-- Logs begin at Tue 2022-07-12 17:42:44 UTC, end at Tue 2022-07-12 18:48:58 UTC. -- Jul 12 18:13:25.751606 dv-cinder-835384-15-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 12 18:13:25.764728 dv-cinder-835384-15-smb devstack@keystone.service[80215]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 12 18:13:25.766799 dv-cinder-835384-15-smb devstack@keystone.service[80215]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 18:13:25 2022] *** Jul 12 18:13:25.766799 dv-cinder-835384-15-smb devstack@keystone.service[80215]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 18:13:25.766799 dv-cinder-835384-15-smb devstack@keystone.service[80215]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 18:13:25.766799 dv-cinder-835384-15-smb devstack@keystone.service[80215]: nodename: dv-cinder-835384-15-smb Jul 12 18:13:25.766799 dv-cinder-835384-15-smb devstack@keystone.service[80215]: machine: x86_64 Jul 12 18:13:25.766799 dv-cinder-835384-15-smb devstack@keystone.service[80215]: clock source: unix Jul 12 18:13:25.766799 dv-cinder-835384-15-smb devstack@keystone.service[80215]: pcre jit disabled Jul 12 18:13:25.766799 dv-cinder-835384-15-smb devstack@keystone.service[80215]: detected number of CPU cores: 4 Jul 12 18:13:25.766799 dv-cinder-835384-15-smb devstack@keystone.service[80215]: current working directory: / Jul 12 18:13:25.766799 dv-cinder-835384-15-smb devstack@keystone.service[80215]: detected binary path: /usr/bin/uwsgi-core Jul 12 18:13:25.767422 dv-cinder-835384-15-smb devstack@keystone.service[80215]: your processes number limit is 47680 Jul 12 18:13:25.767422 dv-cinder-835384-15-smb devstack@keystone.service[80215]: your memory page size is 4096 bytes Jul 12 18:13:25.767422 dv-cinder-835384-15-smb devstack@keystone.service[80215]: detected max file descriptor number: 2048 Jul 12 18:13:25.767422 dv-cinder-835384-15-smb devstack@keystone.service[80215]: lock engine: pthread robust mutexes Jul 12 18:13:25.767422 dv-cinder-835384-15-smb devstack@keystone.service[80215]: thunder lock: enabled Jul 12 18:13:25.767422 dv-cinder-835384-15-smb devstack@keystone.service[80215]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 12 18:13:25.767422 dv-cinder-835384-15-smb devstack@keystone.service[80215]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 18:13:25.811251 dv-cinder-835384-15-smb devstack@keystone.service[80215]: Python main interpreter initialized at 0x557e140169c0 Jul 12 18:13:25.811251 dv-cinder-835384-15-smb devstack@keystone.service[80215]: python threads support enabled Jul 12 18:13:25.811251 dv-cinder-835384-15-smb devstack@keystone.service[80215]: your server socket listen backlog is limited to 100 connections Jul 12 18:13:25.811251 dv-cinder-835384-15-smb devstack@keystone.service[80215]: your mercy for graceful operations on workers is 90 seconds Jul 12 18:13:25.811575 dv-cinder-835384-15-smb devstack@keystone.service[80215]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 18:13:25.811678 dv-cinder-835384-15-smb devstack@keystone.service[80215]: *** Operational MODE: preforking *** Jul 12 18:13:25.811943 dv-cinder-835384-15-smb devstack@keystone.service[80215]: *** uWSGI is running in multiple interpreter mode *** Jul 12 18:13:25.811943 dv-cinder-835384-15-smb devstack@keystone.service[80215]: spawned uWSGI master process (pid: 80215) Jul 12 18:13:25.812132 dv-cinder-835384-15-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 12 18:13:25.812650 dv-cinder-835384-15-smb devstack@keystone.service[80215]: spawned uWSGI worker 1 (pid: 80226, cores: 1) Jul 12 18:13:25.812979 dv-cinder-835384-15-smb devstack@keystone.service[80215]: spawned uWSGI worker 2 (pid: 80227, cores: 1) Jul 12 18:13:25.817339 dv-cinder-835384-15-smb devstack@keystone.service[80215]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 18:13:31.213875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:13:31.213875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: from cryptography.utils import int_from_bytes Jul 12 18:13:31.214666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:13:31.214666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: from cryptography.utils import int_from_bytes Jul 12 18:13:31.264063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 18:13:31.264280 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 18:13:31.264501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] command line args: [] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 18:13:31.264795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 18:13:31.264998 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ================================================================================ {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 18:13:31.265293 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] admin_token = **** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.265581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] config_dir = [] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.265812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.266030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] config_source = [] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.266255 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] debug = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.266481 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.266971 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.267086 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.267375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.267734 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.267929 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] list_limit = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.268160 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] log_config_append = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.268391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.268557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] log_dir = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.268738 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] log_file = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.268978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.269232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.269524 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.269766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.269968 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.270129 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.270379 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.270629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.270873 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.271108 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.271342 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.271579 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.271830 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.272078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.272357 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.272858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.273047 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] publish_errors = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.273343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.273584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.273766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.274016 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.274254 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.274492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] standard_threads = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.274727 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.274975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.275156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.275334 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] use_journal = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.275513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] use_json = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.275691 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] use_stderr = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.275870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] use_syslog = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.276105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.276363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.276606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.276876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.277118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.277397 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.277642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.277895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.278135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.278386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.278637 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.278890 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.279128 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.279378 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.279618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.279869 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.280120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.280378 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.280617 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.280879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.281127 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.281389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.281647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.281926 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.282185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.282438 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.282675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.282909 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.283144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.283402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.283635 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.283887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.284121 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.284356 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.284607 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.284858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.285097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.285378 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.285614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.285853 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.286090 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.286325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.286559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.286795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.287029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.287268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.287521 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.287754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.287992 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.288226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.288465 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.288710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.289513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.289752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.289992 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.290231 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.290470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.290709 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.290948 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.291179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.291438 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.291678 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.291917 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.292153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.292416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.292656 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.292890 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.293129 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.293392 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.293663 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.293906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.294266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.294519 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.294764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.295005 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.295245 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.295498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.295740 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.295983 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.296231 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.296471 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.296711 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.296950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.297188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.297452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.297720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.297965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.298211 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.298454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.298701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.298943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.299183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.299422 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.299657 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.299892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.300126 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.300366 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.300605 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.300849 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.301094 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.301373 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.301613 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.301874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.302138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.302380 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.302614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] auth.external = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.302849 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.303149 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.303385 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.303619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] auth.password = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.303853 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] auth.token = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.304094 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.304332 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.305137 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.305397 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.305650 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.305899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.306133 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.306372 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] credential.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.306631 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.306885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.307137 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.307379 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.307627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.307866 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.308132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.308389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.308631 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.308888 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.309173 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.309449 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.309716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.309965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.310225 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.310464 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] federation.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.310705 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.310956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.311215 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.311458 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.311710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.311951 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.312210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.312451 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.312710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.312951 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.313199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.313465 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.313718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.313969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.314208 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.314448 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.314700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.314936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.315177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.315429 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.315682 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.315918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.316152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.316386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.316634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.316886 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.317136 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.317613 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.317713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.317927 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.318169 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.318408 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.318656 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.319139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.319139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.319460 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.319599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.319771 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.320062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.320282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.320535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.320786 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.321045 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.321301 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.321560 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.321794 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.322041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.322275 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.322770 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.323017 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.323263 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.323505 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.323744 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.323997 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.324250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.324485 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.324719 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.324970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.325221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.325482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.325723 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.325962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.326195 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.326437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.326700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.326934 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.327186 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.327437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.327687 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.327925 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.328160 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.328398 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.328635 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.328873 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.329106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.329378 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.329632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.329881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.330131 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.330380 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.330613 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.330861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.331101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.331344 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.331583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.331819 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.332066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.332318 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.332556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.332812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.333045 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.333314 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.333555 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.333794 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.334032 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.334282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.334524 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.334759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.335005 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.335250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] resource.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.335504 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.336311 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.336554 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.336808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.337059 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.337318 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.337571 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.337812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.338053 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.338290 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] role.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.338540 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] role.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.338774 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.339026 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.339278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.339528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.339780 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.340032 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.340282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.340533 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.340785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.341022 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.341286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.341560 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.341791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.342049 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.342451 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.342693 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.342947 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.343200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.343453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.343702 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.343940 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.344195 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.344448 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.344691 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.344926 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.345159 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.345425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.345681 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.345939 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.346188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.346428 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.346666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.346900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.347138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] token.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.347377 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.347627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.347866 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.348124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.348376 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.348628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.348877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.349123 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.349399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.349642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.349884 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.350122 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.350372 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.350624 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.350857 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.351103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.351975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.352247 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.connection = **** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.352532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.352787 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.353029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.353302 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.353547 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.353787 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.354026 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.354264 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.354510 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.354750 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.355040 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.355230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.355480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.355717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.355963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.356195 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.356438 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.356677 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.356850 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 18:13:31.387424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.387658 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.387884 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.394229 dv-cinder-835384-15-smb devstack@keystone.service[80227]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:13:31.394229 dv-cinder-835384-15-smb devstack@keystone.service[80227]: from cryptography.utils import int_from_bytes Jul 12 18:13:31.394728 dv-cinder-835384-15-smb devstack@keystone.service[80227]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:13:31.394728 dv-cinder-835384-15-smb devstack@keystone.service[80227]: from cryptography.utils import int_from_bytes Jul 12 18:13:31.396383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.425379 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.425609 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.444630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 18:13:31.444843 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 18:13:31.445067 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] command line args: [] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 18:13:31.445374 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 18:13:31.445557 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ================================================================================ {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 18:13:31.445850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] admin_token = **** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.446142 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] config_dir = [] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.446362 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.446549 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] config_source = [] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.446755 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] debug = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.446977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.447218 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.447401 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.447923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.448174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.448408 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] list_limit = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.448591 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] log_config_append = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.448771 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.448951 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] log_dir = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.449130 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] log_file = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.449445 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.449702 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.449953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.450213 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.450394 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.450573 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.450820 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.451068 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.451304 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.451539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.451774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.452040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.452295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.452544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.452888 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.453461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.453679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] publish_errors = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.453946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.454213 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.454492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.454823 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.455119 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.455376 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] standard_threads = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.455637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.455916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.456096 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.456304 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] use_journal = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.456512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] use_json = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.456719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] use_stderr = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.456924 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] use_syslog = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.457159 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:13:31.457494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.457751 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.458065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.458327 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.458617 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.458861 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.459162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.459404 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.459689 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.459996 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.460279 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.460548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.461382 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.461656 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.461939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.462193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.462466 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.462760 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.463050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.463339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.463621 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.463951 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.464205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.464490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.464798 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.465037 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.465411 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.465718 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.465987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.466267 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.466520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.466786 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.467023 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.467278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.467529 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.467769 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.468020 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.468255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.468495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.468732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.468967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.469202 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.469460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.469693 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.469932 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.470184 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.470420 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.470692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.470929 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.471179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.471417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.471668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.471902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.472145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.472386 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.472627 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.472867 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.473110 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.473374 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.473633 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.473873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.474117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.474358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.474625 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.474866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.475102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.475344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.475586 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.475862 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.476105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.476923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.477187 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.477453 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.477715 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.477955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.478208 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.478450 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.478690 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.478936 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.479307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.479651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.479996 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.480288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.480575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.480896 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.481198 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.481496 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.481739 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.482164 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.482443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.482689 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.483012 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.483344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.483586 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.483854 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.484171 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.484467 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.484757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.485002 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.485337 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.485564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.485865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.486135 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.486422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.486660 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] auth.external = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.486936 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.487243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.487522 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.487759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] auth.password = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.488034 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] auth.token = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.488278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.488609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.488863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.489145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.489453 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.489752 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.490017 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.490363 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] credential.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.490631 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.490919 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.491225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.491498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.491798 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.492100 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.492417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.492710 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.493037 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.493352 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.493700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.493989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.494310 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.494590 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.494902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.495173 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] federation.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.495467 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.495748 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.496052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.496325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.496629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.496950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.497281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.497553 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.497863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.498134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.498471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.498741 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.499043 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.499325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.499616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.500050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.500429 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.500737 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.501060 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.501402 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.501740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.502063 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.502381 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.502679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.503012 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.503344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.503705 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.504027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.504362 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.504703 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.505027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.505371 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.505692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.505997 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.506349 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.506622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.507009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.507279 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.507690 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.507938 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.508191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.508443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.508682 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.508934 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.509181 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.509439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.509684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.509972 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.510217 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.510460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.510713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.510957 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.511199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.511454 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.511708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.511945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.512211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.512464 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.512717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.512956 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.513196 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.513456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.513691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.513942 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.514207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.514488 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.514748 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.514998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.515248 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.515486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.515720 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.515959 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.516199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.516474 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.516739 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.517109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.517468 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.517750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.518001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.518348 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.518648 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.518926 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.519170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.519424 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.519664 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.519933 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.520212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.520516 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.520806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.521070 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.521356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.521678 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.522001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.522252 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.522518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.522836 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.523845 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.524240 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.524573 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.524867 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] resource.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.525154 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.525526 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.525809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.526094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.526427 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.526705 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.526987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.527299 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.527548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.527866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] role.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.528169 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] role.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.528439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.528698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.528951 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.529203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.529480 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.529733 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.529983 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.530234 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.530518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.530786 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.531065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.531317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.531571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.531824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.532268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.532510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.532763 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.533016 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.533284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.533610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.534035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.534299 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.534558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.534804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.535042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.535279 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.535515 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.535773 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.536074 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.536329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.536571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.536811 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.537045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.537312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] token.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.537558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.537836 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.538078 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.538340 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.538593 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.538887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.539676 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.539978 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.540416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.540684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.540997 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.541238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.541554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.541811 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.542047 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.542294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.542603 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.542870 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.connection = **** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.543123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.543374 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.543617 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.543888 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.544130 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.544370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.544666 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.544935 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.545235 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.545502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.545800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.546081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.546388 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.546671 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.546924 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.547210 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.547504 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.547775 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:13:31.547982 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 18:13:31.562918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.575975 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.576349 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.576626 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.586543 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.605974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.606263 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.613331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.613574 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.647303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.678892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.679125 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.679874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.680113 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.680335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.680553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.708274 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.708507 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.708741 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.708975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.709199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.709444 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.709664 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.722400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.736336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.736569 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.736800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.737025 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.737245 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.737486 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.737704 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.755483 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.755696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 18:13:31.756041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.756248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 18:13:31.756775 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.757045 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.757343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.758259 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.769204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.769513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.769786 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.770075 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.776586 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.776835 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.778926 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.782267 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.782555 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.782843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.783128 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.783413 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.783677 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.783949 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.784225 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.784500 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.784776 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.785048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.811688 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.813334 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.813622 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.818945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.819228 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.819516 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.823159 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.823395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.823621 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.823850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.824067 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.824284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.827803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.828094 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.832637 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.832933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.833220 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.833531 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.833809 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.834084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.834356 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.834627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.837538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.837778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.838182 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.838409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.838632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.838853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.839073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.847174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.850523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.850760 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.850994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.851225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.851978 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.852196 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.852414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:13:31.854949 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.855237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.859821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.863530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.863830 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.865503 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.865747 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 18:13:31.866135 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.866343 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 18:13:31.866642 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.866973 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.867736 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.868022 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.869606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.873240 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.876936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.877238 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.877559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.877857 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.878141 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.878422 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.879366 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.879654 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.879936 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.880223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.889048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.893092 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.893440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.893803 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.894088 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.894410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.894708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.895152 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.895517 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.895904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.896282 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.896598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.897623 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.897913 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.898234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.898501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.906525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.908511 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.908791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.912026 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.912314 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.912601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.912886 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.913179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.926170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.927071 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.927357 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.927642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.927937 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.928031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.928225 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.928308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.928521 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.928809 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.934414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.934701 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.934979 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.943138 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.943499 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.948742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.948891 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.949208 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.949555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.949879 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.950193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.950526 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.950826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.951154 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.952228 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.955566 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.957194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.958998 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.959278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.959573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.966971 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.968587 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.971634 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.971891 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.971974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.972186 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.972519 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.972763 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.977919 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.982059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.982378 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.982635 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.982927 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.983213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.987978 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.991120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.991403 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.991683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:31.991766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.992779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.993062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.993361 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.993645 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.993925 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.994312 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.994591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.994874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.995144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.995415 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.995688 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.996251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.996560 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.996894 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.997185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.997492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:31.997773 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.018279 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:32.018565 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.018834 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.019138 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.030090 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.032209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.032598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.033824 dv-cinder-835384-15-smb devstack@keystone.service[80226]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557e140169c0 pid: 80226 (default app) Jul 12 18:13:32.036219 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:32.036528 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.036851 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.037153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a246c-63e4-4c84-a76f-445430f7b4e3 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:32.037236 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.037464 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.037547 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a246c-63e4-4c84-a76f-445430f7b4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:32.037748 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a246c-63e4-4c84-a76f-445430f7b4e3 None None] PATH_INFO: `/v3` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:32.042606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Tue Jul 12 18:13:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:13:32.053334 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:32.053677 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.053960 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.054403 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.055337 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.055648 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.055949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.075977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:32.079324 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:32.082783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.084455 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.086743 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:32.087047 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.087366 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.095360 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.097186 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:32.100885 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.101198 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.102069 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.102347 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.112494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:32.112812 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.113249 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.122054 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:13:32.122336 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.123101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.123101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.123268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.123772 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.123772 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.123994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.124311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.124583 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.124902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.125167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.125456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.125744 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:13:32.169634 dv-cinder-835384-15-smb devstack@keystone.service[80227]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557e140169c0 pid: 80227 (default app) Jul 12 18:13:39.730221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17d88d-43fd-46b3-88d9-09f1808a5278 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:39.730766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17d88d-43fd-46b3-88d9-09f1808a5278 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:39.730766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17d88d-43fd-46b3-88d9-09f1808a5278 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:39.732085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:13:39.739302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b1433-78ba-4b74-bbcd-ca5496751202 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:39.739687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b1433-78ba-4b74-bbcd-ca5496751202 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:39.739848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b1433-78ba-4b74-bbcd-ca5496751202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:39.807688 dv-cinder-835384-15-smb devstack@keystone.service[80227]: INFO dbcounter [None req-f50b1433-78ba-4b74-bbcd-ca5496751202 None None] Registered counter for database keystone Jul 12 18:13:39.829068 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG oslo_db.sqlalchemy.engines [None req-f50b1433-78ba-4b74-bbcd-ca5496751202 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80227) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:13:39.835324 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writer thread running {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:13:40.009975 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG passlib.handlers.bcrypt [None req-f50b1433-78ba-4b74-bbcd-ca5496751202 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80227) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 18:13:40.010396 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG passlib.handlers.bcrypt [None req-f50b1433-78ba-4b74-bbcd-ca5496751202 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80227) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 18:13:40.064398 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f50b1433-78ba-4b74-bbcd-ca5496751202 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:40.066026 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f50b1433-78ba-4b74-bbcd-ca5496751202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:40.187212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1/3] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 12 18:13:40.367475 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17d88d-43fd-46b3-88d9-09f1808a5278 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:40.437160 dv-cinder-835384-15-smb devstack@keystone.service[80226]: INFO dbcounter [None req-3f17d88d-43fd-46b3-88d9-09f1808a5278 None None] Registered counter for database keystone Jul 12 18:13:40.456581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG oslo_db.sqlalchemy.engines [None req-3f17d88d-43fd-46b3-88d9-09f1808a5278 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:13:40.462856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writer thread running {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:13:40.584999 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17d88d-43fd-46b3-88d9-09f1808a5278 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:40.590132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0412f7-db10-461a-baab-15942045e133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:40.590811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0412f7-db10-461a-baab-15942045e133 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:40.591100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0412f7-db10-461a-baab-15942045e133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:40.591380 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0412f7-db10-461a-baab-15942045e133 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:40.600174 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0412f7-db10-461a-baab-15942045e133 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:40.655533 dv-cinder-835384-15-smb devstack@keystone.service[80226]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3a0412f7-db10-461a-baab-15942045e133 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 18:13:40.655908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0412f7-db10-461a-baab-15942045e133 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:40.666561 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 3/4] 10.222.0.57 () {58 vars in 1324 bytes} [Tue Jul 12 18:13:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 18:13:40.672845 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b1433-78ba-4b74-bbcd-ca5496751202 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:40.687510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b1433-78ba-4b74-bbcd-ca5496751202 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:40.691935 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c79bc-2262-4615-aac5-05cfbd7aaaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:40.693038 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c79bc-2262-4615-aac5-05cfbd7aaaab admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:40.693355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c79bc-2262-4615-aac5-05cfbd7aaaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:40.693635 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c79bc-2262-4615-aac5-05cfbd7aaaab admin admin] PATH_INFO: `/v3/projects/9596f7aaab1542a3ad455f9c2becff96` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:40.695817 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c79bc-2262-4615-aac5-05cfbd7aaaab admin admin] RBAC: Authorizing `identity:get_project(project_id=9596f7aaab1542a3ad455f9c2becff96)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:40.748162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: WARNING keystone.common.rbac_enforcer.enforcer [None req-303c79bc-2262-4615-aac5-05cfbd7aaaab admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 18:13:40.748692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c79bc-2262-4615-aac5-05cfbd7aaaab admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:40.753016 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 2/5] 10.222.0.57 () {56 vars in 1207 bytes} [Tue Jul 12 18:13:40 2022] GET /identity/v3/projects/9596f7aaab1542a3ad455f9c2becff96 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:13:42.779678 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3723b-8031-4909-8a4c-70028acf512b None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:42.780198 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3723b-8031-4909-8a4c-70028acf512b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:42.780198 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3723b-8031-4909-8a4c-70028acf512b None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:42.784328 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 4/6] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:13:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:42.790127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d373b-1479-4fd1-9c13-2eda925775a7 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:42.790534 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d373b-1479-4fd1-9c13-2eda925775a7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:42.790684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d373b-1479-4fd1-9c13-2eda925775a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:42.809884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9e0d373b-1479-4fd1-9c13-2eda925775a7 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:42.811406 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9e0d373b-1479-4fd1-9c13-2eda925775a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:42.819331 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 3/7] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 12 18:13:42.850657 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3723b-8031-4909-8a4c-70028acf512b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:42.863218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3723b-8031-4909-8a4c-70028acf512b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:42.868086 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab74aaa-8f67-4ba6-ab29-9f69757e53bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:42.868712 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab74aaa-8f67-4ba6-ab29-9f69757e53bb admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:42.868996 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab74aaa-8f67-4ba6-ab29-9f69757e53bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:42.869295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab74aaa-8f67-4ba6-ab29-9f69757e53bb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:42.876915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab74aaa-8f67-4ba6-ab29-9f69757e53bb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:42.878738 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab74aaa-8f67-4ba6-ab29-9f69757e53bb admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:42.887438 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 5/8] 10.222.0.57 () {58 vars in 1324 bytes} [Tue Jul 12 18:13:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:13:42.892649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d373b-1479-4fd1-9c13-2eda925775a7 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:42.901795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d373b-1479-4fd1-9c13-2eda925775a7 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:42.906194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e84d55-d0cb-44ca-9b94-6a096d1228fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:42.907180 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e84d55-d0cb-44ca-9b94-6a096d1228fb admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:42.907469 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e84d55-d0cb-44ca-9b94-6a096d1228fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:42.907749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e84d55-d0cb-44ca-9b94-6a096d1228fb admin admin] PATH_INFO: `/v3/users/932830b2b4ea40b59369012d162538e2` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:42.909137 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e84d55-d0cb-44ca-9b94-6a096d1228fb admin admin] RBAC: Authorizing `identity:get_user(user_id=932830b2b4ea40b59369012d162538e2)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:42.911016 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e84d55-d0cb-44ca-9b94-6a096d1228fb admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:42.912571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 4/9] 10.222.0.57 () {56 vars in 1198 bytes} [Tue Jul 12 18:13:42 2022] GET /identity/v3/users/932830b2b4ea40b59369012d162538e2 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:13:44.983292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5a508-8519-486e-8e1f-bdc3750fdc90 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:44.983830 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5a508-8519-486e-8e1f-bdc3750fdc90 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:44.983911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5a508-8519-486e-8e1f-bdc3750fdc90 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:44.985230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:44.990613 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffacd7-fcc3-453b-be51-608c68e6062c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:44.991035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffacd7-fcc3-453b-be51-608c68e6062c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:44.991175 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffacd7-fcc3-453b-be51-608c68e6062c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:45.008058 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a7ffacd7-fcc3-453b-be51-608c68e6062c None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:45.009232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a7ffacd7-fcc3-453b-be51-608c68e6062c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:45.069035 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ffb59-09a6-402b-87c1-13bfcf51cf31 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:45.069448 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ffb59-09a6-402b-87c1-13bfcf51cf31 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:45.069736 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ffb59-09a6-402b-87c1-13bfcf51cf31 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:45.071095 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 7/11] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:13:45.076605 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff832d-206a-43c7-886b-d0f45e09a7ca None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:45.076894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff832d-206a-43c7-886b-d0f45e09a7ca None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:45.077203 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff832d-206a-43c7-886b-d0f45e09a7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:45.088985 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 5/12] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:13:45.112000 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffacd7-fcc3-453b-be51-608c68e6062c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:45.117780 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG passlib.handlers.bcrypt [None req-a7ff832d-206a-43c7-886b-d0f45e09a7ca None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80226) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 18:13:45.118202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG passlib.handlers.bcrypt [None req-a7ff832d-206a-43c7-886b-d0f45e09a7ca None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80226) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 18:13:45.135829 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:45.165163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a7ff832d-206a-43c7-886b-d0f45e09a7ca None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:45.166805 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a7ff832d-206a-43c7-886b-d0f45e09a7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:45.215767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffacd7-fcc3-453b-be51-608c68e6062c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:45.249554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b70ea-a3d8-4584-ad00-11ba3aa6a5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:45.250288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b70ea-a3d8-4584-ad00-11ba3aa6a5ed None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:45.250576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b70ea-a3d8-4584-ad00-11ba3aa6a5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:45.250861 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b70ea-a3d8-4584-ad00-11ba3aa6a5ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:45.262131 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b70ea-a3d8-4584-ad00-11ba3aa6a5ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:13:45.266398 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 8/13] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:13:45.273882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-838b70ea-a3d8-4584-ad00-11ba3aa6a5ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:13:45.273882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:13:45.273882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:13:45.273882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:13:45.273882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:13:45.273882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:13:45.273882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:13:45.273882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:13:45.273882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:13:45.273882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:13:45.273882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:13:45.273882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:13:45.273882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:13:45.273882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:13:45.273882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:13:45.273882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:13:45.274966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:13:45.274966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:13:45.274966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:13:45.274966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:13:45.274966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:13:45.274966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:13:45.274966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:13:45.274966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:13:45.274966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:13:45.274966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:13:45.274966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:13:45.274966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:13:45.274966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:13:45.274966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:13:45.274966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:13:45.274966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:13:45.275782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:13:45.275782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:13:45.275782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:13:45.275782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:13:45.275782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:13:45.275782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:13:45.275782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:13:45.275782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:13:45.275782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:13:45.275782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:13:45.275782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:13:45.275782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:13:45.275782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 6/14] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:13:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:13:45.280829 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff832d-206a-43c7-886b-d0f45e09a7ca None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:45.289315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b70ea-a3d8-4584-ad00-11ba3aa6a5ed None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:45.375028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:45.385389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff832d-206a-43c7-886b-d0f45e09a7ca None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:45.387817 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:45.393827 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b70ea-a3d8-4584-ad00-11ba3aa6a5ed None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:45.423642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d7303-87d1-47ca-a455-e2ef077977eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:45.424550 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d7303-87d1-47ca-a455-e2ef077977eb None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:45.424837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d7303-87d1-47ca-a455-e2ef077977eb None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:45.425122 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d7303-87d1-47ca-a455-e2ef077977eb None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:45.426056 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d7303-87d1-47ca-a455-e2ef077977eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:13:45.426359 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d7303-87d1-47ca-a455-e2ef077977eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:45.427803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d7303-87d1-47ca-a455-e2ef077977eb None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:45.428985 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfa55e-84c5-4228-8a87-2c04b5a6c451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:45.429682 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfa55e-84c5-4228-8a87-2c04b5a6c451 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:45.429958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfa55e-84c5-4228-8a87-2c04b5a6c451 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:45.430228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfa55e-84c5-4228-8a87-2c04b5a6c451 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:45.439642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 9/15] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:13:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:13:45.445105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d7303-87d1-47ca-a455-e2ef077977eb None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:45.497686 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfa55e-84c5-4228-8a87-2c04b5a6c451 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:45.499160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfa55e-84c5-4228-8a87-2c04b5a6c451 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:45.544354 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d7303-87d1-47ca-a455-e2ef077977eb None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:45.577606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c42a0-47b8-41f8-a84c-74b444c9f75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:45.578498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c42a0-47b8-41f8-a84c-74b444c9f75a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:45.578785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c42a0-47b8-41f8-a84c-74b444c9f75a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:45.579066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c42a0-47b8-41f8-a84c-74b444c9f75a None admin] PATH_INFO: `/v3/users/932830b2b4ea40b59369012d162538e2` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:45.579207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:45.580715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c42a0-47b8-41f8-a84c-74b444c9f75a None admin] RBAC: Authorizing `identity:get_user(user_id=932830b2b4ea40b59369012d162538e2)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:45.582275 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c42a0-47b8-41f8-a84c-74b444c9f75a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:45.583930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 10/16] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:13:45 2022] GET /identity/v3/users/932830b2b4ea40b59369012d162538e2 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:13:45.589843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c42a0-47b8-41f8-a84c-74b444c9f75a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:45.601124 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 7/17] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:13:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 18:13:45.607126 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfa55e-84c5-4228-8a87-2c04b5a6c451 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:45.623388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:45.690065 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c42a0-47b8-41f8-a84c-74b444c9f75a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:45.702830 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfa55e-84c5-4228-8a87-2c04b5a6c451 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:45.724078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606b447-7acc-4708-94ea-e568949b1dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:45.724862 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606b447-7acc-4708-94ea-e568949b1dfd None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:45.725152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606b447-7acc-4708-94ea-e568949b1dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:45.725464 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606b447-7acc-4708-94ea-e568949b1dfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:45.726684 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606b447-7acc-4708-94ea-e568949b1dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:45.728149 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606b447-7acc-4708-94ea-e568949b1dfd None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:45.729759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 11/18] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:13:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:13:45.735476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606b447-7acc-4708-94ea-e568949b1dfd None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:45.738796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9fd77-eb65-48a2-a485-2337be9e6497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:45.739640 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9fd77-eb65-48a2-a485-2337be9e6497 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:45.739957 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9fd77-eb65-48a2-a485-2337be9e6497 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:45.740264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9fd77-eb65-48a2-a485-2337be9e6497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:45.750168 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9fd77-eb65-48a2-a485-2337be9e6497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:45.751626 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9fd77-eb65-48a2-a485-2337be9e6497 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:45.769953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-f1b9fd77-eb65-48a2-a485-2337be9e6497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:13:45.769953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:13:45.769953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:13:45.769953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:13:45.769953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:13:45.769953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:13:45.769953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:13:45.769953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:13:45.769953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:13:45.769953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:13:45.769953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:13:45.769953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:13:45.769953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:13:45.769953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:13:45.769953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:13:45.770930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:13:45.770930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:13:45.770930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:13:45.770930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:13:45.770930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:13:45.770930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:13:45.770930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:13:45.770930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:13:45.770930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:13:45.770930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:13:45.770930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:13:45.770930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:13:45.770930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:13:45.770930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:13:45.770930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:13:45.770930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:13:45.770930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:13:45.771927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:13:45.771927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:13:45.771927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:13:45.771927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:13:45.771927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 8/19] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:13:45.778647 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9fd77-eb65-48a2-a485-2337be9e6497 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:45.811963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:45.833867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606b447-7acc-4708-94ea-e568949b1dfd None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:45.835381 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:45.870544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa2695-0818-4132-b983-78c70651e107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:45.871199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa2695-0818-4132-b983-78c70651e107 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:45.871484 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa2695-0818-4132-b983-78c70651e107 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:45.871760 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa2695-0818-4132-b983-78c70651e107 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:45.872586 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa2695-0818-4132-b983-78c70651e107 None admin] RBAC: Adding query filter params (role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.domain.id=default, user.id=932830b2b4ea40b59369012d162538e2) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:13:45.872899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa2695-0818-4132-b983-78c70651e107 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:45.874384 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa2695-0818-4132-b983-78c70651e107 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:45.880195 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9fd77-eb65-48a2-a485-2337be9e6497 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:45.883263 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 12/20] 10.222.0.57 () {56 vars in 1322 bytes} [Tue Jul 12 18:13:45 2022] GET /identity/v3/role_assignments?user.id=932830b2b4ea40b59369012d162538e2&scope.domain.id=default&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:13:45.916797 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b22b5-a7f9-4907-a187-b335fc3146a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:45.917508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b22b5-a7f9-4907-a187-b335fc3146a1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:45.917796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b22b5-a7f9-4907-a187-b335fc3146a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:45.918073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b22b5-a7f9-4907-a187-b335fc3146a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:45.918827 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b22b5-a7f9-4907-a187-b335fc3146a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:13:45.919138 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b22b5-a7f9-4907-a187-b335fc3146a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:45.920569 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b22b5-a7f9-4907-a187-b335fc3146a1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:45.939942 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 9/21] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:13:48.066768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf653025-4229-45a7-8b59-2b8ed3080add None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:48.067276 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf653025-4229-45a7-8b59-2b8ed3080add None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:48.067375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf653025-4229-45a7-8b59-2b8ed3080add None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:48.068669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 13/22] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:48.074316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728e738-7ff4-4581-b990-13fe68af3eb9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:48.074702 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728e738-7ff4-4581-b990-13fe68af3eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:48.074863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728e738-7ff4-4581-b990-13fe68af3eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:48.107178 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7728e738-7ff4-4581-b990-13fe68af3eb9 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:48.108673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7728e738-7ff4-4581-b990-13fe68af3eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:48.194874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 10/23] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:13:48.229928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf653025-4229-45a7-8b59-2b8ed3080add None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:48.370999 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf653025-4229-45a7-8b59-2b8ed3080add None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:48.417734 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2f758-ddf5-4e5b-a63f-6bdf69c2651d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:48.418857 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2f758-ddf5-4e5b-a63f-6bdf69c2651d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:48.419312 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2f758-ddf5-4e5b-a63f-6bdf69c2651d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:48.419756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2f758-ddf5-4e5b-a63f-6bdf69c2651d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:48.441101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2f758-ddf5-4e5b-a63f-6bdf69c2651d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:13:48.453839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-e5a2f758-ddf5-4e5b-a63f-6bdf69c2651d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:13:48.453839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:13:48.453839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:13:48.453839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:13:48.453839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:13:48.453839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:13:48.453839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:13:48.453839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:13:48.453839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:13:48.453839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:13:48.453839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:13:48.453839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:13:48.453839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:13:48.453839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:13:48.453839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:13:48.453839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:13:48.454706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:13:48.454706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:13:48.454706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:13:48.454706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:13:48.454706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:13:48.454706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:13:48.454706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:13:48.454706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:13:48.454706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:13:48.454706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:13:48.454706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:13:48.454706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:13:48.454706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:13:48.454706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:13:48.454706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:13:48.454706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:13:48.455495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:13:48.455495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:13:48.455495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:13:48.455495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:13:48.455495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:13:48.455495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:13:48.455495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:13:48.455495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:13:48.455495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:13:48.455495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:13:48.455495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:13:48.455495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:13:48.461664 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 14/24] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:13:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:13:48.467556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728e738-7ff4-4581-b990-13fe68af3eb9 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:48.494320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:48.587150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728e738-7ff4-4581-b990-13fe68af3eb9 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:48.622050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178064f2-1dd9-45a3-b7f4-8fea905311d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:48.622984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178064f2-1dd9-45a3-b7f4-8fea905311d9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:48.623441 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178064f2-1dd9-45a3-b7f4-8fea905311d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:48.623914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178064f2-1dd9-45a3-b7f4-8fea905311d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:48.624844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178064f2-1dd9-45a3-b7f4-8fea905311d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:13:48.625352 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178064f2-1dd9-45a3-b7f4-8fea905311d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:48.626924 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178064f2-1dd9-45a3-b7f4-8fea905311d9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:48.639572 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 11/25] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:13:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:13:48.645206 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2f758-ddf5-4e5b-a63f-6bdf69c2651d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:48.684967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:48.784591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2f758-ddf5-4e5b-a63f-6bdf69c2651d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:48.825512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51430d59-19bd-4878-8c1b-2798ef0e0095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:48.826397 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51430d59-19bd-4878-8c1b-2798ef0e0095 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:48.826683 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51430d59-19bd-4878-8c1b-2798ef0e0095 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:48.826959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51430d59-19bd-4878-8c1b-2798ef0e0095 None admin] PATH_INFO: `/v3/users/932830b2b4ea40b59369012d162538e2` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:48.828180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51430d59-19bd-4878-8c1b-2798ef0e0095 None admin] RBAC: Authorizing `identity:get_user(user_id=932830b2b4ea40b59369012d162538e2)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:48.829740 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51430d59-19bd-4878-8c1b-2798ef0e0095 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:48.831431 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 15/26] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:13:48 2022] GET /identity/v3/users/932830b2b4ea40b59369012d162538e2 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:13:48.836868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178064f2-1dd9-45a3-b7f4-8fea905311d9 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:48.899008 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23187f4d-b9f4-40bc-8e0e-d4fe6b3062ea None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:48.899328 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23187f4d-b9f4-40bc-8e0e-d4fe6b3062ea None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:48.899571 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23187f4d-b9f4-40bc-8e0e-d4fe6b3062ea None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:48.901157 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 16/27] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:13:48.906007 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf654f58-b26f-43a5-a6da-1047038d7beb None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:48.906373 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf654f58-b26f-43a5-a6da-1047038d7beb None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:48.906660 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf654f58-b26f-43a5-a6da-1047038d7beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:48.938394 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-cf654f58-b26f-43a5-a6da-1047038d7beb None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:48.939616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-cf654f58-b26f-43a5-a6da-1047038d7beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:48.987350 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:49.005174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178064f2-1dd9-45a3-b7f4-8fea905311d9 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:49.069151 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11679a-5245-4842-9e99-54d85757a8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:49.070248 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11679a-5245-4842-9e99-54d85757a8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:49.070532 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11679a-5245-4842-9e99-54d85757a8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:49.070808 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11679a-5245-4842-9e99-54d85757a8b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:49.072525 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11679a-5245-4842-9e99-54d85757a8b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:49.075727 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11679a-5245-4842-9e99-54d85757a8b8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:49.077593 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 12/28] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:13:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:13:49.078547 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f2352-a4ce-4e1d-839f-f6a7a56e07d4 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:49.079243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f2352-a4ce-4e1d-839f-f6a7a56e07d4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:49.081038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 17/29] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:13:49.081442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f2352-a4ce-4e1d-839f-f6a7a56e07d4 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:49.082688 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 13/30] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:13:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:49.084314 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf654f58-b26f-43a5-a6da-1047038d7beb None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:49.089619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fcc63-d075-4591-998d-f41df02fa331 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:49.090101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fcc63-d075-4591-998d-f41df02fa331 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:49.094865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fcc63-d075-4591-998d-f41df02fa331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:49.115759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:49.116800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-671fcc63-d075-4591-998d-f41df02fa331 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:49.118279 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-671fcc63-d075-4591-998d-f41df02fa331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:49.208970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 14/31] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:13:49.211449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3daf0-f70a-4049-b24e-ab2cabe66adb None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:49.211878 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3daf0-f70a-4049-b24e-ab2cabe66adb None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:49.212291 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3daf0-f70a-4049-b24e-ab2cabe66adb None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:49.213697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 15/32] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:13:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:49.214772 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3daf0-f70a-4049-b24e-ab2cabe66adb None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:49.216904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf654f58-b26f-43a5-a6da-1047038d7beb None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:49.272764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39c1aa-c582-44b9-a8f9-7fc574c6c2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:49.274475 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39c1aa-c582-44b9-a8f9-7fc574c6c2bd None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:49.274903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39c1aa-c582-44b9-a8f9-7fc574c6c2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:49.275322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39c1aa-c582-44b9-a8f9-7fc574c6c2bd None admin] PATH_INFO: `/v3/domains/default/users/932830b2b4ea40b59369012d162538e2/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:49.277740 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39c1aa-c582-44b9-a8f9-7fc574c6c2bd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=932830b2b4ea40b59369012d162538e2, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:49.279494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39c1aa-c582-44b9-a8f9-7fc574c6c2bd None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:49.313892 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:49.331840 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3daf0-f70a-4049-b24e-ab2cabe66adb None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:49.366255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6b5a0-96b7-4e9e-8d18-15584bb7d26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:49.367502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6b5a0-96b7-4e9e-8d18-15584bb7d26e None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:49.367785 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6b5a0-96b7-4e9e-8d18-15584bb7d26e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:49.368057 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6b5a0-96b7-4e9e-8d18-15584bb7d26e None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:49.368803 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6b5a0-96b7-4e9e-8d18-15584bb7d26e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:49.370233 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6b5a0-96b7-4e9e-8d18-15584bb7d26e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:49.417540 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 18/33] 10.222.0.57 () {58 vars in 1361 bytes} [Tue Jul 12 18:13:49 2022] PUT /identity/v3/domains/default/users/932830b2b4ea40b59369012d162538e2/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:13:49.419793 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f2f53-7638-4078-8e57-2dcf6ae63ce8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:49.420273 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f2f53-7638-4078-8e57-2dcf6ae63ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:49.420732 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f2f53-7638-4078-8e57-2dcf6ae63ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:49.441752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d12f2f53-7638-4078-8e57-2dcf6ae63ce8 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:49.443726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d12f2f53-7638-4078-8e57-2dcf6ae63ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:49.500491 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 16/34] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Jul 12 18:13:49 2022] POST /identity/v3/roles => generated 225 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:13:49.501225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6b5a0-96b7-4e9e-8d18-15584bb7d26e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:49.541118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 19/35] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:13:49.542940 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13835e-664d-4d50-8610-656a21c4b11b None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:49.543497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13835e-664d-4d50-8610-656a21c4b11b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:49.544103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13835e-664d-4d50-8610-656a21c4b11b None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:49.557295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 20/36] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:13:49 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:49.563509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466f587-8644-46dd-9b86-128a36f9b6a8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:49.564177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466f587-8644-46dd-9b86-128a36f9b6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:49.564660 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466f587-8644-46dd-9b86-128a36f9b6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:49.600395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6466f587-8644-46dd-9b86-128a36f9b6a8 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:49.603427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6466f587-8644-46dd-9b86-128a36f9b6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:49.637306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:49.668542 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6b5a0-96b7-4e9e-8d18-15584bb7d26e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:49.714613 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 21/37] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:13:49.715367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466f587-8644-46dd-9b86-128a36f9b6a8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:49.716111 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085df4a4-1a77-41a2-9488-a0f1ca7639e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:49.716729 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085df4a4-1a77-41a2-9488-a0f1ca7639e0 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:49.717016 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085df4a4-1a77-41a2-9488-a0f1ca7639e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:49.717331 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085df4a4-1a77-41a2-9488-a0f1ca7639e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:49.718314 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085df4a4-1a77-41a2-9488-a0f1ca7639e0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:49.720784 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085df4a4-1a77-41a2-9488-a0f1ca7639e0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:49.759333 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 17/38] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Jul 12 18:13:49 2022] POST /identity/v3/roles => generated 219 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:13:49.760547 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085df4a4-1a77-41a2-9488-a0f1ca7639e0 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:49.769730 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:49.902151 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085df4a4-1a77-41a2-9488-a0f1ca7639e0 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:49.943827 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34156a-2821-4bb0-8393-9935df8b28c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:49.944659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34156a-2821-4bb0-8393-9935df8b28c0 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:49.945000 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34156a-2821-4bb0-8393-9935df8b28c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:49.945304 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34156a-2821-4bb0-8393-9935df8b28c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:49.946072 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34156a-2821-4bb0-8393-9935df8b28c0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:49.947786 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34156a-2821-4bb0-8393-9935df8b28c0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:49.967512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466f587-8644-46dd-9b86-128a36f9b6a8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:49.968797 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 18/39] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Jul 12 18:13:49 2022] POST /identity/v3/roles => generated 223 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:13:50.014256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a02114-95f9-42de-96e0-d3ac5b4c7ad7 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:50.014460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a02114-95f9-42de-96e0-d3ac5b4c7ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:50.014744 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a02114-95f9-42de-96e0-d3ac5b4c7ad7 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:50.016217 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 19/40] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:13:50.023755 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7f8be-ee86-4459-9cf3-fb6fbdcd9405 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:50.024086 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7f8be-ee86-4459-9cf3-fb6fbdcd9405 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:50.024367 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7f8be-ee86-4459-9cf3-fb6fbdcd9405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:50.028751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d51bb2-d6f8-4440-9a1f-4af1181a9299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:50.029761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d51bb2-d6f8-4440-9a1f-4af1181a9299 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:50.030145 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d51bb2-d6f8-4440-9a1f-4af1181a9299 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:50.030520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d51bb2-d6f8-4440-9a1f-4af1181a9299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:50.056044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d51bb2-d6f8-4440-9a1f-4af1181a9299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:50.059102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d51bb2-d6f8-4440-9a1f-4af1181a9299 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:50.063035 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:50.074456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-72c7f8be-ee86-4459-9cf3-fb6fbdcd9405 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:50.076023 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-72c7f8be-ee86-4459-9cf3-fb6fbdcd9405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:50.083367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-39d51bb2-d6f8-4440-9a1f-4af1181a9299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:13:50.083367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:13:50.083367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:13:50.083367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:13:50.083367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:13:50.083367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:13:50.083367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:13:50.083367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:13:50.083367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:13:50.083367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:13:50.083367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:13:50.083367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:13:50.083367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:13:50.083367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:13:50.083367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:13:50.084512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:13:50.084512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:13:50.084512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:13:50.084512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:13:50.084512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:13:50.084512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:13:50.084512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:13:50.084512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:13:50.084512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:13:50.084512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:13:50.084512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:13:50.084512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:13:50.084512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:13:50.084512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:13:50.084512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:13:50.084512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:13:50.084512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:13:50.085904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:13:50.085904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:13:50.085904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:13:50.085904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:13:50.085904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 22/41] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:13:50.095389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d51bb2-d6f8-4440-9a1f-4af1181a9299 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:50.167404 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:50.177182 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 20/42] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:13:50.201152 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7f8be-ee86-4459-9cf3-fb6fbdcd9405 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:50.231312 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d51bb2-d6f8-4440-9a1f-4af1181a9299 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:50.276159 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570647a-3999-425c-ba52-d70046c3f9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:50.276767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570647a-3999-425c-ba52-d70046c3f9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:50.277055 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570647a-3999-425c-ba52-d70046c3f9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:50.277452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570647a-3999-425c-ba52-d70046c3f9f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:50.278217 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570647a-3999-425c-ba52-d70046c3f9f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:13:50.278534 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570647a-3999-425c-ba52-d70046c3f9f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:50.280017 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570647a-3999-425c-ba52-d70046c3f9f5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:50.301748 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 23/43] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:13:50.308093 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570647a-3999-425c-ba52-d70046c3f9f5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:50.371371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:50.417782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570647a-3999-425c-ba52-d70046c3f9f5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:50.434412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7f8be-ee86-4459-9cf3-fb6fbdcd9405 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:50.452493 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286bf6a-342f-4695-b886-a29c280925d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:50.453153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286bf6a-342f-4695-b886-a29c280925d1 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:50.453542 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286bf6a-342f-4695-b886-a29c280925d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:50.453827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286bf6a-342f-4695-b886-a29c280925d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:50.454539 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286bf6a-342f-4695-b886-a29c280925d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:50.456085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286bf6a-342f-4695-b886-a29c280925d1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:50.475300 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33470de-ed5b-43c7-a7d3-97612c0640c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:50.476895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33470de-ed5b-43c7-a7d3-97612c0640c9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:50.477215 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33470de-ed5b-43c7-a7d3-97612c0640c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:50.477730 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33470de-ed5b-43c7-a7d3-97612c0640c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:50.478922 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33470de-ed5b-43c7-a7d3-97612c0640c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:50.480380 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33470de-ed5b-43c7-a7d3-97612c0640c9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:50.482035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 21/44] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:13:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:13:50.493508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 24/45] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Jul 12 18:13:50 2022] POST /identity/v3/projects => generated 301 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:13:50.493728 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33470de-ed5b-43c7-a7d3-97612c0640c9 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:50.561212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:50.610518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33470de-ed5b-43c7-a7d3-97612c0640c9 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:50.649163 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ce75d-882e-4e07-88eb-f8b92cb3d1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:50.649858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ce75d-882e-4e07-88eb-f8b92cb3d1b8 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:50.650140 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ce75d-882e-4e07-88eb-f8b92cb3d1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:50.651182 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ce75d-882e-4e07-88eb-f8b92cb3d1b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:50.654015 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ce75d-882e-4e07-88eb-f8b92cb3d1b8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:50.655717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ce75d-882e-4e07-88eb-f8b92cb3d1b8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:50.685030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 22/46] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Jul 12 18:13:50 2022] POST /identity/v3/projects => generated 312 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:13:51.679053 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ef81b-0904-4ff1-9a9d-7fbc09f9e1c3 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:51.679567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ef81b-0904-4ff1-9a9d-7fbc09f9e1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:51.679722 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ef81b-0904-4ff1-9a9d-7fbc09f9e1c3 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:51.681159 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 25/47] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:51.686311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf406c88-dbad-4291-a3e8-be62d2cc605f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:51.686686 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf406c88-dbad-4291-a3e8-be62d2cc605f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:51.686875 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf406c88-dbad-4291-a3e8-be62d2cc605f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:51.703890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-cf406c88-dbad-4291-a3e8-be62d2cc605f None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:51.705057 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-cf406c88-dbad-4291-a3e8-be62d2cc605f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:51.769713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 23/48] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:13:51.793575 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ef81b-0904-4ff1-9a9d-7fbc09f9e1c3 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:51.895790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ef81b-0904-4ff1-9a9d-7fbc09f9e1c3 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:51.904889 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:51.931309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def31e65-8d54-46f9-af5c-84d087dcd067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:51.932108 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def31e65-8d54-46f9-af5c-84d087dcd067 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:51.932392 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def31e65-8d54-46f9-af5c-84d087dcd067 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:51.932664 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def31e65-8d54-46f9-af5c-84d087dcd067 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:51.942709 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def31e65-8d54-46f9-af5c-84d087dcd067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:13:51.950644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-def31e65-8d54-46f9-af5c-84d087dcd067 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:13:51.950644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:13:51.950644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:13:51.950644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:13:51.950644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:13:51.950644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:13:51.950644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:13:51.950644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:13:51.950644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:13:51.950644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:13:51.950644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:13:51.950644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:13:51.950644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:13:51.950644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:13:51.950644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:13:51.950644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:13:51.951454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:13:51.951454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:13:51.951454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:13:51.951454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:13:51.951454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:13:51.951454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:13:51.951454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:13:51.951454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:13:51.951454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:13:51.951454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:13:51.951454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:13:51.951454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:13:51.951454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:13:51.951454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:13:51.951454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:13:51.951454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:13:51.952257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:13:51.952257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:13:51.952257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:13:51.952257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:13:51.952257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:13:51.952257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:13:51.952257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:13:51.952257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:13:51.952257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:13:51.952257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:13:51.952257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:13:51.952257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:13:51.952257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 26/49] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:13:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:13:51.957559 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf406c88-dbad-4291-a3e8-be62d2cc605f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:52.002010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:52.055197 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf406c88-dbad-4291-a3e8-be62d2cc605f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:52.088255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ae325-55f1-4ae8-a2e6-05c95a3a713d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:52.088915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ae325-55f1-4ae8-a2e6-05c95a3a713d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:52.089205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ae325-55f1-4ae8-a2e6-05c95a3a713d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:52.089526 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ae325-55f1-4ae8-a2e6-05c95a3a713d None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:52.090273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ae325-55f1-4ae8-a2e6-05c95a3a713d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:13:52.090588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ae325-55f1-4ae8-a2e6-05c95a3a713d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:52.091987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ae325-55f1-4ae8-a2e6-05c95a3a713d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:52.099937 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 24/50] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:13:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:13:52.105927 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def31e65-8d54-46f9-af5c-84d087dcd067 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:52.309225 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def31e65-8d54-46f9-af5c-84d087dcd067 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:52.342814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3c60d-aaa4-4fd4-a725-42fe4deb31c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:52.343689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3c60d-aaa4-4fd4-a725-42fe4deb31c8 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:52.343977 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3c60d-aaa4-4fd4-a725-42fe4deb31c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:52.344254 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3c60d-aaa4-4fd4-a725-42fe4deb31c8 None admin] PATH_INFO: `/v3/users/932830b2b4ea40b59369012d162538e2` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:52.345476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3c60d-aaa4-4fd4-a725-42fe4deb31c8 None admin] RBAC: Authorizing `identity:get_user(user_id=932830b2b4ea40b59369012d162538e2)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:52.346936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3c60d-aaa4-4fd4-a725-42fe4deb31c8 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:52.348566 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 27/51] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:13:52 2022] GET /identity/v3/users/932830b2b4ea40b59369012d162538e2 => generated 247 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:13:52.354553 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ae325-55f1-4ae8-a2e6-05c95a3a713d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:52.450749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ae325-55f1-4ae8-a2e6-05c95a3a713d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:52.458596 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:52.485428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dc87e-6a96-44c5-8220-7384025e08e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:52.486209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dc87e-6a96-44c5-8220-7384025e08e4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:52.486488 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dc87e-6a96-44c5-8220-7384025e08e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:52.486753 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dc87e-6a96-44c5-8220-7384025e08e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:52.487908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dc87e-6a96-44c5-8220-7384025e08e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:52.489404 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dc87e-6a96-44c5-8220-7384025e08e4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:52.490992 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 25/52] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:13:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:13:52.496628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3c60d-aaa4-4fd4-a725-42fe4deb31c8 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:52.530728 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:52.597939 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3c60d-aaa4-4fd4-a725-42fe4deb31c8 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:52.631292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70166fd3-eed6-484c-83c6-cb85ca28f551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:52.631942 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70166fd3-eed6-484c-83c6-cb85ca28f551 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:52.632230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70166fd3-eed6-484c-83c6-cb85ca28f551 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:52.632505 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70166fd3-eed6-484c-83c6-cb85ca28f551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:52.633360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70166fd3-eed6-484c-83c6-cb85ca28f551 None admin] RBAC: Adding query filter params (role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.domain.id=default, user.id=932830b2b4ea40b59369012d162538e2) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:13:52.633671 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70166fd3-eed6-484c-83c6-cb85ca28f551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:52.635106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70166fd3-eed6-484c-83c6-cb85ca28f551 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:52.640831 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 28/53] 10.222.0.57 () {56 vars in 1322 bytes} [Tue Jul 12 18:13:52 2022] GET /identity/v3/role_assignments?user.id=932830b2b4ea40b59369012d162538e2&scope.domain.id=default&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:13:52.711013 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c0ea4-f1f6-4cc2-b01f-74837ac37613 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:52.711536 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c0ea4-f1f6-4cc2-b01f-74837ac37613 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:52.711616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c0ea4-f1f6-4cc2-b01f-74837ac37613 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:52.712972 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 26/54] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:52.718938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a310ca-0ecb-4573-acf2-4194487d6664 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:52.719460 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a310ca-0ecb-4573-acf2-4194487d6664 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:52.719460 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a310ca-0ecb-4573-acf2-4194487d6664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:52.737048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-55a310ca-0ecb-4573-acf2-4194487d6664 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:52.738321 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-55a310ca-0ecb-4573-acf2-4194487d6664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:52.807994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 29/55] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:13:52.831641 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c0ea4-f1f6-4cc2-b01f-74837ac37613 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:52.939345 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c0ea4-f1f6-4cc2-b01f-74837ac37613 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:52.971917 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb71585-cc30-4fd7-b21a-b0c1455d8fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:52.972699 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb71585-cc30-4fd7-b21a-b0c1455d8fbb None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:52.972981 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb71585-cc30-4fd7-b21a-b0c1455d8fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:52.973285 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb71585-cc30-4fd7-b21a-b0c1455d8fbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:52.974432 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb71585-cc30-4fd7-b21a-b0c1455d8fbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:52.975869 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb71585-cc30-4fd7-b21a-b0c1455d8fbb None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:52.978047 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 27/56] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:13:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:13:52.983715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a310ca-0ecb-4573-acf2-4194487d6664 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:53.012389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:53.082668 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a310ca-0ecb-4573-acf2-4194487d6664 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:53.115802 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79165d23-7648-4d7b-bf32-30ea23a7660e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:53.116469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165d23-7648-4d7b-bf32-30ea23a7660e None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:53.116759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165d23-7648-4d7b-bf32-30ea23a7660e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:53.117042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165d23-7648-4d7b-bf32-30ea23a7660e None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:53.117784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79165d23-7648-4d7b-bf32-30ea23a7660e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:53.119257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79165d23-7648-4d7b-bf32-30ea23a7660e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:53.143880 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 30/57] 10.222.0.57 () {60 vars in 1140 bytes} [Tue Jul 12 18:13:52 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:13:55.158853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4d1ae-c4d1-48c7-8862-8d6cfb4737bb None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:55.159362 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4d1ae-c4d1-48c7-8862-8d6cfb4737bb None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:55.159442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4d1ae-c4d1-48c7-8862-8d6cfb4737bb None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:55.160749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 28/58] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:55.166345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5646749-77ce-4dfe-9ae4-893f96e5398e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:55.166699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5646749-77ce-4dfe-9ae4-893f96e5398e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:55.166916 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5646749-77ce-4dfe-9ae4-893f96e5398e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:55.184124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c5646749-77ce-4dfe-9ae4-893f96e5398e None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:55.185347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c5646749-77ce-4dfe-9ae4-893f96e5398e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:55.250612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 31/59] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:13:55.274791 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4d1ae-c4d1-48c7-8862-8d6cfb4737bb None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:55.318697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:55.373051 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4d1ae-c4d1-48c7-8862-8d6cfb4737bb None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:55.404982 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc0c9a-01ea-4762-8ee6-3ae9d613129c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:55.405780 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc0c9a-01ea-4762-8ee6-3ae9d613129c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:55.406060 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc0c9a-01ea-4762-8ee6-3ae9d613129c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:55.406333 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc0c9a-01ea-4762-8ee6-3ae9d613129c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:55.407490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc0c9a-01ea-4762-8ee6-3ae9d613129c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:55.408975 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc0c9a-01ea-4762-8ee6-3ae9d613129c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:55.410524 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 29/60] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:13:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:13:55.416462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5646749-77ce-4dfe-9ae4-893f96e5398e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:55.430826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:55.514489 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5646749-77ce-4dfe-9ae4-893f96e5398e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:55.547191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7310add-fc56-4bab-b042-104b1c6652e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:55.547852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7310add-fc56-4bab-b042-104b1c6652e6 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:55.548141 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7310add-fc56-4bab-b042-104b1c6652e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:55.548422 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7310add-fc56-4bab-b042-104b1c6652e6 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:55.549130 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7310add-fc56-4bab-b042-104b1c6652e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:55.550628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7310add-fc56-4bab-b042-104b1c6652e6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:55.576722 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 32/61] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Jul 12 18:13:55 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:13:58.647162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e3ecd-878d-4ae7-9c01-73ebc43d7ab9 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:58.647162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e3ecd-878d-4ae7-9c01-73ebc43d7ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:58.647162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e3ecd-878d-4ae7-9c01-73ebc43d7ab9 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:58.648178 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 30/62] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:58.652423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812cb8d-f54e-4f44-8eea-a17b6b5332a2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:58.652822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812cb8d-f54e-4f44-8eea-a17b6b5332a2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:58.653059 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812cb8d-f54e-4f44-8eea-a17b6b5332a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:58.675032 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d812cb8d-f54e-4f44-8eea-a17b6b5332a2 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:58.676242 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d812cb8d-f54e-4f44-8eea-a17b6b5332a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:58.761322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:58.772058 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 33/63] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:13:58.799322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e3ecd-878d-4ae7-9c01-73ebc43d7ab9 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:58.954023 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e3ecd-878d-4ae7-9c01-73ebc43d7ab9 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:58.969134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:59.003325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84c9b1-4572-494c-abfa-63a2e18097b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:59.004147 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84c9b1-4572-494c-abfa-63a2e18097b8 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:59.004430 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84c9b1-4572-494c-abfa-63a2e18097b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:59.004707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84c9b1-4572-494c-abfa-63a2e18097b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:59.018544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dd390-87e5-41d7-bda6-bd16ce158c6b None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:59.019153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dd390-87e5-41d7-bda6-bd16ce158c6b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:59.019634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dd390-87e5-41d7-bda6-bd16ce158c6b None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:59.020268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84c9b1-4572-494c-abfa-63a2e18097b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:13:59.021524 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 34/64] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:59.027124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1751b0-4e2e-44f1-8f26-d056b57e265a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:59.027656 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1751b0-4e2e-44f1-8f26-d056b57e265a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:59.028134 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1751b0-4e2e-44f1-8f26-d056b57e265a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:59.029781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-9b84c9b1-4572-494c-abfa-63a2e18097b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:13:59.029781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:13:59.029781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:13:59.029781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:13:59.029781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:13:59.029781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:13:59.029781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:13:59.029781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:13:59.029781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:13:59.029781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:13:59.029781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:13:59.029781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:13:59.029781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:13:59.029781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:13:59.029781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:13:59.029781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:13:59.030605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:13:59.030605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:13:59.030605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:13:59.030605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:13:59.030605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:13:59.030605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:13:59.030605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:13:59.030605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:13:59.030605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:13:59.030605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:13:59.030605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:13:59.030605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:13:59.030605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:13:59.030605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:13:59.030605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:13:59.030605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:13:59.031357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:13:59.031357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:13:59.031357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:13:59.031357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:13:59.031357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:13:59.031357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:13:59.031357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:13:59.031357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:13:59.031357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:13:59.031357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:13:59.031357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:13:59.031357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:13:59.031357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 31/65] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:13:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:13:59.039703 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84c9b1-4572-494c-abfa-63a2e18097b8 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:59.066501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4f1751b0-4e2e-44f1-8f26-d056b57e265a None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:59.068207 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4f1751b0-4e2e-44f1-8f26-d056b57e265a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:59.151348 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84c9b1-4572-494c-abfa-63a2e18097b8 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:59.170473 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 35/66] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:13:59.172165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed4a13-866e-47e9-8cee-24a4b572683f None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:59.172658 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed4a13-866e-47e9-8cee-24a4b572683f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:59.173134 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed4a13-866e-47e9-8cee-24a4b572683f None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:59.174902 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 36/67] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:59.176166 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43b987-fc95-4d05-bf48-076a2711a744 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:59.176673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43b987-fc95-4d05-bf48-076a2711a744 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:59.177150 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43b987-fc95-4d05-bf48-076a2711a744 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:59.178819 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 37/68] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:59.180162 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505186b-ff04-47d7-9c32-4251e7639098 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:59.180647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505186b-ff04-47d7-9c32-4251e7639098 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:59.181157 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505186b-ff04-47d7-9c32-4251e7639098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:59.189875 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2709162-de51-4dac-ba91-84b5cff8e220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:59.190548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2709162-de51-4dac-ba91-84b5cff8e220 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:59.190831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2709162-de51-4dac-ba91-84b5cff8e220 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:59.191106 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2709162-de51-4dac-ba91-84b5cff8e220 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:59.191860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2709162-de51-4dac-ba91-84b5cff8e220 None admin] RBAC: Adding query filter params (name=member) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:13:59.192474 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2709162-de51-4dac-ba91-84b5cff8e220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:59.194189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2709162-de51-4dac-ba91-84b5cff8e220 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:59.201330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-3505186b-ff04-47d7-9c32-4251e7639098 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:59.202537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3505186b-ff04-47d7-9c32-4251e7639098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:59.203657 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 32/69] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:13:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:13:59.205518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d9a5f-08d9-43a3-a683-12a6955aa1f2 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:59.205756 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d9a5f-08d9-43a3-a683-12a6955aa1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:59.206033 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d9a5f-08d9-43a3-a683-12a6955aa1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:59.224254 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-562d9a5f-08d9-43a3-a683-12a6955aa1f2 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:59.225495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-562d9a5f-08d9-43a3-a683-12a6955aa1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:59.253607 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:59.276627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 38/70] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:13:59.277512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505186b-ff04-47d7-9c32-4251e7639098 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:59.301608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 33/71] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:13:59.302449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d9a5f-08d9-43a3-a683-12a6955aa1f2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:59.339892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:59.381513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505186b-ff04-47d7-9c32-4251e7639098 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:59.401724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d9a5f-08d9-43a3-a683-12a6955aa1f2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:59.415811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11a26b-cba1-4951-ba1f-d0b8b5683e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:59.416601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11a26b-cba1-4951-ba1f-d0b8b5683e6b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:59.416879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11a26b-cba1-4951-ba1f-d0b8b5683e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:59.417151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11a26b-cba1-4951-ba1f-d0b8b5683e6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:59.426953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11a26b-cba1-4951-ba1f-d0b8b5683e6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:13:59.435261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-ab11a26b-cba1-4951-ba1f-d0b8b5683e6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:13:59.435261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:13:59.435261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:13:59.435261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:13:59.435261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:13:59.435261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:13:59.435261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:13:59.435261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:13:59.435261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:13:59.435261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:13:59.435261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:13:59.435261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:13:59.435261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:13:59.435261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:13:59.435261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:13:59.435261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:13:59.436292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:13:59.436292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:13:59.436292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:13:59.436292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:13:59.436292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:13:59.436292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:13:59.436292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:13:59.436292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:13:59.436292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:13:59.436292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:13:59.436292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:13:59.436292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:13:59.436292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:13:59.436292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:13:59.436292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:13:59.436292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:13:59.442028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:13:59.442028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:13:59.442028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:13:59.442028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:13:59.442028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:13:59.442028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:13:59.442028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:13:59.442028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:13:59.442028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:13:59.442028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:13:59.442028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:13:59.442028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:13:59.442596 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223340bc-e4a4-4303-bc83-4308a14cefe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:59.442596 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223340bc-e4a4-4303-bc83-4308a14cefe3 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:59.442733 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 39/72] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:13:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:13:59.442795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223340bc-e4a4-4303-bc83-4308a14cefe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:59.442795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223340bc-e4a4-4303-bc83-4308a14cefe3 None admin] PATH_INFO: `/v3/users/d8b17c78161f4eebba3a526db806cf9e` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:59.442912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c71b5-5d60-4ce5-b648-6a715e967825 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:59.442912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c71b5-5d60-4ce5-b648-6a715e967825 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:59.442912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c71b5-5d60-4ce5-b648-6a715e967825 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:59.442912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 40/73] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:59.442912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c71b5-5d60-4ce5-b648-6a715e967825 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:59.454846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223340bc-e4a4-4303-bc83-4308a14cefe3 None admin] RBAC: Authorizing `identity:get_user(user_id=d8b17c78161f4eebba3a526db806cf9e)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:59.456396 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223340bc-e4a4-4303-bc83-4308a14cefe3 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:59.458052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 34/74] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:13:59 2022] GET /identity/v3/users/d8b17c78161f4eebba3a526db806cf9e => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:13:59.462700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223340bc-e4a4-4303-bc83-4308a14cefe3 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:59.484499 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:59.544300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c71b5-5d60-4ce5-b648-6a715e967825 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:59.560875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:59.571637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223340bc-e4a4-4303-bc83-4308a14cefe3 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:59.578926 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b80e7e-21e2-4fb1-84d8-5ebe384ee3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:59.579747 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b80e7e-21e2-4fb1-84d8-5ebe384ee3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:59.580031 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b80e7e-21e2-4fb1-84d8-5ebe384ee3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:59.580306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b80e7e-21e2-4fb1-84d8-5ebe384ee3d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:59.591087 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b80e7e-21e2-4fb1-84d8-5ebe384ee3d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:13:59.599253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-15b80e7e-21e2-4fb1-84d8-5ebe384ee3d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:13:59.599253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:13:59.599253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:13:59.599253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:13:59.599253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:13:59.599253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:13:59.599253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:13:59.599253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:13:59.599253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:13:59.599253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:13:59.599253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:13:59.599253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:13:59.599253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:13:59.599253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:13:59.599253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:13:59.599253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:13:59.600115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:13:59.600115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:13:59.600115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:13:59.600115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:13:59.600115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:13:59.600115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:13:59.600115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:13:59.600115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:13:59.600115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:13:59.600115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:13:59.600115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:13:59.600115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:13:59.600115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:13:59.600115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:13:59.600115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:13:59.600115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:13:59.600915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:13:59.600915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:13:59.600915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:13:59.600915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:13:59.600915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:13:59.600915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:13:59.600915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:13:59.600915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:13:59.600915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:13:59.600915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:13:59.600915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:13:59.600915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:13:59.600915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 41/75] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:13:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:13:59.602107 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b80e7e-21e2-4fb1-84d8-5ebe384ee3d4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:59.606662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167021c-099c-4f63-a4b9-332785e4306c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:59.607461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167021c-099c-4f63-a4b9-332785e4306c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:59.607756 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167021c-099c-4f63-a4b9-332785e4306c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:59.608160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167021c-099c-4f63-a4b9-332785e4306c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:59.609396 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167021c-099c-4f63-a4b9-332785e4306c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:59.610871 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167021c-099c-4f63-a4b9-332785e4306c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:59.612622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 35/76] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:13:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:13:59.613643 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0364b5-7b23-488d-9320-7cd1bd984e87 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:59.613934 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0364b5-7b23-488d-9320-7cd1bd984e87 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:59.614215 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0364b5-7b23-488d-9320-7cd1bd984e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:59.630443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1e0364b5-7b23-488d-9320-7cd1bd984e87 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:59.631642 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1e0364b5-7b23-488d-9320-7cd1bd984e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:59.696914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 36/77] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:13:59.697763 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0364b5-7b23-488d-9320-7cd1bd984e87 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:59.712552 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b80e7e-21e2-4fb1-84d8-5ebe384ee3d4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:59.716478 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:59.746304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08bd3e-349a-4f9e-9bf3-ceef4884cb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:59.746969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08bd3e-349a-4f9e-9bf3-ceef4884cb29 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:59.747256 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08bd3e-349a-4f9e-9bf3-ceef4884cb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:59.747534 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08bd3e-349a-4f9e-9bf3-ceef4884cb29 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:59.748280 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08bd3e-349a-4f9e-9bf3-ceef4884cb29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:13:59.748599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08bd3e-349a-4f9e-9bf3-ceef4884cb29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:59.750025 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08bd3e-349a-4f9e-9bf3-ceef4884cb29 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:59.758162 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 42/78] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:13:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:13:59.759494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08bd3e-349a-4f9e-9bf3-ceef4884cb29 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:59.799839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0364b5-7b23-488d-9320-7cd1bd984e87 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:59.801073 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:59.833444 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e875b6-07e4-48ac-9368-6903702104ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:59.834094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e875b6-07e4-48ac-9368-6903702104ee None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:59.834382 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e875b6-07e4-48ac-9368-6903702104ee None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:59.834662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e875b6-07e4-48ac-9368-6903702104ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:59.859843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08bd3e-349a-4f9e-9bf3-ceef4884cb29 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:59.893759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fc52a-11ea-42ac-bef8-7b5a4e9075f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:59.894425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fc52a-11ea-42ac-bef8-7b5a4e9075f1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:59.894712 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fc52a-11ea-42ac-bef8-7b5a4e9075f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:59.894992 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fc52a-11ea-42ac-bef8-7b5a4e9075f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:59.895739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fc52a-11ea-42ac-bef8-7b5a4e9075f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:13:59.896052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fc52a-11ea-42ac-bef8-7b5a4e9075f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:59.897459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fc52a-11ea-42ac-bef8-7b5a4e9075f1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:59.901550 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e875b6-07e4-48ac-9368-6903702104ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:59.903022 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e875b6-07e4-48ac-9368-6903702104ee None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:59.906207 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 43/79] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:13:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:13:59.906964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fc52a-11ea-42ac-bef8-7b5a4e9075f1 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:59.921209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:00.001667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 37/80] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:13:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:00.002417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e875b6-07e4-48ac-9368-6903702104ee None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:00.010591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fc52a-11ea-42ac-bef8-7b5a4e9075f1 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:00.012138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:00.044765 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabebb6c-20f4-40c3-894d-fccf2e78c9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:00.045453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabebb6c-20f4-40c3-894d-fccf2e78c9e3 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:00.045743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabebb6c-20f4-40c3-894d-fccf2e78c9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:00.046020 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabebb6c-20f4-40c3-894d-fccf2e78c9e3 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:00.046729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabebb6c-20f4-40c3-894d-fccf2e78c9e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:00.048178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabebb6c-20f4-40c3-894d-fccf2e78c9e3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:00.067731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 44/81] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Jul 12 18:13:59 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:14:00.068529 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabebb6c-20f4-40c3-894d-fccf2e78c9e3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:00.108886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e875b6-07e4-48ac-9368-6903702104ee None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:00.130563 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:00.151122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e870f-d35b-48f1-8ea4-faa81bac5913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:00.152041 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e870f-d35b-48f1-8ea4-faa81bac5913 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:00.152331 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e870f-d35b-48f1-8ea4-faa81bac5913 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:00.152607 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e870f-d35b-48f1-8ea4-faa81bac5913 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:00.166260 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e870f-d35b-48f1-8ea4-faa81bac5913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:00.176742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-ec3e870f-d35b-48f1-8ea4-faa81bac5913 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:00.176742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:00.176742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:00.176742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:00.176742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:00.176742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:00.176742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:00.176742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:00.176742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:00.176742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:00.176742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:00.176742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:00.176742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:00.176742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:00.176742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:00.176742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:00.177949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:00.177949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:00.177949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:00.177949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:00.177949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:00.177949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:00.177949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:00.177949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:00.177949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:00.177949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:00.177949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:00.177949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:00.177949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:00.177949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:00.177949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:00.177949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:00.184287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:00.184287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:00.184287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:00.184287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:00.184287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:00.184287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:00.184287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:00.184287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:00.184287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:00.184287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:00.184287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:00.184287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:00.184287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 38/82] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:00.184287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e870f-d35b-48f1-8ea4-faa81bac5913 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:00.191343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabebb6c-20f4-40c3-894d-fccf2e78c9e3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:00.229570 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ea263-e331-48bd-a627-d92fc688a1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:00.230453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ea263-e331-48bd-a627-d92fc688a1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:00.230747 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ea263-e331-48bd-a627-d92fc688a1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:00.231452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ea263-e331-48bd-a627-d92fc688a1e5 None admin] PATH_INFO: `/v3/users/932830b2b4ea40b59369012d162538e2` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:00.232687 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ea263-e331-48bd-a627-d92fc688a1e5 None admin] RBAC: Authorizing `identity:get_user(user_id=932830b2b4ea40b59369012d162538e2)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:00.235617 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ea263-e331-48bd-a627-d92fc688a1e5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:00.236525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 45/83] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:00 2022] GET /identity/v3/users/932830b2b4ea40b59369012d162538e2 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:00.238183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ea263-e331-48bd-a627-d92fc688a1e5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:00.269296 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:00.303743 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e870f-d35b-48f1-8ea4-faa81bac5913 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:00.343089 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00153966-39a3-4d0a-97fa-7769033ed81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:00.344034 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00153966-39a3-4d0a-97fa-7769033ed81a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:00.344381 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00153966-39a3-4d0a-97fa-7769033ed81a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:00.344713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00153966-39a3-4d0a-97fa-7769033ed81a None admin] PATH_INFO: `/v3/users/d8b17c78161f4eebba3a526db806cf9e` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:00.346171 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00153966-39a3-4d0a-97fa-7769033ed81a None admin] RBAC: Authorizing `identity:get_user(user_id=d8b17c78161f4eebba3a526db806cf9e)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:00.347733 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00153966-39a3-4d0a-97fa-7769033ed81a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:00.349979 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 39/84] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:00 2022] GET /identity/v3/users/d8b17c78161f4eebba3a526db806cf9e => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:00.350961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00153966-39a3-4d0a-97fa-7769033ed81a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:00.357568 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ea263-e331-48bd-a627-d92fc688a1e5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:00.400794 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3750a20-0943-471a-a843-20e707c76487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:00.402362 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3750a20-0943-471a-a843-20e707c76487 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:00.402362 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3750a20-0943-471a-a843-20e707c76487 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:00.402362 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3750a20-0943-471a-a843-20e707c76487 None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:00.403467 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3750a20-0943-471a-a843-20e707c76487 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd455713ae940308a0af4cdfeb3c374)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:00.404945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3750a20-0943-471a-a843-20e707c76487 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:00.406913 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 46/85] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:00 2022] GET /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:00.411835 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3750a20-0943-471a-a843-20e707c76487 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:00.417708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:00.479032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00153966-39a3-4d0a-97fa-7769033ed81a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:00.518333 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f0713-7705-4ad2-9292-b0bea6584091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:00.518999 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f0713-7705-4ad2-9292-b0bea6584091 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:00.519287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f0713-7705-4ad2-9292-b0bea6584091 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:00.519668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f0713-7705-4ad2-9292-b0bea6584091 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:00.520380 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f0713-7705-4ad2-9292-b0bea6584091 None admin] RBAC: Adding query filter params (name=member) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:00.520697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f0713-7705-4ad2-9292-b0bea6584091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:00.522136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f0713-7705-4ad2-9292-b0bea6584091 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:00.535592 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 40/86] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:00.535592 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f0713-7705-4ad2-9292-b0bea6584091 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:00.541558 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:00.550008 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3750a20-0943-471a-a843-20e707c76487 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:00.593636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23763ef1-8c27-49e2-bb29-8b626c40a5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:00.594296 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23763ef1-8c27-49e2-bb29-8b626c40a5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:00.594585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23763ef1-8c27-49e2-bb29-8b626c40a5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:00.594887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23763ef1-8c27-49e2-bb29-8b626c40a5c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:00.677220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f0713-7705-4ad2-9292-b0bea6584091 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:00.688205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:00.689646 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23763ef1-8c27-49e2-bb29-8b626c40a5c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:00.691148 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23763ef1-8c27-49e2-bb29-8b626c40a5c8 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:00.723401 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad003f-e72a-44e4-89c7-b1ebcbe4f3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:00.725123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad003f-e72a-44e4-89c7-b1ebcbe4f3ad None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:00.725679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad003f-e72a-44e4-89c7-b1ebcbe4f3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:00.726624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad003f-e72a-44e4-89c7-b1ebcbe4f3ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:00.801146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:00.813424 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad003f-e72a-44e4-89c7-b1ebcbe4f3ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:00.814943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 47/87] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:00.815943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23763ef1-8c27-49e2-bb29-8b626c40a5c8 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:00.820054 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad003f-e72a-44e4-89c7-b1ebcbe4f3ad None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:00.939644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 41/88] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:00.940556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad003f-e72a-44e4-89c7-b1ebcbe4f3ad None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:00.942128 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23763ef1-8c27-49e2-bb29-8b626c40a5c8 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:00.951883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:00.992776 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7e440-e0c0-4a13-946c-3aaffd2a87fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:00.994016 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e440-e0c0-4a13-946c-3aaffd2a87fb None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:00.994408 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e440-e0c0-4a13-946c-3aaffd2a87fb None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:00.994792 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e440-e0c0-4a13-946c-3aaffd2a87fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:00.995793 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7e440-e0c0-4a13-946c-3aaffd2a87fb None admin] RBAC: Adding query filter params (role.id=7ad29af380bd4e608c78235cbf9741b6, scope.project.id=5fd455713ae940308a0af4cdfeb3c374, user.id=d8b17c78161f4eebba3a526db806cf9e) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:00.996214 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7e440-e0c0-4a13-946c-3aaffd2a87fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:00.997821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7e440-e0c0-4a13-946c-3aaffd2a87fb None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:01.004078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 48/89] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:00 2022] GET /identity/v3/role_assignments?user.id=d8b17c78161f4eebba3a526db806cf9e&scope.project.id=5fd455713ae940308a0af4cdfeb3c374&role.id=7ad29af380bd4e608c78235cbf9741b6 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:01.010296 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7e440-e0c0-4a13-946c-3aaffd2a87fb None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:01.058782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad003f-e72a-44e4-89c7-b1ebcbe4f3ad None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:01.102660 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e8594-357b-4062-bfbb-bef3b199fb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:01.103809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e8594-357b-4062-bfbb-bef3b199fb60 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:01.104234 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e8594-357b-4062-bfbb-bef3b199fb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:01.104648 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e8594-357b-4062-bfbb-bef3b199fb60 None admin] PATH_INFO: `/v3/users/d8b17c78161f4eebba3a526db806cf9e` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:01.107062 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e8594-357b-4062-bfbb-bef3b199fb60 None admin] RBAC: Authorizing `identity:get_user(user_id=d8b17c78161f4eebba3a526db806cf9e)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:01.108776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e8594-357b-4062-bfbb-bef3b199fb60 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:01.111055 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 42/90] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:00 2022] GET /identity/v3/users/d8b17c78161f4eebba3a526db806cf9e => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:01.111977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e8594-357b-4062-bfbb-bef3b199fb60 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:01.187340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:01.210104 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:01.251231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e8594-357b-4062-bfbb-bef3b199fb60 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:01.273543 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7e440-e0c0-4a13-946c-3aaffd2a87fb None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:01.292200 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9d3aa-0b64-4c25-af97-db034bf411e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:01.294072 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9d3aa-0b64-4c25-af97-db034bf411e3 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:01.294757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9d3aa-0b64-4c25-af97-db034bf411e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:01.296704 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9d3aa-0b64-4c25-af97-db034bf411e3 None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:01.299064 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9d3aa-0b64-4c25-af97-db034bf411e3 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd455713ae940308a0af4cdfeb3c374)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:01.300879 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9d3aa-0b64-4c25-af97-db034bf411e3 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:01.303618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 43/91] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:01 2022] GET /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:01.305309 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9d3aa-0b64-4c25-af97-db034bf411e3 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:01.340791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cba777-abb2-43b3-af1e-a21c1dcd0b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:01.343281 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cba777-abb2-43b3-af1e-a21c1dcd0b14 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:01.344600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cba777-abb2-43b3-af1e-a21c1dcd0b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:01.345668 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cba777-abb2-43b3-af1e-a21c1dcd0b14 None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:01.348199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cba777-abb2-43b3-af1e-a21c1dcd0b14 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd455713ae940308a0af4cdfeb3c374)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:01.353097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cba777-abb2-43b3-af1e-a21c1dcd0b14 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:01.357028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 49/92] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:01 2022] GET /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374 => generated 298 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:01.358086 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cba777-abb2-43b3-af1e-a21c1dcd0b14 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:01.494494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9d3aa-0b64-4c25-af97-db034bf411e3 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:01.528933 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4389f-8952-48b0-a0de-8d98abf10f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:01.529624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4389f-8952-48b0-a0de-8d98abf10f0a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:01.529909 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4389f-8952-48b0-a0de-8d98abf10f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:01.530186 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4389f-8952-48b0-a0de-8d98abf10f0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:01.547148 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:01.563856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cba777-abb2-43b3-af1e-a21c1dcd0b14 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:01.595852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:01.606710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab285a-1930-4f33-985e-63f444a42a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:01.607626 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab285a-1930-4f33-985e-63f444a42a4d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:01.608366 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab285a-1930-4f33-985e-63f444a42a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:01.608869 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab285a-1930-4f33-985e-63f444a42a4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:01.610010 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab285a-1930-4f33-985e-63f444a42a4d None admin] RBAC: Adding query filter params (role.id=fb45aabab51d4c698f2da1840ff5920d, scope.project.id=5fd455713ae940308a0af4cdfeb3c374, user.id=d8b17c78161f4eebba3a526db806cf9e) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:01.610530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab285a-1930-4f33-985e-63f444a42a4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:01.612190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab285a-1930-4f33-985e-63f444a42a4d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:01.618856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 50/93] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:01 2022] GET /identity/v3/role_assignments?user.id=d8b17c78161f4eebba3a526db806cf9e&scope.project.id=5fd455713ae940308a0af4cdfeb3c374&role.id=fb45aabab51d4c698f2da1840ff5920d => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:01.619906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab285a-1930-4f33-985e-63f444a42a4d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:01.725464 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4389f-8952-48b0-a0de-8d98abf10f0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:01.726999 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4389f-8952-48b0-a0de-8d98abf10f0a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:01.738476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab285a-1930-4f33-985e-63f444a42a4d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:01.778306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf00ae-811a-44ec-b9db-adbdb69d4721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:01.779423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf00ae-811a-44ec-b9db-adbdb69d4721 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:01.779915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf00ae-811a-44ec-b9db-adbdb69d4721 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:01.780393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf00ae-811a-44ec-b9db-adbdb69d4721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:01.781617 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf00ae-811a-44ec-b9db-adbdb69d4721 None admin] RBAC: Adding query filter params (role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.project.id=5fd455713ae940308a0af4cdfeb3c374, user.id=932830b2b4ea40b59369012d162538e2) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:01.782194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf00ae-811a-44ec-b9db-adbdb69d4721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:01.783920 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf00ae-811a-44ec-b9db-adbdb69d4721 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:01.791970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 51/94] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:01 2022] GET /identity/v3/role_assignments?user.id=932830b2b4ea40b59369012d162538e2&scope.project.id=5fd455713ae940308a0af4cdfeb3c374&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:01.893239 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 44/95] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:01.899409 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf00ae-811a-44ec-b9db-adbdb69d4721 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:01.973731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:02.032500 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf00ae-811a-44ec-b9db-adbdb69d4721 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:02.071467 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e45fe8-6f56-4a0f-86b0-a02c16b2291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:02.072337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e45fe8-6f56-4a0f-86b0-a02c16b2291a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:02.072619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e45fe8-6f56-4a0f-86b0-a02c16b2291a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:02.072894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e45fe8-6f56-4a0f-86b0-a02c16b2291a None admin] PATH_INFO: `/v3/projects/ab5a896ce128415dbf4c0874f0ef89e5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:02.078003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e45fe8-6f56-4a0f-86b0-a02c16b2291a None admin] RBAC: Authorizing `identity:get_project(project_id=ab5a896ce128415dbf4c0874f0ef89e5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:02.079472 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e45fe8-6f56-4a0f-86b0-a02c16b2291a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:02.081535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 52/96] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:01 2022] GET /identity/v3/projects/ab5a896ce128415dbf4c0874f0ef89e5 => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:02.087852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4389f-8952-48b0-a0de-8d98abf10f0a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:02.146212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:02.203967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4389f-8952-48b0-a0de-8d98abf10f0a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:02.239263 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a114f-7c9e-43fa-858a-965edca82a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:02.239924 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a114f-7c9e-43fa-858a-965edca82a6f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:02.240206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a114f-7c9e-43fa-858a-965edca82a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:02.240484 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a114f-7c9e-43fa-858a-965edca82a6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:02.241344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a114f-7c9e-43fa-858a-965edca82a6f None admin] RBAC: Adding query filter params (role.id=7ad29af380bd4e608c78235cbf9741b6, scope.project.id=ab5a896ce128415dbf4c0874f0ef89e5, user.id=d8b17c78161f4eebba3a526db806cf9e) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:02.241696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a114f-7c9e-43fa-858a-965edca82a6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:02.243158 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a114f-7c9e-43fa-858a-965edca82a6f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:02.250365 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 45/97] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:02 2022] GET /identity/v3/role_assignments?user.id=d8b17c78161f4eebba3a526db806cf9e&scope.project.id=ab5a896ce128415dbf4c0874f0ef89e5&role.id=7ad29af380bd4e608c78235cbf9741b6 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:02.538351 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb65b2c-533e-432b-a7ff-c584b0d9bd01 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:02.539182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb65b2c-533e-432b-a7ff-c584b0d9bd01 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:02.539354 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb65b2c-533e-432b-a7ff-c584b0d9bd01 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:02.540977 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 53/98] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:02.545888 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc44c4f-f61c-4934-aab0-bce9be198b67 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:02.546182 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc44c4f-f61c-4934-aab0-bce9be198b67 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:02.546464 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc44c4f-f61c-4934-aab0-bce9be198b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:02.566288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8dc44c4f-f61c-4934-aab0-bce9be198b67 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:02.567511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8dc44c4f-f61c-4934-aab0-bce9be198b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:02.639429 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 46/99] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:02.677657 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb65b2c-533e-432b-a7ff-c584b0d9bd01 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:02.818879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb65b2c-533e-432b-a7ff-c584b0d9bd01 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:02.856040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9bbdb-7cdf-4ca3-96d6-760bdd9ec816 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:02.856538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9bbdb-7cdf-4ca3-96d6-760bdd9ec816 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:02.856611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9bbdb-7cdf-4ca3-96d6-760bdd9ec816 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:02.858071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 47/100] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:14:02.861881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:02.863205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94d005-79ec-4dae-9332-ad77ae880e18 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:02.863205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94d005-79ec-4dae-9332-ad77ae880e18 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:02.863513 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94d005-79ec-4dae-9332-ad77ae880e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:02.891908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-bb94d005-79ec-4dae-9332-ad77ae880e18 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:02.893166 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-bb94d005-79ec-4dae-9332-ad77ae880e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:02.893958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5183241-9c3d-4393-bb0a-70a1efef68ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:02.894772 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5183241-9c3d-4393-bb0a-70a1efef68ea None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:02.895056 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5183241-9c3d-4393-bb0a-70a1efef68ea None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:02.895528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5183241-9c3d-4393-bb0a-70a1efef68ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:02.899720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5183241-9c3d-4393-bb0a-70a1efef68ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:02.901193 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5183241-9c3d-4393-bb0a-70a1efef68ea None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:02.904478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 54/101] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:02.910371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5183241-9c3d-4393-bb0a-70a1efef68ea None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:02.952547 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:03.031797 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 48/102] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:03.072209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94d005-79ec-4dae-9332-ad77ae880e18 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:03.102260 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5183241-9c3d-4393-bb0a-70a1efef68ea None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:03.156161 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6bbaa-bdc9-44f4-a062-1fffb1a38b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:03.156833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6bbaa-bdc9-44f4-a062-1fffb1a38b09 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:03.157120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6bbaa-bdc9-44f4-a062-1fffb1a38b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:03.157423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6bbaa-bdc9-44f4-a062-1fffb1a38b09 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:03.158142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6bbaa-bdc9-44f4-a062-1fffb1a38b09 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:03.159650 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6bbaa-bdc9-44f4-a062-1fffb1a38b09 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:03.203301 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 55/103] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Jul 12 18:14:02 2022] POST /identity/v3/projects => generated 302 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:14:03.295713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94d005-79ec-4dae-9332-ad77ae880e18 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:03.352997 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9b125-f978-4cc9-8ef2-1ac2e31999f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:03.353849 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9b125-f978-4cc9-8ef2-1ac2e31999f7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:03.354137 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9b125-f978-4cc9-8ef2-1ac2e31999f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:03.354411 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9b125-f978-4cc9-8ef2-1ac2e31999f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:03.372353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9b125-f978-4cc9-8ef2-1ac2e31999f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:03.380322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-7da9b125-f978-4cc9-8ef2-1ac2e31999f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:14:03.380322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:03.380322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:03.380322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:03.380322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:03.380322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:03.380322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:03.380322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:03.380322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:03.380322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:03.380322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:03.380322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:03.380322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:03.380322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:03.380322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:03.380322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:03.381220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:03.381220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:03.381220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:03.381220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:03.381220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:03.381220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:03.381220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:03.381220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:03.381220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:03.381220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:03.381220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:03.381220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:03.381220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:03.381220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:03.381220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:03.381220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:03.382093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:03.382093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:03.382093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:03.382093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:03.382093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:03.382093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:03.382093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:03.382093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:03.382093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:03.382093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:03.382093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:14:03.382093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:03.386003 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 49/104] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:03.393841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6bbaa-bdc9-44f4-a062-1fffb1a38b09 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:03.468336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:03.546074 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6bbaa-bdc9-44f4-a062-1fffb1a38b09 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:03.589074 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bfb3d-d453-4be2-87e7-c2f520f9ba97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:03.589784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bfb3d-d453-4be2-87e7-c2f520f9ba97 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:03.590072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bfb3d-d453-4be2-87e7-c2f520f9ba97 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:03.590353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bfb3d-d453-4be2-87e7-c2f520f9ba97 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:03.591103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bfb3d-d453-4be2-87e7-c2f520f9ba97 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:03.591413 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bfb3d-d453-4be2-87e7-c2f520f9ba97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:03.592814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bfb3d-d453-4be2-87e7-c2f520f9ba97 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:03.601473 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 56/105] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:03.606883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9b125-f978-4cc9-8ef2-1ac2e31999f7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:03.636691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:03.710504 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9b125-f978-4cc9-8ef2-1ac2e31999f7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:03.745243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca165d71-258f-4268-9924-627b1a2a8ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:03.746201 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca165d71-258f-4268-9924-627b1a2a8ffd None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:03.746533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca165d71-258f-4268-9924-627b1a2a8ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:03.746820 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca165d71-258f-4268-9924-627b1a2a8ffd None admin] PATH_INFO: `/v3/users/4d9bff7d464c41e3944de1b786ef8288` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:03.761178 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca165d71-258f-4268-9924-627b1a2a8ffd None admin] RBAC: Authorizing `identity:get_user(user_id=4d9bff7d464c41e3944de1b786ef8288)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:03.762707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca165d71-258f-4268-9924-627b1a2a8ffd None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:03.764397 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 50/106] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:03 2022] GET /identity/v3/users/4d9bff7d464c41e3944de1b786ef8288 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:03.770192 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bfb3d-d453-4be2-87e7-c2f520f9ba97 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:03.885422 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bfb3d-d453-4be2-87e7-c2f520f9ba97 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:03.888617 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:03.931156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efe18f-7212-41b5-8800-4577e20640e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:03.931902 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efe18f-7212-41b5-8800-4577e20640e2 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:03.932117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efe18f-7212-41b5-8800-4577e20640e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:03.932394 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efe18f-7212-41b5-8800-4577e20640e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:04.023999 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efe18f-7212-41b5-8800-4577e20640e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:04.025499 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efe18f-7212-41b5-8800-4577e20640e2 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:04.107908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb4423-1231-4e23-b97f-065d3a23e497 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:04.108440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb4423-1231-4e23-b97f-065d3a23e497 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:04.108516 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb4423-1231-4e23-b97f-065d3a23e497 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:04.109940 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 51/107] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:14:04.114731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed13273-c661-4f82-a0e8-57c249b17adb None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:04.115025 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed13273-c661-4f82-a0e8-57c249b17adb None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:04.115311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed13273-c661-4f82-a0e8-57c249b17adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:04.131856 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-bed13273-c661-4f82-a0e8-57c249b17adb None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:04.133629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-bed13273-c661-4f82-a0e8-57c249b17adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:04.184781 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 57/108] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 18:14:04.190167 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efe18f-7212-41b5-8800-4577e20640e2 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:04.204015 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:04.204442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 52/109] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:04.275369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed13273-c661-4f82-a0e8-57c249b17adb None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:04.302495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:04.348682 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efe18f-7212-41b5-8800-4577e20640e2 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:04.415525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee7fd3-7e25-428c-8bae-b9559c6becb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:04.416409 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee7fd3-7e25-428c-8bae-b9559c6becb7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:04.416694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee7fd3-7e25-428c-8bae-b9559c6becb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:04.416968 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee7fd3-7e25-428c-8bae-b9559c6becb7 None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:04.419083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee7fd3-7e25-428c-8bae-b9559c6becb7 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd455713ae940308a0af4cdfeb3c374)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:04.420844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee7fd3-7e25-428c-8bae-b9559c6becb7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:04.422604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 58/110] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:04 2022] GET /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:04.428359 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee7fd3-7e25-428c-8bae-b9559c6becb7 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:04.459671 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed13273-c661-4f82-a0e8-57c249b17adb None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:04.522422 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:04.545988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f390b-851b-4c0b-b3a7-0491011c9a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:04.546810 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f390b-851b-4c0b-b3a7-0491011c9a63 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:04.547101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f390b-851b-4c0b-b3a7-0491011c9a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:04.547383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f390b-851b-4c0b-b3a7-0491011c9a63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:04.588391 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f390b-851b-4c0b-b3a7-0491011c9a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:04.596294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-756f390b-851b-4c0b-b3a7-0491011c9a63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:04.596294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:04.596294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:04.596294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:04.596294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:04.596294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:04.596294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:04.596294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:04.596294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:04.596294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:04.596294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:04.596294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:04.596294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:04.596294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:04.596294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:04.596294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:04.597125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:04.597125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:04.597125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:04.597125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:04.597125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:04.597125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:04.597125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:04.597125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:04.597125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:04.597125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:04.597125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:04.597125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:04.597125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:04.597125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:04.597125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:04.597125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:04.597900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:04.597900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:04.597900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:04.597900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:04.597900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:04.597900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:04.597900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:04.597900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:04.597900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:04.597900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:04.597900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:04.597900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:04.603068 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee7fd3-7e25-428c-8bae-b9559c6becb7 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:04.605965 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 53/111] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:04.612574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f390b-851b-4c0b-b3a7-0491011c9a63 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:04.659659 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33403d3a-2b94-4dd4-a7c2-f7af4b7f8ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:04.660545 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33403d3a-2b94-4dd4-a7c2-f7af4b7f8ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:04.660837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33403d3a-2b94-4dd4-a7c2-f7af4b7f8ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:04.661124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33403d3a-2b94-4dd4-a7c2-f7af4b7f8ed4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:04.661997 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33403d3a-2b94-4dd4-a7c2-f7af4b7f8ed4 None admin] RBAC: Adding query filter params (role.id=aec350b8d47248f1a54daf9304cdc462, scope.project.id=5fd455713ae940308a0af4cdfeb3c374, user.id=4d9bff7d464c41e3944de1b786ef8288) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:04.662920 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33403d3a-2b94-4dd4-a7c2-f7af4b7f8ed4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:04.664477 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33403d3a-2b94-4dd4-a7c2-f7af4b7f8ed4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:04.678151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 59/112] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:04 2022] GET /identity/v3/role_assignments?user.id=4d9bff7d464c41e3944de1b786ef8288&scope.project.id=5fd455713ae940308a0af4cdfeb3c374&role.id=aec350b8d47248f1a54daf9304cdc462 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:04.769744 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:04.798020 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f390b-851b-4c0b-b3a7-0491011c9a63 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:04.845965 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a79c7-c9f3-4747-a90a-b5b9c8cf8bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:04.846649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a79c7-c9f3-4747-a90a-b5b9c8cf8bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:04.846941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a79c7-c9f3-4747-a90a-b5b9c8cf8bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:04.847224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a79c7-c9f3-4747-a90a-b5b9c8cf8bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:04.847994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a79c7-c9f3-4747-a90a-b5b9c8cf8bf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:04.848308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a79c7-c9f3-4747-a90a-b5b9c8cf8bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:04.849759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a79c7-c9f3-4747-a90a-b5b9c8cf8bf4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:04.859276 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 54/113] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:04.864969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33403d3a-2b94-4dd4-a7c2-f7af4b7f8ed4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:04.945748 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccdec4-9e50-4895-a57e-e9f11e784ee8 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:04.946061 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccdec4-9e50-4895-a57e-e9f11e784ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:04.946318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccdec4-9e50-4895-a57e-e9f11e784ee8 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:04.947865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 55/114] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:04.953548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a881bff-f5cd-46c2-a384-0d08dbbdafdf None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:04.953842 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a881bff-f5cd-46c2-a384-0d08dbbdafdf None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:04.954128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a881bff-f5cd-46c2-a384-0d08dbbdafdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:04.991719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7a881bff-f5cd-46c2-a384-0d08dbbdafdf None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:04.991719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7a881bff-f5cd-46c2-a384-0d08dbbdafdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:05.053538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33403d3a-2b94-4dd4-a7c2-f7af4b7f8ed4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:05.102650 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 56/115] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:05.106218 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866037c7-7498-4171-b17d-de0d0a47c521 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:05.107443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866037c7-7498-4171-b17d-de0d0a47c521 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:05.108788 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866037c7-7498-4171-b17d-de0d0a47c521 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:05.111718 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 57/116] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:05.113502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250c022-1e5d-42b7-9b68-224fd247bc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:05.114594 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250c022-1e5d-42b7-9b68-224fd247bc3d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:05.115084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250c022-1e5d-42b7-9b68-224fd247bc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:05.115545 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250c022-1e5d-42b7-9b68-224fd247bc3d None admin] PATH_INFO: `/v3/users/d8b17c78161f4eebba3a526db806cf9e` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:05.117484 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91f547-7ed4-4e23-bc02-2d4813588a35 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:05.117966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91f547-7ed4-4e23-bc02-2d4813588a35 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:05.118440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91f547-7ed4-4e23-bc02-2d4813588a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:05.120342 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250c022-1e5d-42b7-9b68-224fd247bc3d None admin] RBAC: Authorizing `identity:get_user(user_id=d8b17c78161f4eebba3a526db806cf9e)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:05.123280 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250c022-1e5d-42b7-9b68-224fd247bc3d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:05.127996 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 60/117] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:04 2022] GET /identity/v3/users/d8b17c78161f4eebba3a526db806cf9e => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:05.134293 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250c022-1e5d-42b7-9b68-224fd247bc3d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:05.142178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:05.165302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9a91f547-7ed4-4e23-bc02-2d4813588a35 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:05.165302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9a91f547-7ed4-4e23-bc02-2d4813588a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:05.248715 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:05.254571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 58/118] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:05.256027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91f547-7ed4-4e23-bc02-2d4813588a35 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:05.276008 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250c022-1e5d-42b7-9b68-224fd247bc3d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:05.314469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a6622-431c-4193-892c-be4cbbfa0fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:05.315269 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a6622-431c-4193-892c-be4cbbfa0fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:05.315560 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a6622-431c-4193-892c-be4cbbfa0fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:05.315841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a6622-431c-4193-892c-be4cbbfa0fb7 None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:05.317362 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a6622-431c-4193-892c-be4cbbfa0fb7 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd455713ae940308a0af4cdfeb3c374)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:05.318983 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a6622-431c-4193-892c-be4cbbfa0fb7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:05.321291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 61/119] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:05 2022] GET /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:05.322556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b1932-4b7d-44d8-85b9-342e07168831 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:05.322849 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b1932-4b7d-44d8-85b9-342e07168831 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:05.323389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b1932-4b7d-44d8-85b9-342e07168831 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:05.324746 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 62/120] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:05.329383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b1932-4b7d-44d8-85b9-342e07168831 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:05.372812 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91f547-7ed4-4e23-bc02-2d4813588a35 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:05.407941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c08fa1-a4a2-49d2-8622-5892eabbc1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:05.408363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:05.409845 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c08fa1-a4a2-49d2-8622-5892eabbc1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:05.411325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c08fa1-a4a2-49d2-8622-5892eabbc1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:05.411325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c08fa1-a4a2-49d2-8622-5892eabbc1b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:05.423251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c08fa1-a4a2-49d2-8622-5892eabbc1b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:05.431571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-02c08fa1-a4a2-49d2-8622-5892eabbc1b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:14:05.431571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:05.431571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:05.431571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:05.431571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:05.431571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:05.431571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:05.431571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:05.431571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:05.431571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:05.431571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:05.431571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:05.431571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:05.431571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:05.431571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:05.431571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:05.432395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:05.432395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:05.432395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:05.432395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:05.432395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:05.432395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:05.432395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:05.432395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:05.432395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:05.432395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:05.432395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:05.432395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:05.432395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:05.432395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:05.432395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:05.432395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:05.433127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:05.433127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:05.433127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:05.433127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:05.433127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:05.433127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:05.433127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:05.433127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:05.433127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:05.433127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:05.433127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:14:05.433127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:05.433127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 59/121] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:14:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:05.433783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c08fa1-a4a2-49d2-8622-5892eabbc1b7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:05.441942 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b1932-4b7d-44d8-85b9-342e07168831 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:05.479580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a15ec-eb9a-4407-8920-26a319d80e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:05.480396 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a15ec-eb9a-4407-8920-26a319d80e07 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:05.480689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a15ec-eb9a-4407-8920-26a319d80e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:05.480967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a15ec-eb9a-4407-8920-26a319d80e07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:05.492428 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a15ec-eb9a-4407-8920-26a319d80e07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:05.495021 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:05.503336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-f96a15ec-eb9a-4407-8920-26a319d80e07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:05.503336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:05.503336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:05.503336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:05.503336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:05.503336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:05.503336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:05.503336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:05.503336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:05.503336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:05.503336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:05.503336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:05.503336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:05.503336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:05.503336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:05.503336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:05.504303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:05.504303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:05.504303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:05.504303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:05.504303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:05.504303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:05.504303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:05.504303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:05.504303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:05.504303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:05.504303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:05.504303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:05.504303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:05.504303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:05.504303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:05.504303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:05.505070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:05.505070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:05.505070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:05.505070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:05.505070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:05.505070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:05.505070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:05.505070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:05.505070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:05.505070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:05.505070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:05.505070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:05.508112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 63/122] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:14:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:05.509513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe2db1-d484-442e-aa1e-27b6b62ed454 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:05.509966 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe2db1-d484-442e-aa1e-27b6b62ed454 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:05.510405 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe2db1-d484-442e-aa1e-27b6b62ed454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:05.528587 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6cfe2db1-d484-442e-aa1e-27b6b62ed454 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:05.530259 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6cfe2db1-d484-442e-aa1e-27b6b62ed454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:05.545394 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c08fa1-a4a2-49d2-8622-5892eabbc1b7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:05.608131 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158328d-3059-4f52-835a-b3e7680dd61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:05.609041 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158328d-3059-4f52-835a-b3e7680dd61d None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:05.609560 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158328d-3059-4f52-835a-b3e7680dd61d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:05.610042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158328d-3059-4f52-835a-b3e7680dd61d None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374/users/d8b17c78161f4eebba3a526db806cf9e/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:05.612799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158328d-3059-4f52-835a-b3e7680dd61d None admin] RBAC: Authorizing `identity:create_grant(project_id=5fd455713ae940308a0af4cdfeb3c374, user_id=d8b17c78161f4eebba3a526db806cf9e, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:05.614953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158328d-3059-4f52-835a-b3e7680dd61d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:05.624496 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 64/123] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:05.630401 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe2db1-d484-442e-aa1e-27b6b62ed454 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:05.637298 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 60/124] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:14:05 2022] PUT /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374/users/d8b17c78161f4eebba3a526db806cf9e/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:14:05.638168 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158328d-3059-4f52-835a-b3e7680dd61d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:05.724104 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:05.763936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe2db1-d484-442e-aa1e-27b6b62ed454 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:05.806456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a92c84-3cf3-40d5-8ccc-4691db280a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:05.807516 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a92c84-3cf3-40d5-8ccc-4691db280a41 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:05.807973 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a92c84-3cf3-40d5-8ccc-4691db280a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:05.808395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a92c84-3cf3-40d5-8ccc-4691db280a41 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:05.809316 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a92c84-3cf3-40d5-8ccc-4691db280a41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:05.809792 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a92c84-3cf3-40d5-8ccc-4691db280a41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:05.811523 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a92c84-3cf3-40d5-8ccc-4691db280a41 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:05.821476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 65/125] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:05.822721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a92c84-3cf3-40d5-8ccc-4691db280a41 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:05.834481 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158328d-3059-4f52-835a-b3e7680dd61d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:05.866980 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:05.892641 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b23e34-3a7e-4f56-ad7a-fb55b369eebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:05.902015 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b23e34-3a7e-4f56-ad7a-fb55b369eebc None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:05.902367 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b23e34-3a7e-4f56-ad7a-fb55b369eebc None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:05.902726 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b23e34-3a7e-4f56-ad7a-fb55b369eebc None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:05.903707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b23e34-3a7e-4f56-ad7a-fb55b369eebc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:05.904089 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b23e34-3a7e-4f56-ad7a-fb55b369eebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:05.905646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b23e34-3a7e-4f56-ad7a-fb55b369eebc None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:05.923041 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 61/126] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:14:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:05.924026 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b23e34-3a7e-4f56-ad7a-fb55b369eebc None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:05.940019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a92c84-3cf3-40d5-8ccc-4691db280a41 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:05.973697 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:05.989931 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d628e-0bd7-4d9d-92fe-f41c271e794d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:05.991210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d628e-0bd7-4d9d-92fe-f41c271e794d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:05.991711 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d628e-0bd7-4d9d-92fe-f41c271e794d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:05.992189 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d628e-0bd7-4d9d-92fe-f41c271e794d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:06.012244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d628e-0bd7-4d9d-92fe-f41c271e794d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:06.029875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-3c8d628e-0bd7-4d9d-92fe-f41c271e794d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:06.029875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:06.029875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:06.029875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:06.029875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:06.029875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:06.029875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:06.029875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:06.029875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:06.029875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:06.029875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:06.029875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:06.029875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:06.029875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:06.029875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:06.029875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:06.030938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:06.030938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:06.030938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:06.030938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:06.030938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:06.030938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:06.030938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:06.030938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:06.030938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:06.030938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:06.030938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:06.030938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:06.030938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:06.030938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:06.030938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:06.030938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:06.031731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:06.031731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:06.031731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:06.031731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:06.031731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:06.031731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:06.031731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:06.031731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:06.031731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:06.031731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:06.031731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:06.031731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:06.040928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 66/127] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:06.042034 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d628e-0bd7-4d9d-92fe-f41c271e794d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:06.053125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b23e34-3a7e-4f56-ad7a-fb55b369eebc None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:06.088870 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d36049-46ae-4681-844b-bf9a5ee28a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:06.090699 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d36049-46ae-4681-844b-bf9a5ee28a95 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:06.091091 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d36049-46ae-4681-844b-bf9a5ee28a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:06.091474 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d36049-46ae-4681-844b-bf9a5ee28a95 None admin] PATH_INFO: `/v3/users/932830b2b4ea40b59369012d162538e2` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:06.092842 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d36049-46ae-4681-844b-bf9a5ee28a95 None admin] RBAC: Authorizing `identity:get_user(user_id=932830b2b4ea40b59369012d162538e2)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:06.094519 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d36049-46ae-4681-844b-bf9a5ee28a95 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:06.096282 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 62/128] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:05 2022] GET /identity/v3/users/932830b2b4ea40b59369012d162538e2 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:06.097137 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d36049-46ae-4681-844b-bf9a5ee28a95 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:06.153619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:06.170549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d628e-0bd7-4d9d-92fe-f41c271e794d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:06.208487 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88a32e-9a41-4b27-bb3c-0f8685937a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:06.208796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d36049-46ae-4681-844b-bf9a5ee28a95 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:06.209850 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88a32e-9a41-4b27-bb3c-0f8685937a7c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:06.210388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88a32e-9a41-4b27-bb3c-0f8685937a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:06.210815 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88a32e-9a41-4b27-bb3c-0f8685937a7c None admin] PATH_INFO: `/v3/users/d8b17c78161f4eebba3a526db806cf9e` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:06.212771 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88a32e-9a41-4b27-bb3c-0f8685937a7c None admin] RBAC: Authorizing `identity:get_user(user_id=d8b17c78161f4eebba3a526db806cf9e)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:06.214532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88a32e-9a41-4b27-bb3c-0f8685937a7c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:06.216339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 67/129] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:06 2022] GET /identity/v3/users/d8b17c78161f4eebba3a526db806cf9e => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:06.217387 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88a32e-9a41-4b27-bb3c-0f8685937a7c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:06.245271 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afe1cd-b6e8-4da4-b873-afaf65a69a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:06.246098 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afe1cd-b6e8-4da4-b873-afaf65a69a3f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:06.246500 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afe1cd-b6e8-4da4-b873-afaf65a69a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:06.246976 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afe1cd-b6e8-4da4-b873-afaf65a69a3f None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:06.247724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afe1cd-b6e8-4da4-b873-afaf65a69a3f None admin] RBAC: Adding query filter params (name=member) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:06.248207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afe1cd-b6e8-4da4-b873-afaf65a69a3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:06.249659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afe1cd-b6e8-4da4-b873-afaf65a69a3f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:06.258420 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 63/130] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:06.259266 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afe1cd-b6e8-4da4-b873-afaf65a69a3f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:06.282346 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:06.339684 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88a32e-9a41-4b27-bb3c-0f8685937a7c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:06.382811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94372c74-4859-40c8-977d-b50dbaae0239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:06.383957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94372c74-4859-40c8-977d-b50dbaae0239 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:06.384387 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94372c74-4859-40c8-977d-b50dbaae0239 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:06.384819 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94372c74-4859-40c8-977d-b50dbaae0239 None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:06.384927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afe1cd-b6e8-4da4-b873-afaf65a69a3f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:06.386314 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94372c74-4859-40c8-977d-b50dbaae0239 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd455713ae940308a0af4cdfeb3c374)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:06.389062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94372c74-4859-40c8-977d-b50dbaae0239 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:06.390963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 68/131] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:06 2022] GET /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:06.392307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96daef0e-bad8-451f-9596-2115a6a36631 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:06.393160 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96daef0e-bad8-451f-9596-2115a6a36631 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:06.393618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96daef0e-bad8-451f-9596-2115a6a36631 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:06.395628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 69/132] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:06.396552 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96daef0e-bad8-451f-9596-2115a6a36631 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:06.414329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:06.425874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8678b94-bcbc-4b4c-a0cf-4e56a9018019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:06.427105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8678b94-bcbc-4b4c-a0cf-4e56a9018019 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:06.427598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8678b94-bcbc-4b4c-a0cf-4e56a9018019 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:06.428129 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8678b94-bcbc-4b4c-a0cf-4e56a9018019 None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:06.429606 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8678b94-bcbc-4b4c-a0cf-4e56a9018019 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd455713ae940308a0af4cdfeb3c374)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:06.431367 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8678b94-bcbc-4b4c-a0cf-4e56a9018019 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:06.433332 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 64/133] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:06 2022] GET /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:06.434163 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8678b94-bcbc-4b4c-a0cf-4e56a9018019 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:06.522240 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96daef0e-bad8-451f-9596-2115a6a36631 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:06.543988 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:06.556011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8678b94-bcbc-4b4c-a0cf-4e56a9018019 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:06.567305 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b60f9-094d-4d41-b367-eed9c0fc065d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:06.568454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b60f9-094d-4d41-b367-eed9c0fc065d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:06.574217 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b60f9-094d-4d41-b367-eed9c0fc065d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:06.574735 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b60f9-094d-4d41-b367-eed9c0fc065d None admin] PATH_INFO: `/v3/users/d8b17c78161f4eebba3a526db806cf9e` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:06.576263 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b60f9-094d-4d41-b367-eed9c0fc065d None admin] RBAC: Authorizing `identity:get_user(user_id=d8b17c78161f4eebba3a526db806cf9e)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:06.577976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b60f9-094d-4d41-b367-eed9c0fc065d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:06.579859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 70/134] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:06 2022] GET /identity/v3/users/d8b17c78161f4eebba3a526db806cf9e => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:06.581489 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995db672-f897-4625-83c6-1ff3d62aa92a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:06.581987 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995db672-f897-4625-83c6-1ff3d62aa92a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:06.582465 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995db672-f897-4625-83c6-1ff3d62aa92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:06.592747 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb0371-488a-47b2-b62d-127dfc6492cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:06.593673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb0371-488a-47b2-b62d-127dfc6492cb None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:06.593960 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb0371-488a-47b2-b62d-127dfc6492cb None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:06.594242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb0371-488a-47b2-b62d-127dfc6492cb None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374/users/932830b2b4ea40b59369012d162538e2/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:06.596642 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb0371-488a-47b2-b62d-127dfc6492cb None admin] RBAC: Authorizing `identity:create_grant(project_id=5fd455713ae940308a0af4cdfeb3c374, user_id=932830b2b4ea40b59369012d162538e2, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:06.598176 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb0371-488a-47b2-b62d-127dfc6492cb None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:06.603176 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-995db672-f897-4625-83c6-1ff3d62aa92a None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:06.605881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-995db672-f897-4625-83c6-1ff3d62aa92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:06.615133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 65/135] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:14:06 2022] PUT /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374/users/932830b2b4ea40b59369012d162538e2/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:14:06.616373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb0371-488a-47b2-b62d-127dfc6492cb None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:06.666447 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:06.741899 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb0371-488a-47b2-b62d-127dfc6492cb None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:06.753499 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 71/136] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:06.754306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995db672-f897-4625-83c6-1ff3d62aa92a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:06.783769 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d976232-ad61-4986-9bfe-daf890c2ecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:06.785104 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d976232-ad61-4986-9bfe-daf890c2ecb7 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:06.785649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d976232-ad61-4986-9bfe-daf890c2ecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:06.786134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d976232-ad61-4986-9bfe-daf890c2ecb7 None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374/users/d8b17c78161f4eebba3a526db806cf9e/roles/fb45aabab51d4c698f2da1840ff5920d` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:06.790080 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d976232-ad61-4986-9bfe-daf890c2ecb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fd455713ae940308a0af4cdfeb3c374, user_id=d8b17c78161f4eebba3a526db806cf9e, role_id=fb45aabab51d4c698f2da1840ff5920d)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:06.792084 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d976232-ad61-4986-9bfe-daf890c2ecb7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:06.809560 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 66/137] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:14:06 2022] PUT /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374/users/d8b17c78161f4eebba3a526db806cf9e/roles/fb45aabab51d4c698f2da1840ff5920d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:14:06.811082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d976232-ad61-4986-9bfe-daf890c2ecb7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:06.940842 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d976232-ad61-4986-9bfe-daf890c2ecb7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:06.945631 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:06.968854 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995db672-f897-4625-83c6-1ff3d62aa92a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:06.993042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371295be-e235-4179-bf25-f98738f1fed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:06.994210 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371295be-e235-4179-bf25-f98738f1fed7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:06.994496 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371295be-e235-4179-bf25-f98738f1fed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:06.994774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371295be-e235-4179-bf25-f98738f1fed7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:06.996786 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:06.997393 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371295be-e235-4179-bf25-f98738f1fed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:06.998924 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371295be-e235-4179-bf25-f98738f1fed7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:07.001204 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 67/138] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:07.006668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371295be-e235-4179-bf25-f98738f1fed7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:07.020901 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914bb3d-6234-4594-98f1-fd5ac3e2caaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:07.021932 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914bb3d-6234-4594-98f1-fd5ac3e2caaf None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:07.022225 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914bb3d-6234-4594-98f1-fd5ac3e2caaf None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:07.022505 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914bb3d-6234-4594-98f1-fd5ac3e2caaf None admin] PATH_INFO: `/v3/projects/ab5a896ce128415dbf4c0874f0ef89e5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:07.024350 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914bb3d-6234-4594-98f1-fd5ac3e2caaf None admin] RBAC: Authorizing `identity:get_project(project_id=ab5a896ce128415dbf4c0874f0ef89e5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:07.025969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914bb3d-6234-4594-98f1-fd5ac3e2caaf None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:07.028162 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 72/139] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:06 2022] GET /identity/v3/projects/ab5a896ce128415dbf4c0874f0ef89e5 => generated 312 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:07.033415 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914bb3d-6234-4594-98f1-fd5ac3e2caaf None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:07.142463 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371295be-e235-4179-bf25-f98738f1fed7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:07.158149 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914bb3d-6234-4594-98f1-fd5ac3e2caaf None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:07.187673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483041f9-d2b6-40b4-8afc-1f1794653776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:07.188760 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483041f9-d2b6-40b4-8afc-1f1794653776 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:07.189344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483041f9-d2b6-40b4-8afc-1f1794653776 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:07.189633 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483041f9-d2b6-40b4-8afc-1f1794653776 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:07.190376 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483041f9-d2b6-40b4-8afc-1f1794653776 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:07.192890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483041f9-d2b6-40b4-8afc-1f1794653776 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:07.201018 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c799d-adbb-4f0e-96cb-9abc99119e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:07.201941 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c799d-adbb-4f0e-96cb-9abc99119e7c None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:07.202279 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c799d-adbb-4f0e-96cb-9abc99119e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:07.202560 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c799d-adbb-4f0e-96cb-9abc99119e7c None admin] PATH_INFO: `/v3/projects/ab5a896ce128415dbf4c0874f0ef89e5/users/d8b17c78161f4eebba3a526db806cf9e/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:07.204614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c799d-adbb-4f0e-96cb-9abc99119e7c None admin] RBAC: Authorizing `identity:create_grant(project_id=ab5a896ce128415dbf4c0874f0ef89e5, user_id=d8b17c78161f4eebba3a526db806cf9e, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:07.206110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c799d-adbb-4f0e-96cb-9abc99119e7c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:07.220873 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 73/140] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:14:07 2022] PUT /identity/v3/projects/ab5a896ce128415dbf4c0874f0ef89e5/users/d8b17c78161f4eebba3a526db806cf9e/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:14:07.227082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 68/141] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Jul 12 18:14:07 2022] POST /identity/v3/users => generated 283 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:14:07.360908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc38316-2486-440f-8d91-50e9e24310bd None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:07.361507 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc38316-2486-440f-8d91-50e9e24310bd None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:07.361962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc38316-2486-440f-8d91-50e9e24310bd None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:07.363580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 74/142] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:07.370188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1179df0-f7b4-41ce-aa08-caadf99b0275 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:07.370489 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1179df0-f7b4-41ce-aa08-caadf99b0275 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:07.370756 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1179df0-f7b4-41ce-aa08-caadf99b0275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:07.391358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e1179df0-f7b4-41ce-aa08-caadf99b0275 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:07.392599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e1179df0-f7b4-41ce-aa08-caadf99b0275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:07.412653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:07.478096 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 69/143] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:07.513754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc38316-2486-440f-8d91-50e9e24310bd None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:07.590513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:07.652695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc38316-2486-440f-8d91-50e9e24310bd None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:07.692937 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1734bb-4320-4793-996d-2cf383dcb601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:07.693765 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1734bb-4320-4793-996d-2cf383dcb601 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:07.694046 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1734bb-4320-4793-996d-2cf383dcb601 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:07.694317 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1734bb-4320-4793-996d-2cf383dcb601 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:07.705210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1734bb-4320-4793-996d-2cf383dcb601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:07.713294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-db1734bb-4320-4793-996d-2cf383dcb601 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:14:07.713294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:07.713294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:07.713294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:07.713294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:07.713294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:07.713294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:07.713294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:07.713294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:07.713294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:07.713294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:07.713294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:07.713294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:07.713294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:07.713294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:07.713294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:07.714142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:07.714142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:07.714142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:07.714142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:07.714142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:07.714142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:07.714142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:07.714142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:07.714142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:07.714142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:07.714142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:07.714142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:07.714142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:07.714142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:07.714142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:07.714142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:07.714910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:07.714910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:07.714910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:07.714910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:07.714910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:07.714910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:07.714910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:07.714910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:07.714910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:07.714910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:07.714910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:14:07.714910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:07.714910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 75/144] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:07.722140 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1179df0-f7b4-41ce-aa08-caadf99b0275 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:07.844860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1179df0-f7b4-41ce-aa08-caadf99b0275 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:07.879973 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e254b50-adc2-4cbd-b850-c6fd5b504e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:07.880649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e254b50-adc2-4cbd-b850-c6fd5b504e11 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:07.880936 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e254b50-adc2-4cbd-b850-c6fd5b504e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:07.881214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e254b50-adc2-4cbd-b850-c6fd5b504e11 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:07.882097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e254b50-adc2-4cbd-b850-c6fd5b504e11 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:07.885696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e254b50-adc2-4cbd-b850-c6fd5b504e11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:07.887134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e254b50-adc2-4cbd-b850-c6fd5b504e11 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:07.896219 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 70/145] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:07.902490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1734bb-4320-4793-996d-2cf383dcb601 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:08.027685 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1734bb-4320-4793-996d-2cf383dcb601 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:08.035370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:08.067289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ba99e-d9a9-4c17-acdb-701fae4de882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:08.068182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ba99e-d9a9-4c17-acdb-701fae4de882 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:08.068465 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ba99e-d9a9-4c17-acdb-701fae4de882 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:08.068738 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ba99e-d9a9-4c17-acdb-701fae4de882 None admin] PATH_INFO: `/v3/users/4d9bff7d464c41e3944de1b786ef8288` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:08.070062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ba99e-d9a9-4c17-acdb-701fae4de882 None admin] RBAC: Authorizing `identity:get_user(user_id=4d9bff7d464c41e3944de1b786ef8288)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:08.071572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ba99e-d9a9-4c17-acdb-701fae4de882 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:08.073685 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 76/146] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:07 2022] GET /identity/v3/users/4d9bff7d464c41e3944de1b786ef8288 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:08.079288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e254b50-adc2-4cbd-b850-c6fd5b504e11 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:08.101890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:08.201014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e254b50-adc2-4cbd-b850-c6fd5b504e11 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:08.236509 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41614a4e-eabc-424a-8779-f2b1e63ec395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:08.237406 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41614a4e-eabc-424a-8779-f2b1e63ec395 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:08.237704 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41614a4e-eabc-424a-8779-f2b1e63ec395 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:08.237991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41614a4e-eabc-424a-8779-f2b1e63ec395 None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:08.239244 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41614a4e-eabc-424a-8779-f2b1e63ec395 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd455713ae940308a0af4cdfeb3c374)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:08.240818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41614a4e-eabc-424a-8779-f2b1e63ec395 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:08.242742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 71/147] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:08 2022] GET /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:08.248460 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ba99e-d9a9-4c17-acdb-701fae4de882 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:08.381977 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ba99e-d9a9-4c17-acdb-701fae4de882 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:08.428279 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b598434-37cf-4620-ac57-8eb8f84daccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:08.429758 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b598434-37cf-4620-ac57-8eb8f84daccc None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:08.430038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b598434-37cf-4620-ac57-8eb8f84daccc None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:08.430314 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b598434-37cf-4620-ac57-8eb8f84daccc None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374/users/4d9bff7d464c41e3944de1b786ef8288/roles/aec350b8d47248f1a54daf9304cdc462` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:08.432319 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b598434-37cf-4620-ac57-8eb8f84daccc None admin] RBAC: Authorizing `identity:create_grant(project_id=5fd455713ae940308a0af4cdfeb3c374, user_id=4d9bff7d464c41e3944de1b786ef8288, role_id=aec350b8d47248f1a54daf9304cdc462)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:08.433851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b598434-37cf-4620-ac57-8eb8f84daccc None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:08.451233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 77/148] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:14:08 2022] PUT /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374/users/4d9bff7d464c41e3944de1b786ef8288/roles/aec350b8d47248f1a54daf9304cdc462 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:14:08.992479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe70e-bb6d-4217-9de3-8add93f2035e None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:08.992880 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe70e-bb6d-4217-9de3-8add93f2035e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:08.993077 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe70e-bb6d-4217-9de3-8add93f2035e None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:08.994678 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 72/149] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:09.003380 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0a106-f55d-4eab-983b-2c54eec98a7a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:09.003671 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0a106-f55d-4eab-983b-2c54eec98a7a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:09.003954 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0a106-f55d-4eab-983b-2c54eec98a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:09.021952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-84b0a106-f55d-4eab-983b-2c54eec98a7a None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:09.023711 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-84b0a106-f55d-4eab-983b-2c54eec98a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:09.051669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:09.108400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 78/150] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:09.172544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe70e-bb6d-4217-9de3-8add93f2035e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:09.292878 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:09.321929 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe70e-bb6d-4217-9de3-8add93f2035e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:09.363449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5e9e9-1ce6-4493-b4c0-4d2cf5ebf214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:09.364246 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5e9e9-1ce6-4493-b4c0-4d2cf5ebf214 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:09.364530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5e9e9-1ce6-4493-b4c0-4d2cf5ebf214 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:09.364800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5e9e9-1ce6-4493-b4c0-4d2cf5ebf214 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:09.377569 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5e9e9-1ce6-4493-b4c0-4d2cf5ebf214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:09.385904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-8ba5e9e9-1ce6-4493-b4c0-4d2cf5ebf214 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:09.385904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:09.385904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:09.385904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:09.385904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:09.385904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:09.385904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:09.385904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:09.385904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:09.385904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:09.385904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:09.385904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:09.385904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:09.385904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:09.385904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:09.385904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:09.386804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:09.386804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:09.386804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:09.386804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:09.386804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:09.386804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:09.386804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:09.386804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:09.386804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:09.386804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:09.386804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:09.386804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:09.386804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:09.386804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:09.386804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:09.386804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:09.387608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:09.387608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:09.387608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:09.387608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:09.387608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:09.387608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:09.387608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:09.387608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:09.387608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:09.387608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:09.387608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:09.387608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:09.387608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 73/151] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:09.395163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0a106-f55d-4eab-983b-2c54eec98a7a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:09.552105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0a106-f55d-4eab-983b-2c54eec98a7a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:09.606859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced1d42-f1b8-4268-80e8-5c415ee58f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:09.607536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced1d42-f1b8-4268-80e8-5c415ee58f65 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:09.607812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced1d42-f1b8-4268-80e8-5c415ee58f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:09.608068 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced1d42-f1b8-4268-80e8-5c415ee58f65 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:09.608828 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced1d42-f1b8-4268-80e8-5c415ee58f65 None admin] RBAC: Adding query filter params (name=member) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:09.609133 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced1d42-f1b8-4268-80e8-5c415ee58f65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:09.610554 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced1d42-f1b8-4268-80e8-5c415ee58f65 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:09.624748 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 79/152] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:09.630119 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5e9e9-1ce6-4493-b4c0-4d2cf5ebf214 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:09.834028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5e9e9-1ce6-4493-b4c0-4d2cf5ebf214 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:09.879044 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e2d0f-e098-400e-a77f-2103fa4a59e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:09.880188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e2d0f-e098-400e-a77f-2103fa4a59e5 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:09.880615 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e2d0f-e098-400e-a77f-2103fa4a59e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:09.881044 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e2d0f-e098-400e-a77f-2103fa4a59e5 None admin] PATH_INFO: `/v3/users/d8b17c78161f4eebba3a526db806cf9e` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:09.885980 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e2d0f-e098-400e-a77f-2103fa4a59e5 None admin] RBAC: Authorizing `identity:get_user(user_id=d8b17c78161f4eebba3a526db806cf9e)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:09.887618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e2d0f-e098-400e-a77f-2103fa4a59e5 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:09.889438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 74/153] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:09 2022] GET /identity/v3/users/d8b17c78161f4eebba3a526db806cf9e => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:09.895051 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced1d42-f1b8-4268-80e8-5c415ee58f65 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:09.951529 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:10.050519 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced1d42-f1b8-4268-80e8-5c415ee58f65 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:10.097679 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3f81d-9e8d-4fc4-86eb-5ea9ed19560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:10.098286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3f81d-9e8d-4fc4-86eb-5ea9ed19560f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:10.098572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3f81d-9e8d-4fc4-86eb-5ea9ed19560f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:10.098851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3f81d-9e8d-4fc4-86eb-5ea9ed19560f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:10.182322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3f81d-9e8d-4fc4-86eb-5ea9ed19560f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:10.183825 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3f81d-9e8d-4fc4-86eb-5ea9ed19560f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:10.219578 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:10.316306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 80/154] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:10.322737 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e2d0f-e098-400e-a77f-2103fa4a59e5 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:10.346752 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:10.440529 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b766ad4-14fb-4740-ba1e-32dff1c1e18e None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:10.441588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b766ad4-14fb-4740-ba1e-32dff1c1e18e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:10.442067 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b766ad4-14fb-4740-ba1e-32dff1c1e18e None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:10.443778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 81/155] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:10.455559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ee4bb-601d-466d-abed-333d4c683e61 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:10.456133 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ee4bb-601d-466d-abed-333d4c683e61 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:10.456634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ee4bb-601d-466d-abed-333d4c683e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:10.460780 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e2d0f-e098-400e-a77f-2103fa4a59e5 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:10.488745 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c16ee4bb-601d-466d-abed-333d4c683e61 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:10.490597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c16ee4bb-601d-466d-abed-333d4c683e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:10.509173 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac6e1b-02f8-4cfe-b16c-8030ce79ff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:10.510117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac6e1b-02f8-4cfe-b16c-8030ce79ff5f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:10.510405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac6e1b-02f8-4cfe-b16c-8030ce79ff5f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:10.510683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac6e1b-02f8-4cfe-b16c-8030ce79ff5f None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:10.512288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac6e1b-02f8-4cfe-b16c-8030ce79ff5f None admin] RBAC: Authorizing `identity:get_project(project_id=5fd455713ae940308a0af4cdfeb3c374)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:10.513799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac6e1b-02f8-4cfe-b16c-8030ce79ff5f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:10.515494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 75/156] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:10 2022] GET /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:10.522842 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac6e1b-02f8-4cfe-b16c-8030ce79ff5f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:10.633035 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 82/157] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:10.661730 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:10.674658 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ee4bb-601d-466d-abed-333d4c683e61 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:10.678147 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac6e1b-02f8-4cfe-b16c-8030ce79ff5f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:10.735344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2edf8-cebd-46ec-8f51-f0ca93e24ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:10.736382 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2edf8-cebd-46ec-8f51-f0ca93e24ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:10.736876 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2edf8-cebd-46ec-8f51-f0ca93e24ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:10.737315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2edf8-cebd-46ec-8f51-f0ca93e24ba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:10.738416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2edf8-cebd-46ec-8f51-f0ca93e24ba9 None admin] RBAC: Adding query filter params (role.id=7ad29af380bd4e608c78235cbf9741b6, scope.project.id=5fd455713ae940308a0af4cdfeb3c374, user.id=d8b17c78161f4eebba3a526db806cf9e) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:10.738875 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2edf8-cebd-46ec-8f51-f0ca93e24ba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:10.740941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2edf8-cebd-46ec-8f51-f0ca93e24ba9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:10.748662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 76/158] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:10 2022] GET /identity/v3/role_assignments?user.id=d8b17c78161f4eebba3a526db806cf9e&scope.project.id=5fd455713ae940308a0af4cdfeb3c374&role.id=7ad29af380bd4e608c78235cbf9741b6 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:10.772503 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5cd2b-36f3-4ce0-96eb-af411a7648f9 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:10.773695 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5cd2b-36f3-4ce0-96eb-af411a7648f9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:10.774200 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5cd2b-36f3-4ce0-96eb-af411a7648f9 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:10.775820 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 77/159] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:14:10.782607 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b5635-f944-4736-a3b8-cd5ed9cc8888 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:10.782898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:10.783258 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b5635-f944-4736-a3b8-cd5ed9cc8888 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:10.783633 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b5635-f944-4736-a3b8-cd5ed9cc8888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:10.822305 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1f6b5635-f944-4736-a3b8-cd5ed9cc8888 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:10.824271 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1f6b5635-f944-4736-a3b8-cd5ed9cc8888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:10.839183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ee4bb-601d-466d-abed-333d4c683e61 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:10.893969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12932f-9b11-4eb1-a060-1e3d3f0f3c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:10.895119 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12932f-9b11-4eb1-a060-1e3d3f0f3c36 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:10.895583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12932f-9b11-4eb1-a060-1e3d3f0f3c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:10.896495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12932f-9b11-4eb1-a060-1e3d3f0f3c36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:10.917711 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12932f-9b11-4eb1-a060-1e3d3f0f3c36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:10.934580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-9a12932f-9b11-4eb1-a060-1e3d3f0f3c36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:10.934580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:10.934580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:10.934580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:10.934580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:10.934580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:10.934580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:10.934580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:10.934580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:10.934580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:10.934580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:10.934580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:10.934580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:10.934580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:10.934580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:10.934580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:10.935717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:10.935717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:10.935717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:10.935717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:10.935717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:10.935717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:10.935717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:10.935717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:10.935717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:10.935717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:10.935717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:10.935717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:10.935717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:10.935717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:10.935717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:10.935717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:10.936672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:10.936672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:10.936672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:10.936672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:10.936672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:10.936672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:10.936672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:10.936672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:10.936672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:10.936672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:10.936672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:10.936672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:10.940395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 83/160] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:14:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:10.943016 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44b1f9-a4b6-4591-83ec-cba254a2bb96 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:10.945610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44b1f9-a4b6-4591-83ec-cba254a2bb96 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:10.946911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44b1f9-a4b6-4591-83ec-cba254a2bb96 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:10.951358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 84/161] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:10.953150 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44b1f9-a4b6-4591-83ec-cba254a2bb96 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:10.989898 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 78/162] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 12 18:14:10.991955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81a896-cc6b-4269-bedc-8796825f7eda None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:10.994089 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81a896-cc6b-4269-bedc-8796825f7eda None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:10.994533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81a896-cc6b-4269-bedc-8796825f7eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:11.018328 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2f81a896-cc6b-4269-bedc-8796825f7eda None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:11.020074 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2f81a896-cc6b-4269-bedc-8796825f7eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:11.095371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44b1f9-a4b6-4591-83ec-cba254a2bb96 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:11.112782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:11.148504 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 79/163] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:11.149735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81a896-cc6b-4269-bedc-8796825f7eda None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:11.153721 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:11.164752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b5a73-0502-4c5e-8881-d2089019245e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:11.165468 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b5a73-0502-4c5e-8881-d2089019245e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:11.165755 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b5a73-0502-4c5e-8881-d2089019245e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:11.166035 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b5a73-0502-4c5e-8881-d2089019245e None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:11.169402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b5a73-0502-4c5e-8881-d2089019245e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:11.171579 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b5a73-0502-4c5e-8881-d2089019245e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:11.172997 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b5a73-0502-4c5e-8881-d2089019245e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:11.199716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 85/164] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:14:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:11.218133 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b5a73-0502-4c5e-8881-d2089019245e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:11.367964 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81a896-cc6b-4269-bedc-8796825f7eda None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:11.410726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b5a73-0502-4c5e-8881-d2089019245e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:11.466553 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1eca1e-9b2e-4880-9d8d-7fbe191eabfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:11.467615 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1eca1e-9b2e-4880-9d8d-7fbe191eabfb None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:11.468049 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1eca1e-9b2e-4880-9d8d-7fbe191eabfb None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:11.468459 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1eca1e-9b2e-4880-9d8d-7fbe191eabfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:11.473953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fcc6f-feb7-450c-a0dc-be996ef43d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:11.475454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fcc6f-feb7-450c-a0dc-be996ef43d8c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:11.476451 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fcc6f-feb7-450c-a0dc-be996ef43d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:11.476933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fcc6f-feb7-450c-a0dc-be996ef43d8c None admin] PATH_INFO: `/v3/users/d8b17c78161f4eebba3a526db806cf9e` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:11.478478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70fcc6f-feb7-450c-a0dc-be996ef43d8c None admin] RBAC: Authorizing `identity:get_user(user_id=d8b17c78161f4eebba3a526db806cf9e)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:11.480194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70fcc6f-feb7-450c-a0dc-be996ef43d8c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:11.482395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 86/165] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:11 2022] GET /identity/v3/users/d8b17c78161f4eebba3a526db806cf9e => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:11.483464 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fcc6f-feb7-450c-a0dc-be996ef43d8c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:11.502243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1eca1e-9b2e-4880-9d8d-7fbe191eabfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:11.518587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-bf1eca1e-9b2e-4880-9d8d-7fbe191eabfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:14:11.518587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:11.518587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:11.518587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:11.518587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:11.518587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:11.518587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:11.518587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:11.518587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:11.518587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:11.518587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:11.518587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:11.518587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:11.518587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:11.518587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:11.518587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:11.519479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:11.519479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:11.519479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:11.519479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:11.519479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:11.519479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:11.519479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:11.519479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:11.519479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:11.519479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:11.519479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:11.519479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:11.519479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:11.519479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:11.519479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:11.519479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:11.520241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:11.520241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:11.520241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:11.520241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:11.520241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:11.520241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:11.520241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:11.520241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:11.520241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:11.520241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:11.520241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:14:11.520241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:11.523026 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 80/166] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:14:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:11.523989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1eca1e-9b2e-4880-9d8d-7fbe191eabfb None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:11.565653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:11.671569 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fcc6f-feb7-450c-a0dc-be996ef43d8c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:11.689625 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:11.736700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81436bab-e580-46ed-8ca3-4d399fbc0472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:11.737532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81436bab-e580-46ed-8ca3-4d399fbc0472 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:11.737817 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81436bab-e580-46ed-8ca3-4d399fbc0472 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:11.738092 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81436bab-e580-46ed-8ca3-4d399fbc0472 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:11.756595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1eca1e-9b2e-4880-9d8d-7fbe191eabfb None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:11.764325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81436bab-e580-46ed-8ca3-4d399fbc0472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:11.778642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-81436bab-e580-46ed-8ca3-4d399fbc0472 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:11.778642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:11.778642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:11.778642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:11.778642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:11.778642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:11.778642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:11.778642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:11.778642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:11.778642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:11.778642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:11.778642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:11.778642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:11.778642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:11.778642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:11.778642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:11.779514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:11.779514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:11.779514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:11.779514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:11.779514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:11.779514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:11.779514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:11.779514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:11.779514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:11.779514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:11.779514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:11.779514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:11.779514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:11.779514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:11.779514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:11.779514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:11.780309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:11.780309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:11.780309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:11.780309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:11.780309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:11.780309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:11.780309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:11.780309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:11.780309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:11.780309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:11.780309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:11.780309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:11.783175 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 87/167] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:11.784164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81436bab-e580-46ed-8ca3-4d399fbc0472 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:11.791844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a793f-3da8-4bb5-abc9-07d407a885f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:11.792732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a793f-3da8-4bb5-abc9-07d407a885f7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:11.793293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a793f-3da8-4bb5-abc9-07d407a885f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:11.793761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a793f-3da8-4bb5-abc9-07d407a885f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:11.874426 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a793f-3da8-4bb5-abc9-07d407a885f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:11.876239 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a793f-3da8-4bb5-abc9-07d407a885f7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:11.953755 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:11.981044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81436bab-e580-46ed-8ca3-4d399fbc0472 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:11.993628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:12.026569 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 81/168] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:12.028204 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d214e-494a-4ca1-bc48-70481706f446 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:12.028666 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d214e-494a-4ca1-bc48-70481706f446 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:12.029117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d214e-494a-4ca1-bc48-70481706f446 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:12.030587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 82/169] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:12.031487 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d214e-494a-4ca1-bc48-70481706f446 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:12.060790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cbfc1-aa4e-4e0b-934c-f9459991c684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:12.061606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cbfc1-aa4e-4e0b-934c-f9459991c684 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:12.061903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cbfc1-aa4e-4e0b-934c-f9459991c684 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:12.062192 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cbfc1-aa4e-4e0b-934c-f9459991c684 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:12.062948 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cbfc1-aa4e-4e0b-934c-f9459991c684 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:12.063424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cbfc1-aa4e-4e0b-934c-f9459991c684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:12.065173 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cbfc1-aa4e-4e0b-934c-f9459991c684 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:12.084622 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 88/170] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:12.086803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2da9b-86fc-4cc7-b48d-1a1c59c10203 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:12.087363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2da9b-86fc-4cc7-b48d-1a1c59c10203 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:12.087788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2da9b-86fc-4cc7-b48d-1a1c59c10203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:12.129498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4ab2da9b-86fc-4cc7-b48d-1a1c59c10203 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:12.130720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4ab2da9b-86fc-4cc7-b48d-1a1c59c10203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:12.170035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d214e-494a-4ca1-bc48-70481706f446 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:12.243066 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb895da-6ca6-40ca-8f83-7b9df15fe61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:12.243711 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb895da-6ca6-40ca-8f83-7b9df15fe61f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:12.243994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb895da-6ca6-40ca-8f83-7b9df15fe61f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:12.244266 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb895da-6ca6-40ca-8f83-7b9df15fe61f None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:12.246559 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb895da-6ca6-40ca-8f83-7b9df15fe61f None admin] RBAC: Adding query filter params (name=member) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:12.246881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb895da-6ca6-40ca-8f83-7b9df15fe61f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:12.248274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb895da-6ca6-40ca-8f83-7b9df15fe61f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:12.267702 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 83/171] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:12.268561 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb895da-6ca6-40ca-8f83-7b9df15fe61f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:12.284117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 89/172] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:12.286791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2da9b-86fc-4cc7-b48d-1a1c59c10203 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:12.327655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:12.410120 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb895da-6ca6-40ca-8f83-7b9df15fe61f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:12.423652 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:12.427920 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2da9b-86fc-4cc7-b48d-1a1c59c10203 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:12.452451 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0091283-eb6d-4c29-9880-bb7e4efd35f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:12.453610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0091283-eb6d-4c29-9880-bb7e4efd35f9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:12.454151 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0091283-eb6d-4c29-9880-bb7e4efd35f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:12.454581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0091283-eb6d-4c29-9880-bb7e4efd35f9 None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:12.456242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0091283-eb6d-4c29-9880-bb7e4efd35f9 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd455713ae940308a0af4cdfeb3c374)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:12.458108 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0091283-eb6d-4c29-9880-bb7e4efd35f9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:12.460100 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 84/173] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:12 2022] GET /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:12.465792 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0091283-eb6d-4c29-9880-bb7e4efd35f9 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:12.473647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160a509-4ca6-4ee8-9455-50b0168b40ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:12.474532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160a509-4ca6-4ee8-9455-50b0168b40ae None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:12.475058 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160a509-4ca6-4ee8-9455-50b0168b40ae None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:12.475058 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160a509-4ca6-4ee8-9455-50b0168b40ae None admin] PATH_INFO: `/v3/users/932830b2b4ea40b59369012d162538e2` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:12.476739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160a509-4ca6-4ee8-9455-50b0168b40ae None admin] RBAC: Authorizing `identity:get_user(user_id=932830b2b4ea40b59369012d162538e2)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:12.478944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160a509-4ca6-4ee8-9455-50b0168b40ae None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:12.480587 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 90/174] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:12 2022] GET /identity/v3/users/932830b2b4ea40b59369012d162538e2 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:12.481781 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ce756-1bd7-4c1e-81f2-38696c5ace5e None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:12.482254 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ce756-1bd7-4c1e-81f2-38696c5ace5e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:12.482703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ce756-1bd7-4c1e-81f2-38696c5ace5e None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:12.484180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 91/175] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:12.485062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ce756-1bd7-4c1e-81f2-38696c5ace5e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:12.568872 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:12.581898 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0091283-eb6d-4c29-9880-bb7e4efd35f9 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:12.590277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ce756-1bd7-4c1e-81f2-38696c5ace5e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:12.616074 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4efcf-d7c9-4f24-bb31-f827f969e3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:12.617504 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4efcf-d7c9-4f24-bb31-f827f969e3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:12.617796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4efcf-d7c9-4f24-bb31-f827f969e3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:12.618071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4efcf-d7c9-4f24-bb31-f827f969e3c3 None admin] PATH_INFO: `/v3/users/d8b17c78161f4eebba3a526db806cf9e` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:12.619268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4efcf-d7c9-4f24-bb31-f827f969e3c3 None admin] RBAC: Authorizing `identity:get_user(user_id=d8b17c78161f4eebba3a526db806cf9e)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:12.620727 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4efcf-d7c9-4f24-bb31-f827f969e3c3 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:12.622377 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 85/176] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:12 2022] GET /identity/v3/users/d8b17c78161f4eebba3a526db806cf9e => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:12.623138 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4efcf-d7c9-4f24-bb31-f827f969e3c3 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:12.625191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c6e14-fade-4b90-bb84-18658d305eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:12.626012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c6e14-fade-4b90-bb84-18658d305eca None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:12.626294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c6e14-fade-4b90-bb84-18658d305eca None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:12.626574 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c6e14-fade-4b90-bb84-18658d305eca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:12.637433 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c6e14-fade-4b90-bb84-18658d305eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:12.645168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-901c6e14-fade-4b90-bb84-18658d305eca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:14:12.645168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:12.645168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:12.645168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:12.645168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:12.645168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:12.645168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:12.645168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:12.645168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:12.645168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:12.645168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:12.645168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:12.645168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:12.645168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:12.645168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:12.645168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:12.646038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:12.646038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:12.646038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:12.646038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:12.646038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:12.646038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:12.646038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:12.646038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:12.646038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:12.646038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:12.646038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:12.646038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:12.646038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:12.646038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:12.646038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:12.646038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:12.646804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:12.646804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:12.646804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:12.646804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:12.646804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:12.646804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:12.646804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:12.646804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:12.646804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:12.646804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:12.646804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:14:12.646804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:12.646804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 92/177] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:14:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:12.647580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e264f9-5047-4f1d-b2e5-46edcd1d60ff None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:12.648042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e264f9-5047-4f1d-b2e5-46edcd1d60ff None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:12.648141 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e264f9-5047-4f1d-b2e5-46edcd1d60ff None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:12.649385 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 93/178] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:12.650080 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e264f9-5047-4f1d-b2e5-46edcd1d60ff None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:12.678311 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:12.725225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4efcf-d7c9-4f24-bb31-f827f969e3c3 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:12.752921 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e264f9-5047-4f1d-b2e5-46edcd1d60ff None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:12.758468 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc48a88-dcee-4cfe-a8bd-9881990dd7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:12.759106 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc48a88-dcee-4cfe-a8bd-9881990dd7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:12.759385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc48a88-dcee-4cfe-a8bd-9881990dd7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:12.759662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc48a88-dcee-4cfe-a8bd-9881990dd7c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:12.760476 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc48a88-dcee-4cfe-a8bd-9881990dd7c6 None admin] RBAC: Adding query filter params (role.id=fb45aabab51d4c698f2da1840ff5920d, scope.project.id=5fd455713ae940308a0af4cdfeb3c374, user.id=d8b17c78161f4eebba3a526db806cf9e) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:12.760778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc48a88-dcee-4cfe-a8bd-9881990dd7c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:12.762248 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc48a88-dcee-4cfe-a8bd-9881990dd7c6 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:12.767886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 86/179] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:12 2022] GET /identity/v3/role_assignments?user.id=d8b17c78161f4eebba3a526db806cf9e&scope.project.id=5fd455713ae940308a0af4cdfeb3c374&role.id=fb45aabab51d4c698f2da1840ff5920d => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:12.769026 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c1905-dbcc-430b-a587-5a562940c4e9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:12.769336 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c1905-dbcc-430b-a587-5a562940c4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:12.769610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c1905-dbcc-430b-a587-5a562940c4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:12.788993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468f5c7-a762-4508-982a-189c92863e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:12.790168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468f5c7-a762-4508-982a-189c92863e1d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:12.790454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468f5c7-a762-4508-982a-189c92863e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:12.790729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468f5c7-a762-4508-982a-189c92863e1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:12.796589 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ff7c1905-dbcc-430b-a587-5a562940c4e9 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:12.798215 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ff7c1905-dbcc-430b-a587-5a562940c4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:12.820949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:12.867466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468f5c7-a762-4508-982a-189c92863e1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:12.868990 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468f5c7-a762-4508-982a-189c92863e1d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:12.879291 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 87/180] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:12.886920 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22641d31-4eb3-414b-bab0-dbc3a67f9f09 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:12.887572 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22641d31-4eb3-414b-bab0-dbc3a67f9f09 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:12.887858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22641d31-4eb3-414b-bab0-dbc3a67f9f09 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:12.889458 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 88/181] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:12.894237 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22641d31-4eb3-414b-bab0-dbc3a67f9f09 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:12.905584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:12.995515 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 94/182] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:12.996673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468f5c7-a762-4508-982a-189c92863e1d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:13.014098 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22641d31-4eb3-414b-bab0-dbc3a67f9f09 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:13.047810 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ce028-3efc-409c-a315-b2ac040552a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:13.048461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce028-3efc-409c-a315-b2ac040552a3 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:13.048742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce028-3efc-409c-a315-b2ac040552a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:13.049018 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce028-3efc-409c-a315-b2ac040552a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:13.072880 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:13.094872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468f5c7-a762-4508-982a-189c92863e1d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:13.116395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ce028-3efc-409c-a315-b2ac040552a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:13.117918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ce028-3efc-409c-a315-b2ac040552a3 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:13.120305 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:13.129116 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e9b92-19c5-4917-a467-2c9de94a9d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:13.129811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e9b92-19c5-4917-a467-2c9de94a9d82 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:13.130096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e9b92-19c5-4917-a467-2c9de94a9d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:13.130368 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e9b92-19c5-4917-a467-2c9de94a9d82 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:13.131112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e9b92-19c5-4917-a467-2c9de94a9d82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:13.131417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e9b92-19c5-4917-a467-2c9de94a9d82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:13.132815 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e9b92-19c5-4917-a467-2c9de94a9d82 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:13.140866 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 95/183] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:13.146959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358e7fe-932e-4879-8003-5d01fb57f342 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:13.147250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358e7fe-932e-4879-8003-5d01fb57f342 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:13.148061 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358e7fe-932e-4879-8003-5d01fb57f342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:13.164209 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5358e7fe-932e-4879-8003-5d01fb57f342 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:13.165424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5358e7fe-932e-4879-8003-5d01fb57f342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:13.216433 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 89/184] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:13.217915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9160dec-05c5-4a86-88f5-92fa413748ae None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:13.218207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9160dec-05c5-4a86-88f5-92fa413748ae None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:13.218485 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9160dec-05c5-4a86-88f5-92fa413748ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:13.234581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a9160dec-05c5-4a86-88f5-92fa413748ae None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:13.235782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a9160dec-05c5-4a86-88f5-92fa413748ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:13.241124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 96/185] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:13.241997 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358e7fe-932e-4879-8003-5d01fb57f342 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:13.289338 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:13.306319 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 90/186] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:13.307153 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9160dec-05c5-4a86-88f5-92fa413748ae None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:13.346813 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358e7fe-932e-4879-8003-5d01fb57f342 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:13.364914 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:13.383827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe48a60-dcd5-4f05-a56f-546c6a83db33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:13.384628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe48a60-dcd5-4f05-a56f-546c6a83db33 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:13.384909 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe48a60-dcd5-4f05-a56f-546c6a83db33 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:13.385182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe48a60-dcd5-4f05-a56f-546c6a83db33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:13.395147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe48a60-dcd5-4f05-a56f-546c6a83db33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:13.402936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-afe48a60-dcd5-4f05-a56f-546c6a83db33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:14:13.402936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:13.402936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:13.402936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:13.402936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:13.402936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:13.402936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:13.402936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:13.402936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:13.402936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:13.402936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:13.402936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:13.402936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:13.402936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:13.402936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:13.402936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:13.403796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:13.403796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:13.403796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:13.403796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:13.403796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:13.403796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:13.403796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:13.403796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:13.403796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:13.403796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:13.403796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:13.403796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:13.403796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:13.403796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:13.403796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:13.403796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:13.404576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:13.404576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:13.404576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:13.404576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:13.404576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:13.404576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:13.404576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:13.404576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:13.404576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:13.404576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:13.404576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:14:13.404576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:13.404576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 97/187] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:13.405341 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe48a60-dcd5-4f05-a56f-546c6a83db33 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:13.412748 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9160dec-05c5-4a86-88f5-92fa413748ae None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:13.447762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b640a12-8c0b-4fd3-974f-cb20d77a60a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:13.448860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b640a12-8c0b-4fd3-974f-cb20d77a60a4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:13.449137 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b640a12-8c0b-4fd3-974f-cb20d77a60a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:13.449445 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b640a12-8c0b-4fd3-974f-cb20d77a60a4 None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:13.450624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b640a12-8c0b-4fd3-974f-cb20d77a60a4 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd455713ae940308a0af4cdfeb3c374)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:13.452082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b640a12-8c0b-4fd3-974f-cb20d77a60a4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:13.453839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 91/188] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:13 2022] GET /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:13.454596 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b640a12-8c0b-4fd3-974f-cb20d77a60a4 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:13.506648 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe48a60-dcd5-4f05-a56f-546c6a83db33 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:13.509533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:13.540301 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffc462-7f1b-4c50-8c6e-16acc31e2e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:13.541172 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffc462-7f1b-4c50-8c6e-16acc31e2e86 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:13.541480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffc462-7f1b-4c50-8c6e-16acc31e2e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:13.541760 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffc462-7f1b-4c50-8c6e-16acc31e2e86 None admin] PATH_INFO: `/v3/users/8533b60522fe42218218ad40f7c05675` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:13.556526 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b640a12-8c0b-4fd3-974f-cb20d77a60a4 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:13.557378 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffc462-7f1b-4c50-8c6e-16acc31e2e86 None admin] RBAC: Authorizing `identity:get_user(user_id=8533b60522fe42218218ad40f7c05675)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:13.558888 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffc462-7f1b-4c50-8c6e-16acc31e2e86 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:13.561456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 98/189] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:13 2022] GET /identity/v3/users/8533b60522fe42218218ad40f7c05675 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:13.561456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffc462-7f1b-4c50-8c6e-16acc31e2e86 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:13.591527 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1ab0a-45b5-4f38-b7f7-d360c1faa8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:13.592394 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1ab0a-45b5-4f38-b7f7-d360c1faa8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:13.592672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1ab0a-45b5-4f38-b7f7-d360c1faa8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:13.592947 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1ab0a-45b5-4f38-b7f7-d360c1faa8a7 None admin] PATH_INFO: `/v3/projects/ab5a896ce128415dbf4c0874f0ef89e5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:13.594184 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1ab0a-45b5-4f38-b7f7-d360c1faa8a7 None admin] RBAC: Authorizing `identity:get_project(project_id=ab5a896ce128415dbf4c0874f0ef89e5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:13.595658 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1ab0a-45b5-4f38-b7f7-d360c1faa8a7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:13.597538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 92/190] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:13 2022] GET /identity/v3/projects/ab5a896ce128415dbf4c0874f0ef89e5 => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:13.598142 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1ab0a-45b5-4f38-b7f7-d360c1faa8a7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:13.601849 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:13.667445 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffc462-7f1b-4c50-8c6e-16acc31e2e86 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:13.695976 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1ab0a-45b5-4f38-b7f7-d360c1faa8a7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:13.700497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020263d-f22d-4fc4-8bf3-a1d516dc57b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:13.701303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020263d-f22d-4fc4-8bf3-a1d516dc57b6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:13.701586 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020263d-f22d-4fc4-8bf3-a1d516dc57b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:13.701858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020263d-f22d-4fc4-8bf3-a1d516dc57b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:13.703013 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020263d-f22d-4fc4-8bf3-a1d516dc57b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:13.704467 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020263d-f22d-4fc4-8bf3-a1d516dc57b6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:13.706326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 99/191] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:13.706828 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020263d-f22d-4fc4-8bf3-a1d516dc57b6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:13.715745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:13.730359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbdd69-7919-4113-848a-dae1231338dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:13.731167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbdd69-7919-4113-848a-dae1231338dc None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:13.731452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbdd69-7919-4113-848a-dae1231338dc None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:13.731731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbdd69-7919-4113-848a-dae1231338dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:13.742193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbdd69-7919-4113-848a-dae1231338dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:13.750359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-a4bbdd69-7919-4113-848a-dae1231338dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:13.750359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:13.750359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:13.750359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:13.750359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:13.750359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:13.750359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:13.750359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:13.750359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:13.750359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:13.750359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:13.750359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:13.750359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:13.750359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:13.750359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:13.750359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:13.751364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:13.751364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:13.751364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:13.751364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:13.751364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:13.751364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:13.751364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:13.751364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:13.751364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:13.751364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:13.751364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:13.751364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:13.751364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:13.751364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:13.751364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:13.751364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:13.757189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:13.757189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:13.757189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:13.757189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:13.757189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:13.757189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:13.757189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:13.757189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:13.757189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:13.757189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:13.757189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:13.757189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:13.757189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 93/192] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:14:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:13.757189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbdd69-7919-4113-848a-dae1231338dc None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:13.809489 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020263d-f22d-4fc4-8bf3-a1d516dc57b6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:13.812477 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:13.843281 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451faec0-efb5-47b5-b3b2-6c5390aa9049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:13.843950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451faec0-efb5-47b5-b3b2-6c5390aa9049 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:13.844231 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451faec0-efb5-47b5-b3b2-6c5390aa9049 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:13.844506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451faec0-efb5-47b5-b3b2-6c5390aa9049 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:13.845250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451faec0-efb5-47b5-b3b2-6c5390aa9049 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:13.845585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451faec0-efb5-47b5-b3b2-6c5390aa9049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:13.846964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451faec0-efb5-47b5-b3b2-6c5390aa9049 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:13.855752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 100/193] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:13.856128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbdd69-7919-4113-848a-dae1231338dc None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:13.856299 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451faec0-efb5-47b5-b3b2-6c5390aa9049 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:13.889832 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e1501-b163-43a7-b4d2-a920f123158a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:13.890480 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e1501-b163-43a7-b4d2-a920f123158a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:13.890771 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e1501-b163-43a7-b4d2-a920f123158a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:13.891048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e1501-b163-43a7-b4d2-a920f123158a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:13.891878 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e1501-b163-43a7-b4d2-a920f123158a None admin] RBAC: Adding query filter params (role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.project.id=5fd455713ae940308a0af4cdfeb3c374, user.id=932830b2b4ea40b59369012d162538e2) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:13.892196 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e1501-b163-43a7-b4d2-a920f123158a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:13.893702 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e1501-b163-43a7-b4d2-a920f123158a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:13.900001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 94/194] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:13 2022] GET /identity/v3/role_assignments?user.id=932830b2b4ea40b59369012d162538e2&scope.project.id=5fd455713ae940308a0af4cdfeb3c374&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:13.900776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e1501-b163-43a7-b4d2-a920f123158a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:13.952105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:13.971711 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451faec0-efb5-47b5-b3b2-6c5390aa9049 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:14.009860 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211caf2-7cf4-432c-a9b9-1c38834fba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:14.010533 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211caf2-7cf4-432c-a9b9-1c38834fba15 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:14.010817 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211caf2-7cf4-432c-a9b9-1c38834fba15 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:14.011098 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211caf2-7cf4-432c-a9b9-1c38834fba15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:14.017582 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e1501-b163-43a7-b4d2-a920f123158a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:14.050570 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:14.065388 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa3b83-641b-4e9e-9f7c-e3e88c3da2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:14.066054 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa3b83-641b-4e9e-9f7c-e3e88c3da2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:14.066351 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa3b83-641b-4e9e-9f7c-e3e88c3da2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:14.066752 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa3b83-641b-4e9e-9f7c-e3e88c3da2b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:14.067597 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa3b83-641b-4e9e-9f7c-e3e88c3da2b1 None admin] RBAC: Adding query filter params (role.id=7ad29af380bd4e608c78235cbf9741b6, scope.project.id=ab5a896ce128415dbf4c0874f0ef89e5, user.id=d8b17c78161f4eebba3a526db806cf9e) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:14.068606 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa3b83-641b-4e9e-9f7c-e3e88c3da2b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:14.069588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa3b83-641b-4e9e-9f7c-e3e88c3da2b1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:14.076234 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 95/195] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:13 2022] GET /identity/v3/role_assignments?user.id=d8b17c78161f4eebba3a526db806cf9e&scope.project.id=ab5a896ce128415dbf4c0874f0ef89e5&role.id=7ad29af380bd4e608c78235cbf9741b6 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:14.077019 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa3b83-641b-4e9e-9f7c-e3e88c3da2b1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:14.104160 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211caf2-7cf4-432c-a9b9-1c38834fba15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:14.105821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211caf2-7cf4-432c-a9b9-1c38834fba15 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:14.216895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa3b83-641b-4e9e-9f7c-e3e88c3da2b1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:14.227202 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:14.230028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 101/196] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:14.230841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211caf2-7cf4-432c-a9b9-1c38834fba15 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:14.264187 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657fb5f-189b-4fbf-97b3-aba9dc35041f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:14.265209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657fb5f-189b-4fbf-97b3-aba9dc35041f None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:14.265209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657fb5f-189b-4fbf-97b3-aba9dc35041f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:14.265584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657fb5f-189b-4fbf-97b3-aba9dc35041f None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:14.266307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657fb5f-189b-4fbf-97b3-aba9dc35041f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:14.267775 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657fb5f-189b-4fbf-97b3-aba9dc35041f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:14.292003 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 96/197] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Jul 12 18:14:14 2022] POST /identity/v3/users => generated 297 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:14:14.293703 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657fb5f-189b-4fbf-97b3-aba9dc35041f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:14.320908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:14.365221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211caf2-7cf4-432c-a9b9-1c38834fba15 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:14.404165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819f32f-812f-4201-a582-c5e78480ddaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:14.404841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819f32f-812f-4201-a582-c5e78480ddaa None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:14.405122 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819f32f-812f-4201-a582-c5e78480ddaa None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:14.405426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819f32f-812f-4201-a582-c5e78480ddaa None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:14.406193 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819f32f-812f-4201-a582-c5e78480ddaa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:14.406502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819f32f-812f-4201-a582-c5e78480ddaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:14.407756 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657fb5f-189b-4fbf-97b3-aba9dc35041f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:14.407924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819f32f-812f-4201-a582-c5e78480ddaa None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:14.418248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 102/198] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:14:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:14.418934 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819f32f-812f-4201-a582-c5e78480ddaa None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:14.454093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3d209-3ace-4407-92da-16254b568e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:14.454988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3d209-3ace-4407-92da-16254b568e16 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:14.455459 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3d209-3ace-4407-92da-16254b568e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:14.455742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3d209-3ace-4407-92da-16254b568e16 None admin] PATH_INFO: `/v3/users/4d9bff7d464c41e3944de1b786ef8288` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:14.457107 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3d209-3ace-4407-92da-16254b568e16 None admin] RBAC: Authorizing `identity:get_user(user_id=4d9bff7d464c41e3944de1b786ef8288)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:14.458651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3d209-3ace-4407-92da-16254b568e16 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:14.460455 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 97/199] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:14 2022] GET /identity/v3/users/4d9bff7d464c41e3944de1b786ef8288 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:14.461141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3d209-3ace-4407-92da-16254b568e16 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:14.495284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:14.545000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819f32f-812f-4201-a582-c5e78480ddaa None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:14.581607 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:14.591087 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3d209-3ace-4407-92da-16254b568e16 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:14.593426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474f64f-ceac-4bfd-9a5c-7466da3cf531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:14.594454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474f64f-ceac-4bfd-9a5c-7466da3cf531 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:14.594895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474f64f-ceac-4bfd-9a5c-7466da3cf531 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:14.595296 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474f64f-ceac-4bfd-9a5c-7466da3cf531 None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:14.596660 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474f64f-ceac-4bfd-9a5c-7466da3cf531 None admin] RBAC: Authorizing `identity:get_project(project_id=b83079b3240b49369bd78d73fd7c599c)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:14.598287 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474f64f-ceac-4bfd-9a5c-7466da3cf531 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:14.600206 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 103/200] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:14 2022] GET /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:14.601385 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474f64f-ceac-4bfd-9a5c-7466da3cf531 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:14.630094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0edfcb-c3b2-4d8f-ae9f-bdb90de0bd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:14.630970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0edfcb-c3b2-4d8f-ae9f-bdb90de0bd42 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:14.631351 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0edfcb-c3b2-4d8f-ae9f-bdb90de0bd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:14.631733 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0edfcb-c3b2-4d8f-ae9f-bdb90de0bd42 None admin] PATH_INFO: `/v3/users/8533b60522fe42218218ad40f7c05675` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:14.633112 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0edfcb-c3b2-4d8f-ae9f-bdb90de0bd42 None admin] RBAC: Authorizing `identity:get_user(user_id=8533b60522fe42218218ad40f7c05675)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:14.634608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0edfcb-c3b2-4d8f-ae9f-bdb90de0bd42 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:14.636341 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 98/201] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:14 2022] GET /identity/v3/users/8533b60522fe42218218ad40f7c05675 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:14.637113 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0edfcb-c3b2-4d8f-ae9f-bdb90de0bd42 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:14.717159 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474f64f-ceac-4bfd-9a5c-7466da3cf531 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:14.738930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:14.744052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0edfcb-c3b2-4d8f-ae9f-bdb90de0bd42 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:14.756761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585482d-dadb-4ff1-8ec5-88d63bb87535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:14.757484 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585482d-dadb-4ff1-8ec5-88d63bb87535 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:14.757770 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585482d-dadb-4ff1-8ec5-88d63bb87535 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:14.758197 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585482d-dadb-4ff1-8ec5-88d63bb87535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:14.780349 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537c715-f607-42f1-b318-478f7a4adc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:14.781275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537c715-f607-42f1-b318-478f7a4adc63 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:14.781707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537c715-f607-42f1-b318-478f7a4adc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:14.781979 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537c715-f607-42f1-b318-478f7a4adc63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:14.782817 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537c715-f607-42f1-b318-478f7a4adc63 None admin] RBAC: Adding query filter params (role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.project.id=b83079b3240b49369bd78d73fd7c599c, user.id=8533b60522fe42218218ad40f7c05675) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:14.783127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537c715-f607-42f1-b318-478f7a4adc63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:14.784584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537c715-f607-42f1-b318-478f7a4adc63 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:14.790960 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 99/202] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:14 2022] GET /identity/v3/role_assignments?user.id=8533b60522fe42218218ad40f7c05675&scope.project.id=b83079b3240b49369bd78d73fd7c599c&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:14.791756 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537c715-f607-42f1-b318-478f7a4adc63 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:14.829443 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:14.846519 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585482d-dadb-4ff1-8ec5-88d63bb87535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:14.848491 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585482d-dadb-4ff1-8ec5-88d63bb87535 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:14.897167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537c715-f607-42f1-b318-478f7a4adc63 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:14.933248 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba87a5b-22b9-4b41-98a6-6219cee9a497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:14.933932 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba87a5b-22b9-4b41-98a6-6219cee9a497 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:14.934213 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba87a5b-22b9-4b41-98a6-6219cee9a497 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:14.934487 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba87a5b-22b9-4b41-98a6-6219cee9a497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:14.969314 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:15.050137 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 104/203] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:15.054066 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba87a5b-22b9-4b41-98a6-6219cee9a497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:15.055552 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba87a5b-22b9-4b41-98a6-6219cee9a497 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:15.058304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585482d-dadb-4ff1-8ec5-88d63bb87535 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:15.168473 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:15.178365 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585482d-dadb-4ff1-8ec5-88d63bb87535 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:15.184573 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 100/204] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:15.198393 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba87a5b-22b9-4b41-98a6-6219cee9a497 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:15.272182 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:15.282000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f60e92-d0ab-42ff-92a9-2a337de86a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:15.282895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f60e92-d0ab-42ff-92a9-2a337de86a23 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:15.283185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f60e92-d0ab-42ff-92a9-2a337de86a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:15.283467 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f60e92-d0ab-42ff-92a9-2a337de86a23 None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:15.287778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f60e92-d0ab-42ff-92a9-2a337de86a23 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd455713ae940308a0af4cdfeb3c374)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:15.290645 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f60e92-d0ab-42ff-92a9-2a337de86a23 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:15.292833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 105/205] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:15 2022] GET /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:15.298440 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f60e92-d0ab-42ff-92a9-2a337de86a23 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:15.324746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba87a5b-22b9-4b41-98a6-6219cee9a497 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:15.395150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e087a-df18-44b3-934f-23c7733b7804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:15.396308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e087a-df18-44b3-934f-23c7733b7804 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:15.396939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e087a-df18-44b3-934f-23c7733b7804 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:15.399052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e087a-df18-44b3-934f-23c7733b7804 None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:15.401145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e087a-df18-44b3-934f-23c7733b7804 None admin] RBAC: Authorizing `identity:get_project(project_id=b83079b3240b49369bd78d73fd7c599c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:15.405429 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e087a-df18-44b3-934f-23c7733b7804 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:15.407320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 101/206] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:15 2022] GET /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:15.415995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e087a-df18-44b3-934f-23c7733b7804 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:15.509350 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f60e92-d0ab-42ff-92a9-2a337de86a23 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:15.568812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd3626-ed79-43b6-85bd-10c5d16badde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:15.568812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd3626-ed79-43b6-85bd-10c5d16badde None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:15.568812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd3626-ed79-43b6-85bd-10c5d16badde None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:15.568812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd3626-ed79-43b6-85bd-10c5d16badde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:15.569565 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd3626-ed79-43b6-85bd-10c5d16badde None admin] RBAC: Adding query filter params (role.id=aec350b8d47248f1a54daf9304cdc462, scope.project.id=5fd455713ae940308a0af4cdfeb3c374, user.id=4d9bff7d464c41e3944de1b786ef8288) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:15.569565 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd3626-ed79-43b6-85bd-10c5d16badde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:15.572670 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd3626-ed79-43b6-85bd-10c5d16badde None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:15.578226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 106/207] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:15 2022] GET /identity/v3/role_assignments?user.id=4d9bff7d464c41e3944de1b786ef8288&scope.project.id=5fd455713ae940308a0af4cdfeb3c374&role.id=aec350b8d47248f1a54daf9304cdc462 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:15.605599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e087a-df18-44b3-934f-23c7733b7804 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:15.654299 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:15.662027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753eb30-8748-4286-97e2-7b55e2dd180d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:15.663076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753eb30-8748-4286-97e2-7b55e2dd180d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:15.664098 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753eb30-8748-4286-97e2-7b55e2dd180d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:15.664572 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753eb30-8748-4286-97e2-7b55e2dd180d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:15.665670 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753eb30-8748-4286-97e2-7b55e2dd180d None admin] RBAC: Adding query filter params (role.id=fb45aabab51d4c698f2da1840ff5920d, scope.project.id=b83079b3240b49369bd78d73fd7c599c, user.id=8533b60522fe42218218ad40f7c05675) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:15.666218 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753eb30-8748-4286-97e2-7b55e2dd180d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:15.667936 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753eb30-8748-4286-97e2-7b55e2dd180d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:15.680025 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 102/208] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:15 2022] GET /identity/v3/role_assignments?user.id=8533b60522fe42218218ad40f7c05675&scope.project.id=b83079b3240b49369bd78d73fd7c599c&role.id=fb45aabab51d4c698f2da1840ff5920d => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:16.724061 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c883936-a101-4814-8d3e-58ea31a461f0 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:16.724600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c883936-a101-4814-8d3e-58ea31a461f0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:16.724678 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13985f72-ac6c-47ac-915d-856478861114 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:16.725006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c883936-a101-4814-8d3e-58ea31a461f0 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:16.725076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13985f72-ac6c-47ac-915d-856478861114 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:16.725142 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13985f72-ac6c-47ac-915d-856478861114 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:16.726321 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 107/209] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:16.726794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 103/210] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:16.731230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea36f5-4c5e-4e76-976e-927b55233c8c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:16.731525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea36f5-4c5e-4e76-976e-927b55233c8c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:16.731626 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98370643-16f8-4808-b8e4-3a722717a4ae None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:16.731809 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea36f5-4c5e-4e76-976e-927b55233c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:16.731905 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98370643-16f8-4808-b8e4-3a722717a4ae None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:16.732070 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98370643-16f8-4808-b8e4-3a722717a4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:16.749162 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-dfea36f5-4c5e-4e76-976e-927b55233c8c None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:16.749594 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-98370643-16f8-4808-b8e4-3a722717a4ae None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:16.750397 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-dfea36f5-4c5e-4e76-976e-927b55233c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:16.750740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-98370643-16f8-4808-b8e4-3a722717a4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:16.776738 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:16.830549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 108/211] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:16.839791 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 104/212] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:16.856622 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea36f5-4c5e-4e76-976e-927b55233c8c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:16.862621 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98370643-16f8-4808-b8e4-3a722717a4ae None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:16.975783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea36f5-4c5e-4e76-976e-927b55233c8c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:16.982464 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98370643-16f8-4808-b8e4-3a722717a4ae None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:17.014004 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d361ec-12ef-4ce2-8b82-f3eaf9e50564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:17.014794 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d361ec-12ef-4ce2-8b82-f3eaf9e50564 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:17.015072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d361ec-12ef-4ce2-8b82-f3eaf9e50564 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:17.015363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d361ec-12ef-4ce2-8b82-f3eaf9e50564 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:17.017516 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d361ec-12ef-4ce2-8b82-f3eaf9e50564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:17.018984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d361ec-12ef-4ce2-8b82-f3eaf9e50564 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:17.020583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 109/213] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:17.026293 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d361ec-12ef-4ce2-8b82-f3eaf9e50564 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:17.028120 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:17.038916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9f4f5-a3f1-4417-b756-4e6c96309daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:17.039831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9f4f5-a3f1-4417-b756-4e6c96309daa None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:17.040208 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9f4f5-a3f1-4417-b756-4e6c96309daa None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:17.040594 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9f4f5-a3f1-4417-b756-4e6c96309daa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:17.051217 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9f4f5-a3f1-4417-b756-4e6c96309daa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:17.059610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-80b9f4f5-a3f1-4417-b756-4e6c96309daa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:17.059610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:17.059610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:17.059610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:17.059610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:17.059610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:17.059610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:17.059610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:17.059610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:17.059610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:17.059610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:17.059610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:17.059610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:17.059610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:17.059610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:17.059610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:17.060679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:17.060679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:17.060679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:17.060679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:17.060679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:17.060679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:17.060679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:17.060679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:17.060679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:17.060679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:17.060679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:17.060679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:17.060679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:17.060679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:17.060679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:17.060679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:17.062011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:17.062011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:17.062011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:17.062011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:17.062011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:17.062011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:17.062011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:17.062011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:17.062011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:17.062011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:17.062011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:17.062011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:17.062905 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:17.068465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 105/214] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:17.070092 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9f4f5-a3f1-4417-b756-4e6c96309daa None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:17.152402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d361ec-12ef-4ce2-8b82-f3eaf9e50564 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:17.186694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9f4f5-a3f1-4417-b756-4e6c96309daa None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:17.190682 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a8989-82c0-4792-aec0-4b0a25f28fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:17.191354 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a8989-82c0-4792-aec0-4b0a25f28fe2 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:17.191620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a8989-82c0-4792-aec0-4b0a25f28fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:17.191889 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a8989-82c0-4792-aec0-4b0a25f28fe2 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:17.192594 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a8989-82c0-4792-aec0-4b0a25f28fe2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:17.195129 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a8989-82c0-4792-aec0-4b0a25f28fe2 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:17.217843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 110/215] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Jul 12 18:14:17 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:14:17.218937 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce63f9-c13e-423f-8a58-ea9d51dd7799 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:17.219227 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce63f9-c13e-423f-8a58-ea9d51dd7799 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:17.219690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce63f9-c13e-423f-8a58-ea9d51dd7799 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:17.220885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 111/216] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:17.226967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e94df-1b1b-43d0-b1e0-48ee8aa4b24c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:17.227310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e94df-1b1b-43d0-b1e0-48ee8aa4b24c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:17.227529 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e94df-1b1b-43d0-b1e0-48ee8aa4b24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:17.235416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79abe9-1920-4432-aba6-7d6f91b895b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:17.236563 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79abe9-1920-4432-aba6-7d6f91b895b1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:17.237046 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79abe9-1920-4432-aba6-7d6f91b895b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:17.237578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79abe9-1920-4432-aba6-7d6f91b895b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:17.238565 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79abe9-1920-4432-aba6-7d6f91b895b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:17.239139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79abe9-1920-4432-aba6-7d6f91b895b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:17.242656 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79abe9-1920-4432-aba6-7d6f91b895b1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:17.246277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a66e94df-1b1b-43d0-b1e0-48ee8aa4b24c None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:17.247488 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a66e94df-1b1b-43d0-b1e0-48ee8aa4b24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:17.255381 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 106/217] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:17.260994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79abe9-1920-4432-aba6-7d6f91b895b1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:17.332029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 112/218] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:17.334208 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:17.356920 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e94df-1b1b-43d0-b1e0-48ee8aa4b24c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:17.373508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:17.400062 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79abe9-1920-4432-aba6-7d6f91b895b1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:17.436247 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da998246-71cd-44f2-9938-34732e66af23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:17.437047 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da998246-71cd-44f2-9938-34732e66af23 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:17.437353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da998246-71cd-44f2-9938-34732e66af23 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:17.437630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da998246-71cd-44f2-9938-34732e66af23 None admin] PATH_INFO: `/v3/users/bb923bcb08e4407393b589b78d68a8d9` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:17.455973 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da998246-71cd-44f2-9938-34732e66af23 None admin] RBAC: Authorizing `identity:get_user(user_id=bb923bcb08e4407393b589b78d68a8d9)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:17.457997 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da998246-71cd-44f2-9938-34732e66af23 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:17.460770 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 107/219] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:17 2022] GET /identity/v3/users/bb923bcb08e4407393b589b78d68a8d9 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:17.465970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da998246-71cd-44f2-9938-34732e66af23 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:17.491984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e94df-1b1b-43d0-b1e0-48ee8aa4b24c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:17.550259 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764833c4-8096-4d54-8265-89267c51b67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:17.551444 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764833c4-8096-4d54-8265-89267c51b67f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:17.551800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764833c4-8096-4d54-8265-89267c51b67f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:17.552256 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764833c4-8096-4d54-8265-89267c51b67f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:17.565133 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764833c4-8096-4d54-8265-89267c51b67f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:17.573878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-764833c4-8096-4d54-8265-89267c51b67f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:14:17.573878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:17.573878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:17.573878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:17.573878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:17.573878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:17.573878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:17.573878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:17.573878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:17.573878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:17.573878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:17.573878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:17.573878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:17.573878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:17.573878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:17.573878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:17.574779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:17.574779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:17.574779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:17.574779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:17.574779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:17.574779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:17.574779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:17.574779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:17.574779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:17.574779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:17.574779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:17.574779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:17.574779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:17.574779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:17.574779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:17.574779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:17.575553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:17.575553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:17.575553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:17.575553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:17.575553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:17.575553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:17.575553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:17.575553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:17.575553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:17.575553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:17.575553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:14:17.575553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:17.575553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 113/220] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:14:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:17.583087 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764833c4-8096-4d54-8265-89267c51b67f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:17.610792 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da998246-71cd-44f2-9938-34732e66af23 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:17.619010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:17.648831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533cbb8-deb7-4ca8-b293-750ff405b19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:17.649522 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533cbb8-deb7-4ca8-b293-750ff405b19a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:17.649807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533cbb8-deb7-4ca8-b293-750ff405b19a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:17.650175 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533cbb8-deb7-4ca8-b293-750ff405b19a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:17.662502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:17.695813 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764833c4-8096-4d54-8265-89267c51b67f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:17.723624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533cbb8-deb7-4ca8-b293-750ff405b19a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:17.725175 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533cbb8-deb7-4ca8-b293-750ff405b19a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:17.734226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d481832-d4e8-4058-864a-1aad0ab343a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:17.734901 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d481832-d4e8-4058-864a-1aad0ab343a6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:17.735297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d481832-d4e8-4058-864a-1aad0ab343a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:17.735580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d481832-d4e8-4058-864a-1aad0ab343a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:17.736344 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d481832-d4e8-4058-864a-1aad0ab343a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:17.736654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d481832-d4e8-4058-864a-1aad0ab343a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:17.738183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d481832-d4e8-4058-864a-1aad0ab343a6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:17.747747 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 114/221] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:17.754819 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d481832-d4e8-4058-864a-1aad0ab343a6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:17.858704 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 108/222] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 18:14:17.863876 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7ab9b-7597-4518-96ea-49abcb847e60 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:17.863876 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7ab9b-7597-4518-96ea-49abcb847e60 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:17.863876 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7ab9b-7597-4518-96ea-49abcb847e60 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:17.866046 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 109/223] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:17.867012 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7ab9b-7597-4518-96ea-49abcb847e60 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:17.876201 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:17.883217 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d481832-d4e8-4058-864a-1aad0ab343a6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:17.918911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a8fd4-c29b-496f-940e-2e7de3333da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:17.920210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a8fd4-c29b-496f-940e-2e7de3333da2 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:17.920541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a8fd4-c29b-496f-940e-2e7de3333da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:17.920828 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a8fd4-c29b-496f-940e-2e7de3333da2 None admin] PATH_INFO: `/v3/users/8533b60522fe42218218ad40f7c05675` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:17.922076 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a8fd4-c29b-496f-940e-2e7de3333da2 None admin] RBAC: Authorizing `identity:get_user(user_id=8533b60522fe42218218ad40f7c05675)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:17.923532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a8fd4-c29b-496f-940e-2e7de3333da2 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:17.925486 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 115/224] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:17 2022] GET /identity/v3/users/8533b60522fe42218218ad40f7c05675 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:17.926649 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5214011-78c1-446c-b3fc-cc9cc91f00f2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:17.926930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5214011-78c1-446c-b3fc-cc9cc91f00f2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:17.927204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5214011-78c1-446c-b3fc-cc9cc91f00f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:17.938200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:17.951154 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e5214011-78c1-446c-b3fc-cc9cc91f00f2 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:17.952379 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e5214011-78c1-446c-b3fc-cc9cc91f00f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:17.986027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7ab9b-7597-4518-96ea-49abcb847e60 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:18.020677 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 116/225] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:18.021566 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5214011-78c1-446c-b3fc-cc9cc91f00f2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:18.038975 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2829d8-d7d8-4cf0-adc4-daa87af756db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:18.039949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2829d8-d7d8-4cf0-adc4-daa87af756db None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:18.040326 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2829d8-d7d8-4cf0-adc4-daa87af756db None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:18.040607 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2829d8-d7d8-4cf0-adc4-daa87af756db None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:18.046170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2829d8-d7d8-4cf0-adc4-daa87af756db None admin] RBAC: Authorizing `identity:get_project(project_id=b83079b3240b49369bd78d73fd7c599c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:18.047977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2829d8-d7d8-4cf0-adc4-daa87af756db None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:18.050203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 110/226] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:17 2022] GET /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:18.051205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2829d8-d7d8-4cf0-adc4-daa87af756db None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:18.126762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5214011-78c1-446c-b3fc-cc9cc91f00f2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:18.133187 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:18.157596 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:18.162704 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a31b0-470a-4aff-9143-82fa47606a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:18.163597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a31b0-470a-4aff-9143-82fa47606a86 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:18.163878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a31b0-470a-4aff-9143-82fa47606a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:18.164146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a31b0-470a-4aff-9143-82fa47606a86 None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:18.165359 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a31b0-470a-4aff-9143-82fa47606a86 None admin] RBAC: Authorizing `identity:get_project(project_id=b83079b3240b49369bd78d73fd7c599c)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:18.166406 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2829d8-d7d8-4cf0-adc4-daa87af756db None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:18.166806 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a31b0-470a-4aff-9143-82fa47606a86 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:18.168670 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 117/227] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:18 2022] GET /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:18.169245 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a31b0-470a-4aff-9143-82fa47606a86 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:18.207757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262db9f-b44f-43c3-841d-e9b57cdf65aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:18.208749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262db9f-b44f-43c3-841d-e9b57cdf65aa None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:18.209041 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262db9f-b44f-43c3-841d-e9b57cdf65aa None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:18.210814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262db9f-b44f-43c3-841d-e9b57cdf65aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:18.224420 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262db9f-b44f-43c3-841d-e9b57cdf65aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:18.235826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-6262db9f-b44f-43c3-841d-e9b57cdf65aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:18.235826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:18.235826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:18.235826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:18.235826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:18.235826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:18.235826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:18.235826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:18.235826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:18.235826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:18.235826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:18.235826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:18.235826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:18.235826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:18.235826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:18.235826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:18.236746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:18.236746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:18.236746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:18.236746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:18.236746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:18.236746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:18.236746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:18.236746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:18.236746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:18.236746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:18.236746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:18.236746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:18.236746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:18.236746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:18.236746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:18.236746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:18.237697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:18.237697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:18.237697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:18.237697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:18.237697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:18.237697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:18.237697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:18.237697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:18.237697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:18.237697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:18.237697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:18.237697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:18.237697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 111/228] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:14:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:18.238413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262db9f-b44f-43c3-841d-e9b57cdf65aa None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:18.290030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a31b0-470a-4aff-9143-82fa47606a86 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:18.337611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b720b-1a85-455d-a5e5-057a03ab8362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:18.338282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b720b-1a85-455d-a5e5-057a03ab8362 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:18.338711 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b720b-1a85-455d-a5e5-057a03ab8362 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:18.339114 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b720b-1a85-455d-a5e5-057a03ab8362 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:18.340214 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b720b-1a85-455d-a5e5-057a03ab8362 None admin] RBAC: Adding query filter params (role.id=7ad29af380bd4e608c78235cbf9741b6, scope.project.id=b83079b3240b49369bd78d73fd7c599c, user.id=bb923bcb08e4407393b589b78d68a8d9) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:18.340537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b720b-1a85-455d-a5e5-057a03ab8362 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:18.342745 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b720b-1a85-455d-a5e5-057a03ab8362 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:18.350063 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262db9f-b44f-43c3-841d-e9b57cdf65aa None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:18.350358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 118/229] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:18 2022] GET /identity/v3/role_assignments?user.id=bb923bcb08e4407393b589b78d68a8d9&scope.project.id=b83079b3240b49369bd78d73fd7c599c&role.id=7ad29af380bd4e608c78235cbf9741b6 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:18.351187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b720b-1a85-455d-a5e5-057a03ab8362 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:18.438582 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f322f-f963-41ec-8406-0f0e056f603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:18.439493 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f322f-f963-41ec-8406-0f0e056f603f None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:18.439778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f322f-f963-41ec-8406-0f0e056f603f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:18.440063 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f322f-f963-41ec-8406-0f0e056f603f None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c/users/8533b60522fe42218218ad40f7c05675/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:18.449130 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f322f-f963-41ec-8406-0f0e056f603f None admin] RBAC: Authorizing `identity:create_grant(project_id=b83079b3240b49369bd78d73fd7c599c, user_id=8533b60522fe42218218ad40f7c05675, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:18.450973 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f322f-f963-41ec-8406-0f0e056f603f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:18.456190 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:18.476252 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 112/230] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:14:18 2022] PUT /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c/users/8533b60522fe42218218ad40f7c05675/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:14:18.485488 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:18.530381 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b720b-1a85-455d-a5e5-057a03ab8362 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:18.569498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99b38b-6786-430f-863d-f7eeb1500228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:18.570193 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99b38b-6786-430f-863d-f7eeb1500228 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:18.570485 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99b38b-6786-430f-863d-f7eeb1500228 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:18.570755 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99b38b-6786-430f-863d-f7eeb1500228 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:18.571529 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99b38b-6786-430f-863d-f7eeb1500228 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:18.571837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99b38b-6786-430f-863d-f7eeb1500228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:18.573544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99b38b-6786-430f-863d-f7eeb1500228 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:18.583288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 119/231] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:14:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:18.590399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f322f-f963-41ec-8406-0f0e056f603f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:18.716213 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f322f-f963-41ec-8406-0f0e056f603f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:18.758939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eb483-46af-4c26-99dd-81f89b604a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:18.759748 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eb483-46af-4c26-99dd-81f89b604a80 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:18.760035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eb483-46af-4c26-99dd-81f89b604a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:18.760315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eb483-46af-4c26-99dd-81f89b604a80 None admin] PATH_INFO: `/v3/users/8533b60522fe42218218ad40f7c05675` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:18.762085 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eb483-46af-4c26-99dd-81f89b604a80 None admin] RBAC: Authorizing `identity:get_user(user_id=8533b60522fe42218218ad40f7c05675)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:18.763608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eb483-46af-4c26-99dd-81f89b604a80 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:18.765408 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 113/232] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:18 2022] GET /identity/v3/users/8533b60522fe42218218ad40f7c05675 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:18.771168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99b38b-6786-430f-863d-f7eeb1500228 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:18.915292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99b38b-6786-430f-863d-f7eeb1500228 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:18.948372 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:18.962918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114f440-12b0-416b-bdb1-7f467a928879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:18.963840 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114f440-12b0-416b-bdb1-7f467a928879 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:18.964130 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114f440-12b0-416b-bdb1-7f467a928879 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:18.964402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114f440-12b0-416b-bdb1-7f467a928879 None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:18.965694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114f440-12b0-416b-bdb1-7f467a928879 None admin] RBAC: Authorizing `identity:get_project(project_id=b83079b3240b49369bd78d73fd7c599c)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:18.967144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114f440-12b0-416b-bdb1-7f467a928879 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:18.969055 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 120/233] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:18 2022] GET /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:18.974454 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eb483-46af-4c26-99dd-81f89b604a80 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:19.049900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:19.105768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eb483-46af-4c26-99dd-81f89b604a80 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:19.153974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c20eb-d19b-4d6c-9fee-3d994cf5b75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:19.154879 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c20eb-d19b-4d6c-9fee-3d994cf5b75e None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:19.155170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c20eb-d19b-4d6c-9fee-3d994cf5b75e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:19.155459 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c20eb-d19b-4d6c-9fee-3d994cf5b75e None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c/users/8533b60522fe42218218ad40f7c05675/roles/fb45aabab51d4c698f2da1840ff5920d` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:19.157820 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c20eb-d19b-4d6c-9fee-3d994cf5b75e None admin] RBAC: Authorizing `identity:create_grant(project_id=b83079b3240b49369bd78d73fd7c599c, user_id=8533b60522fe42218218ad40f7c05675, role_id=fb45aabab51d4c698f2da1840ff5920d)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:19.159298 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c20eb-d19b-4d6c-9fee-3d994cf5b75e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:19.175281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 114/234] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:14:18 2022] PUT /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c/users/8533b60522fe42218218ad40f7c05675/roles/fb45aabab51d4c698f2da1840ff5920d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:14:19.730193 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a45d90-baba-4af7-b50e-2d767d6f8e5f None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:19.730879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a45d90-baba-4af7-b50e-2d767d6f8e5f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:19.731362 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a45d90-baba-4af7-b50e-2d767d6f8e5f None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:19.733305 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 121/235] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:19.738680 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614f6b9-63a0-4472-8d8f-cc8b75cd6d6c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:19.739221 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614f6b9-63a0-4472-8d8f-cc8b75cd6d6c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:19.739714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614f6b9-63a0-4472-8d8f-cc8b75cd6d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:19.757629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e614f6b9-63a0-4472-8d8f-cc8b75cd6d6c None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:19.759093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e614f6b9-63a0-4472-8d8f-cc8b75cd6d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:19.838165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 115/236] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:19.874670 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a45d90-baba-4af7-b50e-2d767d6f8e5f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:19.929194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee9575-6d50-4640-b7b1-7dc59bdad457 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:19.929513 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee9575-6d50-4640-b7b1-7dc59bdad457 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:19.929784 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee9575-6d50-4640-b7b1-7dc59bdad457 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:19.931424 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 116/237] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:19.936313 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4fdc7-ea50-45bd-bd9d-2402ffef855f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:19.936590 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4fdc7-ea50-45bd-bd9d-2402ffef855f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:19.936856 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4fdc7-ea50-45bd-bd9d-2402ffef855f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:19.953679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f0a4fdc7-ea50-45bd-bd9d-2402ffef855f None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:19.954848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f0a4fdc7-ea50-45bd-bd9d-2402ffef855f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:20.040842 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a45d90-baba-4af7-b50e-2d767d6f8e5f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:20.049671 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:20.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 117/238] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:20.107453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790c8d1-dcdf-442f-b7ba-1a5d36e51649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:20.108181 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790c8d1-dcdf-442f-b7ba-1a5d36e51649 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:20.108464 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790c8d1-dcdf-442f-b7ba-1a5d36e51649 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:20.108739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790c8d1-dcdf-442f-b7ba-1a5d36e51649 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:20.111556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4fdc7-ea50-45bd-bd9d-2402ffef855f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:20.126155 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790c8d1-dcdf-442f-b7ba-1a5d36e51649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:20.139014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-a790c8d1-dcdf-442f-b7ba-1a5d36e51649 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:14:20.139014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:20.139014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:20.139014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:20.139014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:20.139014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:20.139014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:20.139014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:20.139014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:20.139014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:20.139014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:20.139014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:20.139014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:20.139014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:20.139014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:20.139014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:20.139924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:20.139924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:20.139924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:20.139924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:20.139924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:20.139924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:20.139924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:20.139924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:20.139924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:20.139924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:20.139924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:20.139924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:20.139924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:20.139924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:20.139924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:20.139924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:20.141190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:20.141190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:20.141190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:20.141190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:20.141190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:20.141190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:20.141190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:20.141190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:20.141190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:20.141190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:20.141190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:14:20.141190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:20.141190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 122/239] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:20.149448 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790c8d1-dcdf-442f-b7ba-1a5d36e51649 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:20.212972 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:20.260858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790c8d1-dcdf-442f-b7ba-1a5d36e51649 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:20.299022 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f0299-bcd3-48b4-8a4a-acf595a2a40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:20.299695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f0299-bcd3-48b4-8a4a-acf595a2a40c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:20.299980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f0299-bcd3-48b4-8a4a-acf595a2a40c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:20.300258 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f0299-bcd3-48b4-8a4a-acf595a2a40c None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:20.301005 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f0299-bcd3-48b4-8a4a-acf595a2a40c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:20.301338 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f0299-bcd3-48b4-8a4a-acf595a2a40c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:20.302732 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f0299-bcd3-48b4-8a4a-acf595a2a40c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:20.312484 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 123/240] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:20.318059 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f0299-bcd3-48b4-8a4a-acf595a2a40c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:20.359128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4fdc7-ea50-45bd-bd9d-2402ffef855f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:20.430091 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865214a7-7bf4-4a5c-b6a9-133417ce5cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:20.430885 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865214a7-7bf4-4a5c-b6a9-133417ce5cfa None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:20.431166 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865214a7-7bf4-4a5c-b6a9-133417ce5cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:20.431446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865214a7-7bf4-4a5c-b6a9-133417ce5cfa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:20.432792 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865214a7-7bf4-4a5c-b6a9-133417ce5cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:20.434261 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865214a7-7bf4-4a5c-b6a9-133417ce5cfa None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:20.436068 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 118/241] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:20.445992 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865214a7-7bf4-4a5c-b6a9-133417ce5cfa None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:20.482322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f0299-bcd3-48b4-8a4a-acf595a2a40c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:20.517737 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:20.519753 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bf346-f8ac-4153-bea9-17df9ff6af40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:20.520625 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bf346-f8ac-4153-bea9-17df9ff6af40 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:20.520917 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bf346-f8ac-4153-bea9-17df9ff6af40 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:20.521172 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bf346-f8ac-4153-bea9-17df9ff6af40 None admin] PATH_INFO: `/v3/users/dc736c3d12de4be2b05abdbb106b3a4f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:20.548586 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bf346-f8ac-4153-bea9-17df9ff6af40 None admin] RBAC: Authorizing `identity:get_user(user_id=dc736c3d12de4be2b05abdbb106b3a4f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:20.550372 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bf346-f8ac-4153-bea9-17df9ff6af40 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:20.554894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 124/242] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:20 2022] GET /identity/v3/users/dc736c3d12de4be2b05abdbb106b3a4f => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:20.559387 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bf346-f8ac-4153-bea9-17df9ff6af40 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:20.562948 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:20.670466 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865214a7-7bf4-4a5c-b6a9-133417ce5cfa None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:20.674973 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bf346-f8ac-4153-bea9-17df9ff6af40 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:20.736356 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf565335-f3d3-4dc4-a1dd-7e4544ab7448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:20.737007 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf565335-f3d3-4dc4-a1dd-7e4544ab7448 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:20.737304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf565335-f3d3-4dc4-a1dd-7e4544ab7448 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:20.737581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf565335-f3d3-4dc4-a1dd-7e4544ab7448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:20.738730 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbbb33-3a5d-4293-8518-fd3dc24c0fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:20.739450 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbbb33-3a5d-4293-8518-fd3dc24c0fb0 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:20.739772 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbbb33-3a5d-4293-8518-fd3dc24c0fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:20.740040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbbb33-3a5d-4293-8518-fd3dc24c0fb0 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:20.740760 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbbb33-3a5d-4293-8518-fd3dc24c0fb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:20.742274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbbb33-3a5d-4293-8518-fd3dc24c0fb0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:20.777227 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 119/243] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Jul 12 18:14:20 2022] POST /identity/v3/users => generated 293 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:14:20.779745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540baf0-c8a0-4f8f-bfbd-408bb0dbdd82 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:20.780190 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540baf0-c8a0-4f8f-bfbd-408bb0dbdd82 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:20.781088 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540baf0-c8a0-4f8f-bfbd-408bb0dbdd82 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:20.787828 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 120/244] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:20.789989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2e2b1-d92c-4fc3-8aa2-d21ca2d925cd None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:20.791003 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2e2b1-d92c-4fc3-8aa2-d21ca2d925cd None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:20.791285 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2e2b1-d92c-4fc3-8aa2-d21ca2d925cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:20.806376 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:20.820616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-75a2e2b1-d92c-4fc3-8aa2-d21ca2d925cd None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:20.822899 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-75a2e2b1-d92c-4fc3-8aa2-d21ca2d925cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:20.837067 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf565335-f3d3-4dc4-a1dd-7e4544ab7448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:20.838966 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf565335-f3d3-4dc4-a1dd-7e4544ab7448 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:20.956351 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 121/245] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:20.990780 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 125/246] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:20.997659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2e2b1-d92c-4fc3-8aa2-d21ca2d925cd None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:20.998306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf565335-f3d3-4dc4-a1dd-7e4544ab7448 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:21.038919 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:21.112135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:21.132907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2e2b1-d92c-4fc3-8aa2-d21ca2d925cd None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:21.149243 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf565335-f3d3-4dc4-a1dd-7e4544ab7448 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:21.186226 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bab6c-3fd8-4129-9c04-795971b3d9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:21.187269 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bab6c-3fd8-4129-9c04-795971b3d9bd None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:21.188144 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bab6c-3fd8-4129-9c04-795971b3d9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:21.188592 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bab6c-3fd8-4129-9c04-795971b3d9bd None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:21.190420 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bab6c-3fd8-4129-9c04-795971b3d9bd None admin] RBAC: Authorizing `identity:get_project(project_id=b83079b3240b49369bd78d73fd7c599c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:21.192124 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bab6c-3fd8-4129-9c04-795971b3d9bd None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:21.194056 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 122/247] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:20 2022] GET /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:21.200145 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b4ce5-4751-485c-bf6d-83bf0a6d9b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:21.200145 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b4ce5-4751-485c-bf6d-83bf0a6d9b7a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:21.200145 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b4ce5-4751-485c-bf6d-83bf0a6d9b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:21.200145 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b4ce5-4751-485c-bf6d-83bf0a6d9b7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:21.203804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bab6c-3fd8-4129-9c04-795971b3d9bd None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:21.220821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b4ce5-4751-485c-bf6d-83bf0a6d9b7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:21.233567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-912b4ce5-4751-485c-bf6d-83bf0a6d9b7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:21.233567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:21.233567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:21.233567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:21.233567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:21.233567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:21.233567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:21.233567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:21.233567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:21.233567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:21.233567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:21.233567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:21.233567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:21.233567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:21.233567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:21.233567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:21.234944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:21.234944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:21.234944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:21.234944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:21.234944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:21.234944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:21.234944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:21.234944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:21.234944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:21.234944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:21.234944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:21.234944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:21.234944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:21.234944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:21.234944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:21.234944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:21.236185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:21.236185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:21.236185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:21.236185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:21.236185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:21.236185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:21.236185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:21.236185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:21.236185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:21.236185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:21.236185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:21.236185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:21.239562 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 126/248] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:21.250660 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b4ce5-4751-485c-bf6d-83bf0a6d9b7a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:21.335778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bab6c-3fd8-4129-9c04-795971b3d9bd None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:21.339662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:21.376831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee66202-0c48-4d46-9c3a-f0f2b7f6455c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:21.377202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b4ce5-4751-485c-bf6d-83bf0a6d9b7a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:21.377537 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee66202-0c48-4d46-9c3a-f0f2b7f6455c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:21.377820 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee66202-0c48-4d46-9c3a-f0f2b7f6455c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:21.378094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee66202-0c48-4d46-9c3a-f0f2b7f6455c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:21.379053 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee66202-0c48-4d46-9c3a-f0f2b7f6455c None admin] RBAC: Adding query filter params (role.id=aec350b8d47248f1a54daf9304cdc462, scope.project.id=b83079b3240b49369bd78d73fd7c599c, user.id=dc736c3d12de4be2b05abdbb106b3a4f) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:21.380133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee66202-0c48-4d46-9c3a-f0f2b7f6455c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:21.380989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee66202-0c48-4d46-9c3a-f0f2b7f6455c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:21.387193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 123/249] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:21 2022] GET /identity/v3/role_assignments?user.id=dc736c3d12de4be2b05abdbb106b3a4f&scope.project.id=b83079b3240b49369bd78d73fd7c599c&role.id=aec350b8d47248f1a54daf9304cdc462 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:21.388492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3869a4e-9c0e-4b98-8d20-f6d880dc43d1 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:21.388905 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3869a4e-9c0e-4b98-8d20-f6d880dc43d1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:21.389195 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3869a4e-9c0e-4b98-8d20-f6d880dc43d1 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:21.390460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 124/250] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:21.398677 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d02a43-e45c-4764-9d23-8c394087c420 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:21.398978 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d02a43-e45c-4764-9d23-8c394087c420 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:21.399232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d02a43-e45c-4764-9d23-8c394087c420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:21.421811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bbd99-6886-4d9f-9a54-e00a71998b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:21.422565 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bbd99-6886-4d9f-9a54-e00a71998b40 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:21.422852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bbd99-6886-4d9f-9a54-e00a71998b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:21.423125 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bbd99-6886-4d9f-9a54-e00a71998b40 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:21.423903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bbd99-6886-4d9f-9a54-e00a71998b40 None admin] RBAC: Adding query filter params (name=member) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:21.424210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bbd99-6886-4d9f-9a54-e00a71998b40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:21.425692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bbd99-6886-4d9f-9a54-e00a71998b40 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:21.429670 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-09d02a43-e45c-4764-9d23-8c394087c420 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:21.431017 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-09d02a43-e45c-4764-9d23-8c394087c420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:21.433629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:21.436767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 127/251] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:21.449863 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bbd99-6886-4d9f-9a54-e00a71998b40 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:21.528398 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 125/252] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:21.554619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d02a43-e45c-4764-9d23-8c394087c420 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:21.586726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bbd99-6886-4d9f-9a54-e00a71998b40 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:21.633951 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182289c-d9fe-4da6-a1cf-ca6e6d1fec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:21.635064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182289c-d9fe-4da6-a1cf-ca6e6d1fec94 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:21.635673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182289c-d9fe-4da6-a1cf-ca6e6d1fec94 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:21.636133 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182289c-d9fe-4da6-a1cf-ca6e6d1fec94 None admin] PATH_INFO: `/v3/users/bb923bcb08e4407393b589b78d68a8d9` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:21.637560 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182289c-d9fe-4da6-a1cf-ca6e6d1fec94 None admin] RBAC: Authorizing `identity:get_user(user_id=bb923bcb08e4407393b589b78d68a8d9)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:21.639668 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182289c-d9fe-4da6-a1cf-ca6e6d1fec94 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:21.641845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 128/253] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:21 2022] GET /identity/v3/users/bb923bcb08e4407393b589b78d68a8d9 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:21.646900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182289c-d9fe-4da6-a1cf-ca6e6d1fec94 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:21.681960 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:21.686272 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d02a43-e45c-4764-9d23-8c394087c420 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:21.718583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:21.726284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902451b-252c-4ccf-9ffd-909a3bd243be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:21.727973 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902451b-252c-4ccf-9ffd-909a3bd243be None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:21.728252 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902451b-252c-4ccf-9ffd-909a3bd243be None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:21.728530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902451b-252c-4ccf-9ffd-909a3bd243be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:21.742268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902451b-252c-4ccf-9ffd-909a3bd243be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:21.752874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-9902451b-252c-4ccf-9ffd-909a3bd243be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:14:21.752874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:21.752874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:21.752874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:21.752874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:21.752874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:21.752874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:21.752874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:21.752874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:21.752874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:21.752874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:21.752874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:21.752874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:21.752874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:21.752874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:21.752874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:21.753794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:21.753794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:21.753794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:21.753794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:21.753794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:21.753794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:21.753794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:21.753794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:21.753794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:21.753794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:21.753794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:21.753794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:21.753794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:21.753794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:21.753794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:21.753794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:21.754562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:21.754562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:21.754562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:21.754562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:21.754562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:21.754562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:21.754562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:21.754562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:21.754562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:21.754562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:21.754562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:14:21.754562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:21.755658 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 126/254] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:14:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:21.757829 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca0588-98a0-49a3-ac0d-85c7f7999a05 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:21.758282 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca0588-98a0-49a3-ac0d-85c7f7999a05 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:21.758701 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca0588-98a0-49a3-ac0d-85c7f7999a05 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:21.758933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182289c-d9fe-4da6-a1cf-ca6e6d1fec94 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:21.760733 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 127/255] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:21.765663 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54056c4-8aeb-4db8-8f80-10ccd9e646cb None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:21.766106 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54056c4-8aeb-4db8-8f80-10ccd9e646cb None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:21.767040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54056c4-8aeb-4db8-8f80-10ccd9e646cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:21.800966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b54056c4-8aeb-4db8-8f80-10ccd9e646cb None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:21.802105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b54056c4-8aeb-4db8-8f80-10ccd9e646cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:21.826044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45fe30-ffa6-4bd5-9ea9-054a3df4acea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:21.826984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45fe30-ffa6-4bd5-9ea9-054a3df4acea None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:21.827266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45fe30-ffa6-4bd5-9ea9-054a3df4acea None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:21.827585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45fe30-ffa6-4bd5-9ea9-054a3df4acea None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:21.829599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45fe30-ffa6-4bd5-9ea9-054a3df4acea None admin] RBAC: Authorizing `identity:get_project(project_id=b83079b3240b49369bd78d73fd7c599c)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:21.833930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45fe30-ffa6-4bd5-9ea9-054a3df4acea None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:21.836066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 129/256] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:21 2022] GET /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:21.836722 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45fe30-ffa6-4bd5-9ea9-054a3df4acea None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:21.922916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 128/257] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:21.923976 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54056c4-8aeb-4db8-8f80-10ccd9e646cb None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:21.992940 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45fe30-ffa6-4bd5-9ea9-054a3df4acea None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:22.033770 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:22.051322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76429b-2727-456a-a263-0e5a182a27ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:22.051919 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76429b-2727-456a-a263-0e5a182a27ca None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:22.052199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76429b-2727-456a-a263-0e5a182a27ca None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:22.052470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76429b-2727-456a-a263-0e5a182a27ca None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:22.053220 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76429b-2727-456a-a263-0e5a182a27ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:22.054170 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76429b-2727-456a-a263-0e5a182a27ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:22.055733 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76429b-2727-456a-a263-0e5a182a27ca None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:22.068790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 130/258] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:22.070943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76429b-2727-456a-a263-0e5a182a27ca None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:22.071550 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:22.084409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54056c4-8aeb-4db8-8f80-10ccd9e646cb None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:22.120200 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf56f3-12b1-4ca6-9d4c-68f7f0c89e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:22.121443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf56f3-12b1-4ca6-9d4c-68f7f0c89e37 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:22.121866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf56f3-12b1-4ca6-9d4c-68f7f0c89e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:22.122280 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf56f3-12b1-4ca6-9d4c-68f7f0c89e37 None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c/users/bb923bcb08e4407393b589b78d68a8d9/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:22.124444 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf56f3-12b1-4ca6-9d4c-68f7f0c89e37 None admin] RBAC: Authorizing `identity:create_grant(project_id=b83079b3240b49369bd78d73fd7c599c, user_id=bb923bcb08e4407393b589b78d68a8d9, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:22.126088 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf56f3-12b1-4ca6-9d4c-68f7f0c89e37 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:22.140359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 129/259] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:14:21 2022] PUT /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c/users/bb923bcb08e4407393b589b78d68a8d9/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:14:22.142446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf56f3-12b1-4ca6-9d4c-68f7f0c89e37 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:22.268355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf56f3-12b1-4ca6-9d4c-68f7f0c89e37 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:22.271780 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76429b-2727-456a-a263-0e5a182a27ca None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:22.313374 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4a68e-16a5-4b3e-a564-1c78f5c36a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:22.314498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4a68e-16a5-4b3e-a564-1c78f5c36a18 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:22.314920 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4a68e-16a5-4b3e-a564-1c78f5c36a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:22.315330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4a68e-16a5-4b3e-a564-1c78f5c36a18 None admin] PATH_INFO: `/v3/users/8533b60522fe42218218ad40f7c05675` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:22.316725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4a68e-16a5-4b3e-a564-1c78f5c36a18 None admin] RBAC: Authorizing `identity:get_user(user_id=8533b60522fe42218218ad40f7c05675)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:22.319405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4a68e-16a5-4b3e-a564-1c78f5c36a18 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:22.321989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 130/260] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:22 2022] GET /identity/v3/users/8533b60522fe42218218ad40f7c05675 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:22.330862 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4a68e-16a5-4b3e-a564-1c78f5c36a18 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:22.336679 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57f8f1-cdd6-4d5a-9333-25688937f54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:22.336912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57f8f1-cdd6-4d5a-9333-25688937f54e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:22.337193 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57f8f1-cdd6-4d5a-9333-25688937f54e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:22.339427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57f8f1-cdd6-4d5a-9333-25688937f54e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:22.356745 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57f8f1-cdd6-4d5a-9333-25688937f54e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:22.367480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-7e57f8f1-cdd6-4d5a-9333-25688937f54e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:22.367480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:22.367480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:22.367480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:22.367480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:22.367480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:22.367480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:22.367480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:22.367480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:22.367480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:22.367480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:22.367480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:22.367480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:22.367480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:22.367480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:22.367480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:22.368498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:22.368498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:22.368498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:22.368498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:22.368498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:22.368498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:22.368498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:22.368498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:22.368498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:22.368498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:22.368498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:22.368498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:22.368498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:22.368498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:22.368498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:22.368498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:22.369300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:22.369300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:22.369300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:22.369300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:22.369300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:22.369300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:22.369300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:22.369300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:22.369300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:22.369300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:22.369300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:22.369300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:22.375938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 131/261] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:14:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:22.378024 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:22.384885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57f8f1-cdd6-4d5a-9333-25688937f54e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:22.470223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:22.536190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57f8f1-cdd6-4d5a-9333-25688937f54e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:22.555147 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4a68e-16a5-4b3e-a564-1c78f5c36a18 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:22.603156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd094667-8a49-4fc1-8230-665a7b048a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:22.603834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd094667-8a49-4fc1-8230-665a7b048a1e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:22.604114 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd094667-8a49-4fc1-8230-665a7b048a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:22.604391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd094667-8a49-4fc1-8230-665a7b048a1e None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:22.605144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd094667-8a49-4fc1-8230-665a7b048a1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:22.605636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd094667-8a49-4fc1-8230-665a7b048a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:22.608772 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd094667-8a49-4fc1-8230-665a7b048a1e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:22.621076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e016447-5384-4abd-9f66-c04c66fef3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:22.621745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e016447-5384-4abd-9f66-c04c66fef3fd None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:22.622027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e016447-5384-4abd-9f66-c04c66fef3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:22.622301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e016447-5384-4abd-9f66-c04c66fef3fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:22.626770 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 132/262] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:14:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:22.633637 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd094667-8a49-4fc1-8230-665a7b048a1e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:22.767271 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e016447-5384-4abd-9f66-c04c66fef3fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:22.770176 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e016447-5384-4abd-9f66-c04c66fef3fd None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:22.777288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd094667-8a49-4fc1-8230-665a7b048a1e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:22.804568 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:22.814925 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:22.871406 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499c9d5-4c26-47cb-aee2-fd1d65e625e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:22.872302 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499c9d5-4c26-47cb-aee2-fd1d65e625e2 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:22.872585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499c9d5-4c26-47cb-aee2-fd1d65e625e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:22.872863 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499c9d5-4c26-47cb-aee2-fd1d65e625e2 None admin] PATH_INFO: `/v3/users/8533b60522fe42218218ad40f7c05675` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:22.878029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499c9d5-4c26-47cb-aee2-fd1d65e625e2 None admin] RBAC: Authorizing `identity:get_user(user_id=8533b60522fe42218218ad40f7c05675)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:22.879496 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499c9d5-4c26-47cb-aee2-fd1d65e625e2 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:22.881399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 133/263] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:22 2022] GET /identity/v3/users/8533b60522fe42218218ad40f7c05675 => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:22.887294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499c9d5-4c26-47cb-aee2-fd1d65e625e2 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:22.906805 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 131/264] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 18:14:22.911989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e016447-5384-4abd-9f66-c04c66fef3fd None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:23.014250 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e016447-5384-4abd-9f66-c04c66fef3fd None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:23.036145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:23.051537 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42349e-dd75-4210-b872-0a4e62d6bad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:23.052826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42349e-dd75-4210-b872-0a4e62d6bad9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:23.053141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42349e-dd75-4210-b872-0a4e62d6bad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:23.053557 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42349e-dd75-4210-b872-0a4e62d6bad9 None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:23.054909 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42349e-dd75-4210-b872-0a4e62d6bad9 None admin] RBAC: Authorizing `identity:get_project(project_id=b83079b3240b49369bd78d73fd7c599c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:23.056658 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42349e-dd75-4210-b872-0a4e62d6bad9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:23.058634 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 132/265] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:22 2022] GET /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:23.064186 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42349e-dd75-4210-b872-0a4e62d6bad9 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:23.172192 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42349e-dd75-4210-b872-0a4e62d6bad9 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:23.177189 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499c9d5-4c26-47cb-aee2-fd1d65e625e2 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:23.212447 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b7656-dcbb-4a3b-802f-38f7c4f53539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:23.213596 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b7656-dcbb-4a3b-802f-38f7c4f53539 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:23.217277 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b7656-dcbb-4a3b-802f-38f7c4f53539 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:23.217277 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b7656-dcbb-4a3b-802f-38f7c4f53539 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:23.217277 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b7656-dcbb-4a3b-802f-38f7c4f53539 None admin] RBAC: Adding query filter params (role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.project.id=b83079b3240b49369bd78d73fd7c599c, user.id=8533b60522fe42218218ad40f7c05675) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:23.217277 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b7656-dcbb-4a3b-802f-38f7c4f53539 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:23.218630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b7656-dcbb-4a3b-802f-38f7c4f53539 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:23.233216 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 133/266] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:23 2022] GET /identity/v3/role_assignments?user.id=8533b60522fe42218218ad40f7c05675&scope.project.id=b83079b3240b49369bd78d73fd7c599c&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:23.242143 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a838eb-2c82-48e0-b004-5ba96adfb709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:23.242842 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a838eb-2c82-48e0-b004-5ba96adfb709 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:23.243131 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a838eb-2c82-48e0-b004-5ba96adfb709 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:23.243445 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a838eb-2c82-48e0-b004-5ba96adfb709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:23.322149 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:23.340759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a838eb-2c82-48e0-b004-5ba96adfb709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:23.342352 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a838eb-2c82-48e0-b004-5ba96adfb709 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:23.453522 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 134/267] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:23.458778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b7656-dcbb-4a3b-802f-38f7c4f53539 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:23.540996 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:23.616736 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b7656-dcbb-4a3b-802f-38f7c4f53539 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:23.668518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516d2ef-54a3-411c-8c2e-0a6a8cc9978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:23.669526 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516d2ef-54a3-411c-8c2e-0a6a8cc9978d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:23.669849 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516d2ef-54a3-411c-8c2e-0a6a8cc9978d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:23.670159 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516d2ef-54a3-411c-8c2e-0a6a8cc9978d None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:23.671580 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516d2ef-54a3-411c-8c2e-0a6a8cc9978d None admin] RBAC: Authorizing `identity:get_project(project_id=b83079b3240b49369bd78d73fd7c599c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:23.673299 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516d2ef-54a3-411c-8c2e-0a6a8cc9978d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:23.675477 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 134/268] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:23 2022] GET /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:23.682006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a838eb-2c82-48e0-b004-5ba96adfb709 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:23.787211 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:23.806875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a838eb-2c82-48e0-b004-5ba96adfb709 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:23.843964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a486235-9d47-4fdb-a594-c05b58878914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:23.844624 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a486235-9d47-4fdb-a594-c05b58878914 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:23.844910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a486235-9d47-4fdb-a594-c05b58878914 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:23.845185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a486235-9d47-4fdb-a594-c05b58878914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:23.846054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a486235-9d47-4fdb-a594-c05b58878914 None admin] RBAC: Adding query filter params (role.id=fb45aabab51d4c698f2da1840ff5920d, scope.project.id=b83079b3240b49369bd78d73fd7c599c, user.id=8533b60522fe42218218ad40f7c05675) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:23.846371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a486235-9d47-4fdb-a594-c05b58878914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:23.847837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a486235-9d47-4fdb-a594-c05b58878914 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:23.854302 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 135/269] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:23 2022] GET /identity/v3/role_assignments?user.id=8533b60522fe42218218ad40f7c05675&scope.project.id=b83079b3240b49369bd78d73fd7c599c&role.id=fb45aabab51d4c698f2da1840ff5920d => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:24.063007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90e87-9543-4684-aa92-6bc2eab9aab6 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:24.063485 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90e87-9543-4684-aa92-6bc2eab9aab6 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:24.063485 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90e87-9543-4684-aa92-6bc2eab9aab6 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:24.065081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 135/270] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:24.075475 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbb746-9ffb-4d2e-9470-11c3eddc979d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:24.075766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbb746-9ffb-4d2e-9470-11c3eddc979d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:24.076049 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbb746-9ffb-4d2e-9470-11c3eddc979d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:24.095336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4edbb746-9ffb-4d2e-9470-11c3eddc979d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:24.096539 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4edbb746-9ffb-4d2e-9470-11c3eddc979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:24.170700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 136/271] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:24.193337 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af90e87-9543-4684-aa92-6bc2eab9aab6 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:24.314129 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af90e87-9543-4684-aa92-6bc2eab9aab6 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:24.334841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:24.356653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb636eb-ad17-440d-8694-17c6d300729b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:24.357526 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb636eb-ad17-440d-8694-17c6d300729b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:24.357811 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb636eb-ad17-440d-8694-17c6d300729b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:24.358089 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb636eb-ad17-440d-8694-17c6d300729b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:24.371271 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb636eb-ad17-440d-8694-17c6d300729b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:24.379103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-5bb636eb-ad17-440d-8694-17c6d300729b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:24.379103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:24.379103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:24.379103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:24.379103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:24.379103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:24.379103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:24.379103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:24.379103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:24.379103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:24.379103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:24.379103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:24.379103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:24.379103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:24.379103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:24.379103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:24.379950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:24.379950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:24.379950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:24.379950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:24.379950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:24.379950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:24.379950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:24.379950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:24.379950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:24.379950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:24.379950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:24.379950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:24.379950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:24.379950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:24.379950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:24.379950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:24.381052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:24.381052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:24.381052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:24.381052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:24.381052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:24.381052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:24.381052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:24.381052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:24.381052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:24.381052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:24.381052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:24.381052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:24.381052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 136/272] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:24.387072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbb746-9ffb-4d2e-9470-11c3eddc979d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:24.475495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:24.498665 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbb746-9ffb-4d2e-9470-11c3eddc979d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:24.514877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ff269-f2a2-4ce9-9e7c-94bc4b2cd261 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:24.515161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ff269-f2a2-4ce9-9e7c-94bc4b2cd261 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:24.515444 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ff269-f2a2-4ce9-9e7c-94bc4b2cd261 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:24.517138 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 137/273] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:24.522076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a8038-789a-43d0-96de-72e40ab3d10e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:24.522906 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a8038-789a-43d0-96de-72e40ab3d10e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:24.523185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a8038-789a-43d0-96de-72e40ab3d10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:24.539308 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10c03b-5dc8-4fda-b4a0-959b9c39376c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:24.539995 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10c03b-5dc8-4fda-b4a0-959b9c39376c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:24.540284 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10c03b-5dc8-4fda-b4a0-959b9c39376c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:24.540561 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10c03b-5dc8-4fda-b4a0-959b9c39376c None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:24.540977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2e6a8038-789a-43d0-96de-72e40ab3d10e None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:24.541348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10c03b-5dc8-4fda-b4a0-959b9c39376c None admin] RBAC: Adding query filter params (name=member) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:24.541662 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10c03b-5dc8-4fda-b4a0-959b9c39376c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:24.542205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2e6a8038-789a-43d0-96de-72e40ab3d10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:24.543050 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10c03b-5dc8-4fda-b4a0-959b9c39376c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:24.551771 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 137/274] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:24.557681 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10c03b-5dc8-4fda-b4a0-959b9c39376c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:24.615018 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 138/275] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:24.618641 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f3e4-d300-439e-b1e4-3f35a2a9574c None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:24.618928 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f3e4-d300-439e-b1e4-3f35a2a9574c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:24.619205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f3e4-d300-439e-b1e4-3f35a2a9574c None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:24.621424 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 139/276] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:24.627534 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080794cc-7b19-4b58-91e4-c7030d0a6f27 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:24.627745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080794cc-7b19-4b58-91e4-c7030d0a6f27 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:24.628124 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080794cc-7b19-4b58-91e4-c7030d0a6f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:24.646036 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-080794cc-7b19-4b58-91e4-c7030d0a6f27 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:24.647260 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-080794cc-7b19-4b58-91e4-c7030d0a6f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:24.674459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10c03b-5dc8-4fda-b4a0-959b9c39376c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:24.715655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a415ea8-b77e-4044-aff0-7560f2bf98c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:24.716802 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a415ea8-b77e-4044-aff0-7560f2bf98c1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:24.717224 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a415ea8-b77e-4044-aff0-7560f2bf98c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:24.717659 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a415ea8-b77e-4044-aff0-7560f2bf98c1 None admin] PATH_INFO: `/v3/users/444e63e870084c44abf38bf00d4d3bb9` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:24.722266 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 140/277] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:24.727684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080794cc-7b19-4b58-91e4-c7030d0a6f27 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:24.729734 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:24.733527 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a415ea8-b77e-4044-aff0-7560f2bf98c1 None admin] RBAC: Authorizing `identity:get_user(user_id=444e63e870084c44abf38bf00d4d3bb9)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:24.735200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a415ea8-b77e-4044-aff0-7560f2bf98c1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:24.737132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 138/278] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:24 2022] GET /identity/v3/users/444e63e870084c44abf38bf00d4d3bb9 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:24.744066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a415ea8-b77e-4044-aff0-7560f2bf98c1 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:24.770949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:24.850046 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080794cc-7b19-4b58-91e4-c7030d0a6f27 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:24.851427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a415ea8-b77e-4044-aff0-7560f2bf98c1 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:24.884072 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e65fce-b3a5-4ecd-801b-c096d6d3cc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:24.884866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e65fce-b3a5-4ecd-801b-c096d6d3cc74 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:24.885146 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e65fce-b3a5-4ecd-801b-c096d6d3cc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:24.885450 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e65fce-b3a5-4ecd-801b-c096d6d3cc74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:24.887240 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e73d6d-4ad5-45b7-a8b4-e3a4d2e249e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:24.888172 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e73d6d-4ad5-45b7-a8b4-e3a4d2e249e6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:24.888465 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e73d6d-4ad5-45b7-a8b4-e3a4d2e249e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:24.888745 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e73d6d-4ad5-45b7-a8b4-e3a4d2e249e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:24.889619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e73d6d-4ad5-45b7-a8b4-e3a4d2e249e6 None admin] RBAC: Adding query filter params (role.id=7ad29af380bd4e608c78235cbf9741b6, user.id=444e63e870084c44abf38bf00d4d3bb9, scope.system=all) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:24.889936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e73d6d-4ad5-45b7-a8b4-e3a4d2e249e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:24.891396 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e73d6d-4ad5-45b7-a8b4-e3a4d2e249e6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:24.895408 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e65fce-b3a5-4ecd-801b-c096d6d3cc74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:24.896524 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 139/279] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Jul 12 18:14:24 2022] GET /identity/v3/role_assignments?user.id=444e63e870084c44abf38bf00d4d3bb9&scope.system=all&role.id=7ad29af380bd4e608c78235cbf9741b6 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:24.897375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e73d6d-4ad5-45b7-a8b4-e3a4d2e249e6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:24.903255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-30e65fce-b3a5-4ecd-801b-c096d6d3cc74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:14:24.903255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:24.903255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:24.903255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:24.903255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:24.903255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:24.903255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:24.903255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:24.903255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:24.903255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:24.903255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:24.903255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:24.903255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:24.903255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:24.903255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:24.903255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:24.904440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:24.904440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:24.904440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:24.904440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:24.904440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:24.904440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:24.904440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:24.904440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:24.904440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:24.904440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:24.904440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:24.904440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:24.904440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:24.904440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:24.904440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:24.904440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:24.905511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:24.905511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:24.905511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:24.905511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:24.905511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:24.905511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:24.905511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:24.905511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:24.905511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:24.905511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:24.905511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:14:24.905511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:24.905511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 141/280] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:24.907352 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5ddf1-615d-4302-92a6-235dfecea269 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:24.907352 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5ddf1-615d-4302-92a6-235dfecea269 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:24.907352 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5ddf1-615d-4302-92a6-235dfecea269 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:24.907752 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 142/281] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:24.910758 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5ddf1-615d-4302-92a6-235dfecea269 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:24.983319 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:25.028882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e73d6d-4ad5-45b7-a8b4-e3a4d2e249e6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:25.030397 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:25.037544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5ddf1-615d-4302-92a6-235dfecea269 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:25.070881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c48b3-793b-48c3-b18f-0b1c61b86948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:25.072044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c48b3-793b-48c3-b18f-0b1c61b86948 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:25.072397 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c48b3-793b-48c3-b18f-0b1c61b86948 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:25.072680 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c48b3-793b-48c3-b18f-0b1c61b86948 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:25.074375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c48b3-793b-48c3-b18f-0b1c61b86948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:25.076328 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c48b3-793b-48c3-b18f-0b1c61b86948 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:25.078634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 140/282] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:25.080083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a6854-7e2d-4944-ba8b-d94794b5fb6f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:25.080370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a6854-7e2d-4944-ba8b-d94794b5fb6f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:25.080647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a6854-7e2d-4944-ba8b-d94794b5fb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:25.088190 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd84b6-0a79-4e84-8d5b-52a1c00af43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:25.089482 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd84b6-0a79-4e84-8d5b-52a1c00af43f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:25.089985 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd84b6-0a79-4e84-8d5b-52a1c00af43f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:25.090589 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd84b6-0a79-4e84-8d5b-52a1c00af43f None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:25.091567 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd84b6-0a79-4e84-8d5b-52a1c00af43f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:25.092203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd84b6-0a79-4e84-8d5b-52a1c00af43f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:25.093755 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd84b6-0a79-4e84-8d5b-52a1c00af43f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:25.097222 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-341a6854-7e2d-4944-ba8b-d94794b5fb6f None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:25.098439 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-341a6854-7e2d-4944-ba8b-d94794b5fb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:25.108011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 143/283] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:25.108668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd84b6-0a79-4e84-8d5b-52a1c00af43f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:25.167308 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 141/284] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:25.178137 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a6854-7e2d-4944-ba8b-d94794b5fb6f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:25.220639 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd84b6-0a79-4e84-8d5b-52a1c00af43f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:25.255612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719b55a-af90-483c-8bbc-509eef7dbbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:25.256282 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719b55a-af90-483c-8bbc-509eef7dbbc5 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:25.256563 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719b55a-af90-483c-8bbc-509eef7dbbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:25.256885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:25.257011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719b55a-af90-483c-8bbc-509eef7dbbc5 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:25.257637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719b55a-af90-483c-8bbc-509eef7dbbc5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:25.259142 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719b55a-af90-483c-8bbc-509eef7dbbc5 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:25.281414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 144/285] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Jul 12 18:14:25 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:14:25.282681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719b55a-af90-483c-8bbc-509eef7dbbc5 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:25.303041 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:25.318899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a6854-7e2d-4944-ba8b-d94794b5fb6f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:25.361332 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df0759-fb97-4de1-a01c-db71cb3c7370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:25.362304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df0759-fb97-4de1-a01c-db71cb3c7370 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:25.362614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df0759-fb97-4de1-a01c-db71cb3c7370 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:25.362887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df0759-fb97-4de1-a01c-db71cb3c7370 None admin] PATH_INFO: `/v3/users/dc736c3d12de4be2b05abdbb106b3a4f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:25.364199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df0759-fb97-4de1-a01c-db71cb3c7370 None admin] RBAC: Authorizing `identity:get_user(user_id=dc736c3d12de4be2b05abdbb106b3a4f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:25.366563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df0759-fb97-4de1-a01c-db71cb3c7370 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:25.372795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 142/286] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:25 2022] GET /identity/v3/users/dc736c3d12de4be2b05abdbb106b3a4f => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:25.374375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df0759-fb97-4de1-a01c-db71cb3c7370 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:25.424881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719b55a-af90-483c-8bbc-509eef7dbbc5 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:25.467510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999943c-6502-45c0-a629-76080df5148e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:25.468320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999943c-6502-45c0-a629-76080df5148e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:25.469196 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999943c-6502-45c0-a629-76080df5148e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:25.469531 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999943c-6502-45c0-a629-76080df5148e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:25.481115 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999943c-6502-45c0-a629-76080df5148e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:25.489684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-2999943c-6502-45c0-a629-76080df5148e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:25.489684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:25.489684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:25.489684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:25.489684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:25.489684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:25.489684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:25.489684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:25.489684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:25.489684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:25.489684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:25.489684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:25.489684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:25.489684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:25.489684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:25.489684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:25.490578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:25.490578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:25.490578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:25.490578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:25.490578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:25.490578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:25.490578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:25.490578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:25.490578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:25.490578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:25.490578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:25.490578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:25.490578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:25.490578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:25.490578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:25.490578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:25.492048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:25.492048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:25.492048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:25.492048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:25.492048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:25.492048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:25.492048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:25.492048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:25.492048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:25.492048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:25.492048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:25.492048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:25.492048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 145/287] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:25.497951 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999943c-6502-45c0-a629-76080df5148e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:25.502287 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df0759-fb97-4de1-a01c-db71cb3c7370 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:25.539244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:25.553525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375d040-55e6-4bce-a20a-e2962739e466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:25.554863 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375d040-55e6-4bce-a20a-e2962739e466 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:25.555883 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375d040-55e6-4bce-a20a-e2962739e466 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:25.556162 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375d040-55e6-4bce-a20a-e2962739e466 None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:25.557761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375d040-55e6-4bce-a20a-e2962739e466 None admin] RBAC: Authorizing `identity:get_project(project_id=b83079b3240b49369bd78d73fd7c599c)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:25.559208 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375d040-55e6-4bce-a20a-e2962739e466 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:25.561447 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 143/288] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:25 2022] GET /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:25.568864 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375d040-55e6-4bce-a20a-e2962739e466 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:25.590301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:25.635203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999943c-6502-45c0-a629-76080df5148e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:25.674441 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd8962-28a3-4c9e-bac0-c1e7b24ae145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:25.675571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd8962-28a3-4c9e-bac0-c1e7b24ae145 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:25.676014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd8962-28a3-4c9e-bac0-c1e7b24ae145 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:25.676549 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd8962-28a3-4c9e-bac0-c1e7b24ae145 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:25.677476 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd8962-28a3-4c9e-bac0-c1e7b24ae145 None admin] RBAC: Adding query filter params (name=member) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:25.677927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd8962-28a3-4c9e-bac0-c1e7b24ae145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:25.680072 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd8962-28a3-4c9e-bac0-c1e7b24ae145 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:25.693409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 146/289] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:25.700115 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd8962-28a3-4c9e-bac0-c1e7b24ae145 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:25.718565 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375d040-55e6-4bce-a20a-e2962739e466 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:25.760229 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1045e-a6d0-45f1-af8b-b3b71982cdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:25.762036 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1045e-a6d0-45f1-af8b-b3b71982cdb3 None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:25.762438 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1045e-a6d0-45f1-af8b-b3b71982cdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:25.762808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1045e-a6d0-45f1-af8b-b3b71982cdb3 None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c/users/dc736c3d12de4be2b05abdbb106b3a4f/roles/aec350b8d47248f1a54daf9304cdc462` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:25.765016 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1045e-a6d0-45f1-af8b-b3b71982cdb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b83079b3240b49369bd78d73fd7c599c, user_id=dc736c3d12de4be2b05abdbb106b3a4f, role_id=aec350b8d47248f1a54daf9304cdc462)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:25.766698 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1045e-a6d0-45f1-af8b-b3b71982cdb3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:25.784675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 144/290] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:14:25 2022] PUT /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c/users/dc736c3d12de4be2b05abdbb106b3a4f/roles/aec350b8d47248f1a54daf9304cdc462 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:14:25.859790 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd8962-28a3-4c9e-bac0-c1e7b24ae145 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:25.896788 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b1a82-b143-4c46-ae8e-f66ea1edd960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:25.898527 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b1a82-b143-4c46-ae8e-f66ea1edd960 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:25.898965 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b1a82-b143-4c46-ae8e-f66ea1edd960 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:25.899382 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b1a82-b143-4c46-ae8e-f66ea1edd960 None admin] PATH_INFO: `/v3/users/bb923bcb08e4407393b589b78d68a8d9` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:25.900928 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b1a82-b143-4c46-ae8e-f66ea1edd960 None admin] RBAC: Authorizing `identity:get_user(user_id=bb923bcb08e4407393b589b78d68a8d9)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:25.902646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b1a82-b143-4c46-ae8e-f66ea1edd960 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:25.904500 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 147/291] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:25 2022] GET /identity/v3/users/bb923bcb08e4407393b589b78d68a8d9 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:25.910555 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1045e-a6d0-45f1-af8b-b3b71982cdb3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:25.996452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:26.046449 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1045e-a6d0-45f1-af8b-b3b71982cdb3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:26.081872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee083845-9ab9-49bf-90a4-d380483cec8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:26.082538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee083845-9ab9-49bf-90a4-d380483cec8f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:26.082864 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee083845-9ab9-49bf-90a4-d380483cec8f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:26.083145 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee083845-9ab9-49bf-90a4-d380483cec8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:26.154732 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee083845-9ab9-49bf-90a4-d380483cec8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:26.156295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee083845-9ab9-49bf-90a4-d380483cec8f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:26.213103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:26.258711 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 145/292] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:26.266325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b1a82-b143-4c46-ae8e-f66ea1edd960 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:26.275323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:26.425363 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b1a82-b143-4c46-ae8e-f66ea1edd960 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:26.467547 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476daa12-3d58-4b66-b834-9815e85be7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:26.468752 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476daa12-3d58-4b66-b834-9815e85be7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:26.469234 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476daa12-3d58-4b66-b834-9815e85be7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:26.469734 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476daa12-3d58-4b66-b834-9815e85be7d3 None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:26.471130 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476daa12-3d58-4b66-b834-9815e85be7d3 None admin] RBAC: Authorizing `identity:get_project(project_id=b83079b3240b49369bd78d73fd7c599c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:26.472793 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476daa12-3d58-4b66-b834-9815e85be7d3 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:26.474718 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 148/293] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:26 2022] GET /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:26.481090 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee083845-9ab9-49bf-90a4-d380483cec8f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:26.626886 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee083845-9ab9-49bf-90a4-d380483cec8f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:26.661783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efe9e9-f986-4900-876f-7c7a7fd9aa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:26.662436 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efe9e9-f986-4900-876f-7c7a7fd9aa92 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:26.662715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efe9e9-f986-4900-876f-7c7a7fd9aa92 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:26.663616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efe9e9-f986-4900-876f-7c7a7fd9aa92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:26.664446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efe9e9-f986-4900-876f-7c7a7fd9aa92 None admin] RBAC: Adding query filter params (role.id=7ad29af380bd4e608c78235cbf9741b6, scope.project.id=b83079b3240b49369bd78d73fd7c599c, user.id=bb923bcb08e4407393b589b78d68a8d9) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:26.664753 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efe9e9-f986-4900-876f-7c7a7fd9aa92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:26.666218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efe9e9-f986-4900-876f-7c7a7fd9aa92 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:26.672594 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 146/294] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:26 2022] GET /identity/v3/role_assignments?user.id=bb923bcb08e4407393b589b78d68a8d9&scope.project.id=b83079b3240b49369bd78d73fd7c599c&role.id=7ad29af380bd4e608c78235cbf9741b6 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:27.208205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534a0da-573b-4e1f-8c34-7a3f45804fb0 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:27.208490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534a0da-573b-4e1f-8c34-7a3f45804fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:27.209104 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534a0da-573b-4e1f-8c34-7a3f45804fb0 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:27.211964 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 149/295] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:27.219466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72436849-027c-4760-b58d-90bfe034763a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:27.220107 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72436849-027c-4760-b58d-90bfe034763a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:27.220655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72436849-027c-4760-b58d-90bfe034763a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:27.239442 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-72436849-027c-4760-b58d-90bfe034763a None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:27.241094 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-72436849-027c-4760-b58d-90bfe034763a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:27.257664 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:27.324070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 147/296] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:27.349673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534a0da-573b-4e1f-8c34-7a3f45804fb0 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:27.427832 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:27.461633 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534a0da-573b-4e1f-8c34-7a3f45804fb0 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:27.496560 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231cce4-0324-4d0f-b23b-b118d779a360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:27.497376 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231cce4-0324-4d0f-b23b-b118d779a360 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:27.497658 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231cce4-0324-4d0f-b23b-b118d779a360 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:27.497929 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231cce4-0324-4d0f-b23b-b118d779a360 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:27.508396 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231cce4-0324-4d0f-b23b-b118d779a360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:27.515961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-3231cce4-0324-4d0f-b23b-b118d779a360 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:27.515961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:27.515961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:27.515961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:27.515961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:27.515961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:27.515961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:27.515961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:27.515961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:27.515961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:27.515961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:27.515961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:27.515961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:27.515961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:27.515961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:27.515961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:27.516822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:27.516822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:27.516822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:27.516822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:27.516822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:27.516822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:27.516822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:27.516822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:27.516822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:27.516822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:27.516822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:27.516822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:27.516822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:27.516822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:27.516822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:27.516822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:27.517913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:27.517913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:27.517913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:27.517913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:27.517913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:27.517913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:27.517913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:27.517913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:27.517913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:27.517913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:27.517913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:27.517913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:27.517913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 150/297] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:27.525406 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72436849-027c-4760-b58d-90bfe034763a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:27.633585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72436849-027c-4760-b58d-90bfe034763a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:27.669468 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2bd59-2f68-4b20-a615-44ed5aa1e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:27.670201 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2bd59-2f68-4b20-a615-44ed5aa1e556 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:27.670486 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2bd59-2f68-4b20-a615-44ed5aa1e556 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:27.670762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2bd59-2f68-4b20-a615-44ed5aa1e556 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:27.671565 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2bd59-2f68-4b20-a615-44ed5aa1e556 None admin] RBAC: Adding query filter params (name=member) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:27.671879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2bd59-2f68-4b20-a615-44ed5aa1e556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:27.673289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2bd59-2f68-4b20-a615-44ed5aa1e556 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:27.681813 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 148/298] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:27.687266 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231cce4-0324-4d0f-b23b-b118d779a360 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:27.732877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89717a5a-a0c6-467b-9456-d6264af96771 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:27.733182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89717a5a-a0c6-467b-9456-d6264af96771 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:27.733384 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89717a5a-a0c6-467b-9456-d6264af96771 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:27.734887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 149/299] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:27.739744 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe99b9b-99e6-432a-9d46-4543a85261f1 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:27.740032 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe99b9b-99e6-432a-9d46-4543a85261f1 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:27.740310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe99b9b-99e6-432a-9d46-4543a85261f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:27.762835 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5fe99b9b-99e6-432a-9d46-4543a85261f1 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:27.764333 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5fe99b9b-99e6-432a-9d46-4543a85261f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:27.813668 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:27.816034 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231cce4-0324-4d0f-b23b-b118d779a360 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:27.861641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 150/300] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:27.863109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:27.869904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c50570-9ad4-40d6-bb21-cd227315a8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:27.870780 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c50570-9ad4-40d6-bb21-cd227315a8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:27.871069 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c50570-9ad4-40d6-bb21-cd227315a8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:27.871345 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c50570-9ad4-40d6-bb21-cd227315a8e2 None admin] PATH_INFO: `/v3/users/444e63e870084c44abf38bf00d4d3bb9` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:27.872557 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c50570-9ad4-40d6-bb21-cd227315a8e2 None admin] RBAC: Authorizing `identity:get_user(user_id=444e63e870084c44abf38bf00d4d3bb9)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:27.874055 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c50570-9ad4-40d6-bb21-cd227315a8e2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:27.875825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 151/301] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:27 2022] GET /identity/v3/users/444e63e870084c44abf38bf00d4d3bb9 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:27.881310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe99b9b-99e6-432a-9d46-4543a85261f1 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:27.884883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c50570-9ad4-40d6-bb21-cd227315a8e2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:27.994713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe99b9b-99e6-432a-9d46-4543a85261f1 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:28.019076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c50570-9ad4-40d6-bb21-cd227315a8e2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:28.031284 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dba87-3e0b-496c-849b-f572a491cf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:28.032180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dba87-3e0b-496c-849b-f572a491cf50 None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:28.032442 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dba87-3e0b-496c-849b-f572a491cf50 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:28.032726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dba87-3e0b-496c-849b-f572a491cf50 None admin] PATH_INFO: `/v3/system/users/444e63e870084c44abf38bf00d4d3bb9/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:28.034258 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38dba87-3e0b-496c-849b-f572a491cf50 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=444e63e870084c44abf38bf00d4d3bb9, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:28.035694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38dba87-3e0b-496c-849b-f572a491cf50 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:28.046061 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 151/302] 10.222.0.57 () {58 vars in 1334 bytes} [Tue Jul 12 18:14:27 2022] PUT /identity/v3/system/users/444e63e870084c44abf38bf00d4d3bb9/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:14:28.047387 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4761a-ecf0-486e-8cd2-cbfed3227133 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:28.047676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4761a-ecf0-486e-8cd2-cbfed3227133 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:28.047953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4761a-ecf0-486e-8cd2-cbfed3227133 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:28.054222 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 152/303] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:28.056129 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462892d2-0458-4e0d-b041-ea1a32cf81e3 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:28.056610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462892d2-0458-4e0d-b041-ea1a32cf81e3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:28.056849 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462892d2-0458-4e0d-b041-ea1a32cf81e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:28.068169 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80742c-493b-440e-821c-f67635af66ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:28.069538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80742c-493b-440e-821c-f67635af66ee None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:28.070057 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80742c-493b-440e-821c-f67635af66ee None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:28.070558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80742c-493b-440e-821c-f67635af66ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:28.070971 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:28.078322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-462892d2-0458-4e0d-b041-ea1a32cf81e3 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:28.079739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-462892d2-0458-4e0d-b041-ea1a32cf81e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:28.087788 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80742c-493b-440e-821c-f67635af66ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:28.098860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-0c80742c-493b-440e-821c-f67635af66ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:14:28.098860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:28.098860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:28.098860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:28.098860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:28.098860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:28.098860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:28.098860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:28.098860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:28.098860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:28.098860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:28.098860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:28.098860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:28.098860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:28.098860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:28.098860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:28.100122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:28.100122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:28.100122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:28.100122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:28.100122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:28.100122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:28.100122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:28.100122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:28.100122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:28.100122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:28.100122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:28.100122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:28.100122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:28.100122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:28.100122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:28.100122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:28.101863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:28.101863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:28.101863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:28.101863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:28.101863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:28.101863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:28.101863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:28.101863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:28.101863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:28.101863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:28.101863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:14:28.101863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:28.104978 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 152/304] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:28.110700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80742c-493b-440e-821c-f67635af66ee None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:28.181299 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 153/305] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:28.200842 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:28.207541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462892d2-0458-4e0d-b041-ea1a32cf81e3 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:28.250600 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80742c-493b-440e-821c-f67635af66ee None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:28.299908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740b206-f2e7-450b-b289-f843c8615aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:28.300928 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740b206-f2e7-450b-b289-f843c8615aaa None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:28.301228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740b206-f2e7-450b-b289-f843c8615aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:28.301541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740b206-f2e7-450b-b289-f843c8615aaa None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:28.302624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740b206-f2e7-450b-b289-f843c8615aaa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:28.302946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740b206-f2e7-450b-b289-f843c8615aaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:28.304667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740b206-f2e7-450b-b289-f843c8615aaa None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:28.317308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 153/306] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:28.322064 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740b206-f2e7-450b-b289-f843c8615aaa None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:28.332835 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462892d2-0458-4e0d-b041-ea1a32cf81e3 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:28.369148 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35792d4e-ae5a-4179-a1ef-72f6af7ee79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:28.369980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35792d4e-ae5a-4179-a1ef-72f6af7ee79c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:28.370266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35792d4e-ae5a-4179-a1ef-72f6af7ee79c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:28.370821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35792d4e-ae5a-4179-a1ef-72f6af7ee79c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:28.371719 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35792d4e-ae5a-4179-a1ef-72f6af7ee79c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:28.373173 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35792d4e-ae5a-4179-a1ef-72f6af7ee79c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:28.374833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 154/307] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:28.379289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be8087-712d-4eb5-b731-f097d3b20290 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:28.379289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be8087-712d-4eb5-b731-f097d3b20290 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:28.379289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be8087-712d-4eb5-b731-f097d3b20290 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:28.379289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 155/308] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:28.382128 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be8087-712d-4eb5-b731-f097d3b20290 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:28.385924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:28.442954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740b206-f2e7-450b-b289-f843c8615aaa None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:28.467030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:28.479603 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c0783-6fce-4de8-adcc-0965bf58f20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:28.480478 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c0783-6fce-4de8-adcc-0965bf58f20b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:28.480759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c0783-6fce-4de8-adcc-0965bf58f20b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:28.481040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c0783-6fce-4de8-adcc-0965bf58f20b None admin] PATH_INFO: `/v3/users/e1ac7266459b49b6bb64d282dbefa861` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:28.496374 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c0783-6fce-4de8-adcc-0965bf58f20b None admin] RBAC: Authorizing `identity:get_user(user_id=e1ac7266459b49b6bb64d282dbefa861)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:28.497957 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c0783-6fce-4de8-adcc-0965bf58f20b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:28.498484 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be8087-712d-4eb5-b731-f097d3b20290 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:28.504379 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 154/309] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:28 2022] GET /identity/v3/users/e1ac7266459b49b6bb64d282dbefa861 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:28.504379 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d3103-9f96-461c-b0a6-6b3f22a19b03 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:28.504379 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d3103-9f96-461c-b0a6-6b3f22a19b03 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:28.504379 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d3103-9f96-461c-b0a6-6b3f22a19b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:28.518484 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ba0d3103-9f96-461c-b0a6-6b3f22a19b03 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:28.519675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ba0d3103-9f96-461c-b0a6-6b3f22a19b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:28.544186 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c05ae0-d1de-4e93-96b1-22ddecdaed5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:28.545191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c05ae0-d1de-4e93-96b1-22ddecdaed5c None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:28.545515 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c05ae0-d1de-4e93-96b1-22ddecdaed5c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:28.545805 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c05ae0-d1de-4e93-96b1-22ddecdaed5c None admin] PATH_INFO: `/v3/groups` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:28.546477 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c05ae0-d1de-4e93-96b1-22ddecdaed5c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:28.547916 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c05ae0-d1de-4e93-96b1-22ddecdaed5c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:28.563732 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 156/310] 10.222.0.57 () {60 vars in 1134 bytes} [Tue Jul 12 18:14:28 2022] POST /identity/v3/groups => generated 229 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:14:28.564552 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c05ae0-d1de-4e93-96b1-22ddecdaed5c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:28.622845 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 155/311] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:28.648117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d3103-9f96-461c-b0a6-6b3f22a19b03 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:28.650353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:28.694621 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c05ae0-d1de-4e93-96b1-22ddecdaed5c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:28.734405 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25115dc7-2680-47d7-b087-d5bb834d8d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:28.735410 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25115dc7-2680-47d7-b087-d5bb834d8d4a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:28.735893 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25115dc7-2680-47d7-b087-d5bb834d8d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:28.736343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25115dc7-2680-47d7-b087-d5bb834d8d4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:28.737182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25115dc7-2680-47d7-b087-d5bb834d8d4a None admin] RBAC: Adding query filter params (role.id=aec350b8d47248f1a54daf9304cdc462, user.id=e1ac7266459b49b6bb64d282dbefa861, scope.system=all) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:28.737515 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25115dc7-2680-47d7-b087-d5bb834d8d4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:28.738991 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25115dc7-2680-47d7-b087-d5bb834d8d4a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:28.744886 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 157/312] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Jul 12 18:14:28 2022] GET /identity/v3/role_assignments?user.id=e1ac7266459b49b6bb64d282dbefa861&scope.system=all&role.id=aec350b8d47248f1a54daf9304cdc462 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:28.764105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d3103-9f96-461c-b0a6-6b3f22a19b03 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:28.777889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:28.808238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41e1db-0098-4d95-bcb7-67d91c3339c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:28.809066 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41e1db-0098-4d95-bcb7-67d91c3339c4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:28.809681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41e1db-0098-4d95-bcb7-67d91c3339c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:28.809963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41e1db-0098-4d95-bcb7-67d91c3339c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:28.823126 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41e1db-0098-4d95-bcb7-67d91c3339c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:28.831473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-0d41e1db-0098-4d95-bcb7-67d91c3339c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:14:28.831473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:28.831473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:28.831473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:28.831473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:28.831473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:28.831473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:28.831473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:28.831473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:28.831473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:28.831473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:28.831473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:28.831473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:28.831473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:28.831473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:28.831473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:28.832418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:28.832418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:28.832418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:28.832418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:28.832418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:28.832418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:28.832418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:28.832418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:28.832418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:28.832418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:28.832418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:28.832418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:28.832418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:28.832418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:28.832418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:28.832418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:28.833188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:28.833188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:28.833188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:28.833188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:28.833188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:28.833188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:28.833188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:28.833188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:28.833188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:28.833188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:28.833188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:14:28.833188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:28.833188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 156/313] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:28.839236 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25115dc7-2680-47d7-b087-d5bb834d8d4a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:28.948438 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25115dc7-2680-47d7-b087-d5bb834d8d4a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:28.975574 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:28.984582 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd931b1-318e-4db0-b9eb-b7ed49e48090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:28.985275 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd931b1-318e-4db0-b9eb-b7ed49e48090 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:28.985564 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd931b1-318e-4db0-b9eb-b7ed49e48090 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:28.985844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd931b1-318e-4db0-b9eb-b7ed49e48090 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:28.986599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd931b1-318e-4db0-b9eb-b7ed49e48090 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:28.986907 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd931b1-318e-4db0-b9eb-b7ed49e48090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:28.988304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd931b1-318e-4db0-b9eb-b7ed49e48090 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:29.001384 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 158/314] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:29.003481 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41e1db-0098-4d95-bcb7-67d91c3339c4 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:29.110827 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41e1db-0098-4d95-bcb7-67d91c3339c4 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:29.145987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4a454-e162-45f9-84b4-560615a1baf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:29.146915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4a454-e162-45f9-84b4-560615a1baf2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:29.147238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4a454-e162-45f9-84b4-560615a1baf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:29.147517 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4a454-e162-45f9-84b4-560615a1baf2 None admin] PATH_INFO: `/v3/users/dc736c3d12de4be2b05abdbb106b3a4f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:29.148783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4a454-e162-45f9-84b4-560615a1baf2 None admin] RBAC: Authorizing `identity:get_user(user_id=dc736c3d12de4be2b05abdbb106b3a4f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:29.150289 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4a454-e162-45f9-84b4-560615a1baf2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:29.152213 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 157/315] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:29 2022] GET /identity/v3/users/dc736c3d12de4be2b05abdbb106b3a4f => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:29.157572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd931b1-318e-4db0-b9eb-b7ed49e48090 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:29.272692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd931b1-318e-4db0-b9eb-b7ed49e48090 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:29.309417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81b21e-74b0-4379-ae83-3dbb2f2ddbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:29.310066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81b21e-74b0-4379-ae83-3dbb2f2ddbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:29.310350 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81b21e-74b0-4379-ae83-3dbb2f2ddbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:29.310626 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81b21e-74b0-4379-ae83-3dbb2f2ddbe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:29.372080 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:29.384273 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81b21e-74b0-4379-ae83-3dbb2f2ddbe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:29.385787 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81b21e-74b0-4379-ae83-3dbb2f2ddbe9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:29.494179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 159/316] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:29.499974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4a454-e162-45f9-84b4-560615a1baf2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:29.541617 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:29.605452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4a454-e162-45f9-84b4-560615a1baf2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:29.639413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7127c-bb2b-4c16-8d88-1231d399c790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:29.640277 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7127c-bb2b-4c16-8d88-1231d399c790 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:29.640560 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7127c-bb2b-4c16-8d88-1231d399c790 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:29.640840 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7127c-bb2b-4c16-8d88-1231d399c790 None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:29.642061 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7127c-bb2b-4c16-8d88-1231d399c790 None admin] RBAC: Authorizing `identity:get_project(project_id=b83079b3240b49369bd78d73fd7c599c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:29.643514 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7127c-bb2b-4c16-8d88-1231d399c790 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:29.649366 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 158/317] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:29 2022] GET /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:29.652014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81b21e-74b0-4379-ae83-3dbb2f2ddbe9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:29.749663 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:29.762470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81b21e-74b0-4379-ae83-3dbb2f2ddbe9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:29.803638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040b708-759c-4a0d-8678-d425dfccbdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:29.804346 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040b708-759c-4a0d-8678-d425dfccbdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:29.804645 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040b708-759c-4a0d-8678-d425dfccbdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:29.804948 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040b708-759c-4a0d-8678-d425dfccbdc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:29.805896 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040b708-759c-4a0d-8678-d425dfccbdc8 None admin] RBAC: Adding query filter params (role.id=aec350b8d47248f1a54daf9304cdc462, scope.project.id=b83079b3240b49369bd78d73fd7c599c, user.id=dc736c3d12de4be2b05abdbb106b3a4f) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:29.806233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040b708-759c-4a0d-8678-d425dfccbdc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:29.807799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040b708-759c-4a0d-8678-d425dfccbdc8 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:29.815329 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 160/318] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:29 2022] GET /identity/v3/role_assignments?user.id=dc736c3d12de4be2b05abdbb106b3a4f&scope.project.id=b83079b3240b49369bd78d73fd7c599c&role.id=aec350b8d47248f1a54daf9304cdc462 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:30.231560 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b67719-2a2f-475b-af70-d105849d06a9 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:30.231932 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b67719-2a2f-475b-af70-d105849d06a9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:30.232117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b67719-2a2f-475b-af70-d105849d06a9 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:30.233664 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 159/319] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:30.238502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28569d3-76ea-46f8-812a-19ddd7106603 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:30.238798 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28569d3-76ea-46f8-812a-19ddd7106603 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:30.239079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28569d3-76ea-46f8-812a-19ddd7106603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:30.256240 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a28569d3-76ea-46f8-812a-19ddd7106603 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:30.257569 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a28569d3-76ea-46f8-812a-19ddd7106603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:30.325505 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 161/320] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:30.348394 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b67719-2a2f-475b-af70-d105849d06a9 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:30.448005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b67719-2a2f-475b-af70-d105849d06a9 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:30.455120 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:30.482435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058c320-8030-4ad2-9f8d-aeb95c275b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:30.483155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058c320-8030-4ad2-9f8d-aeb95c275b24 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:30.483440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058c320-8030-4ad2-9f8d-aeb95c275b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:30.483715 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058c320-8030-4ad2-9f8d-aeb95c275b24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:30.494443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058c320-8030-4ad2-9f8d-aeb95c275b24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:30.502160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-b058c320-8030-4ad2-9f8d-aeb95c275b24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:30.502160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:30.502160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:30.502160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:30.502160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:30.502160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:30.502160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:30.502160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:30.502160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:30.502160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:30.502160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:30.502160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:30.502160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:30.502160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:30.502160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:30.502160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:30.503490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:30.503490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:30.503490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:30.503490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:30.503490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:30.503490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:30.503490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:30.503490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:30.503490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:30.503490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:30.503490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:30.503490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:30.503490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:30.503490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:30.503490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:30.503490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:30.504278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:30.504278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:30.504278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:30.504278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:30.504278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:30.504278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:30.504278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:30.504278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:30.504278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:30.504278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:30.504278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:30.504278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:30.504278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 160/321] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:30.510854 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28569d3-76ea-46f8-812a-19ddd7106603 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:30.602978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:30.622266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28569d3-76ea-46f8-812a-19ddd7106603 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:30.659594 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafc978-63e5-405e-af7a-32684c24fa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:30.660360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafc978-63e5-405e-af7a-32684c24fa18 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:30.660543 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafc978-63e5-405e-af7a-32684c24fa18 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:30.661225 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafc978-63e5-405e-af7a-32684c24fa18 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:30.662005 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafc978-63e5-405e-af7a-32684c24fa18 None admin] RBAC: Adding query filter params (name=member) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:30.662315 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafc978-63e5-405e-af7a-32684c24fa18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:30.663728 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafc978-63e5-405e-af7a-32684c24fa18 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:30.676756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 162/322] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:30.677954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058c320-8030-4ad2-9f8d-aeb95c275b24 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:30.736239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc05263-3d66-419b-82fa-44d28c666364 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:30.736540 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc05263-3d66-419b-82fa-44d28c666364 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:30.736737 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc05263-3d66-419b-82fa-44d28c666364 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:30.738282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 163/323] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:30.743341 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52b744-4e5f-4ec1-8276-279c0923e2f2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:30.743634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52b744-4e5f-4ec1-8276-279c0923e2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:30.743919 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52b744-4e5f-4ec1-8276-279c0923e2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:30.762560 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4c52b744-4e5f-4ec1-8276-279c0923e2f2 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:30.763753 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4c52b744-4e5f-4ec1-8276-279c0923e2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:30.788044 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058c320-8030-4ad2-9f8d-aeb95c275b24 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:30.823080 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cca40c-e613-4429-9b7f-fa506dd617c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:30.824242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cca40c-e613-4429-9b7f-fa506dd617c3 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:30.824626 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cca40c-e613-4429-9b7f-fa506dd617c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:30.824875 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cca40c-e613-4429-9b7f-fa506dd617c3 None admin] PATH_INFO: `/v3/users/444e63e870084c44abf38bf00d4d3bb9` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:30.826027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cca40c-e613-4429-9b7f-fa506dd617c3 None admin] RBAC: Authorizing `identity:get_user(user_id=444e63e870084c44abf38bf00d4d3bb9)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:30.827473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cca40c-e613-4429-9b7f-fa506dd617c3 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:30.829101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 161/324] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:30 2022] GET /identity/v3/users/444e63e870084c44abf38bf00d4d3bb9 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:30.834679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cca40c-e613-4429-9b7f-fa506dd617c3 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:30.839825 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 164/325] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:30.861990 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52b744-4e5f-4ec1-8276-279c0923e2f2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:30.873214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:30.943514 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cca40c-e613-4429-9b7f-fa506dd617c3 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:30.946481 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:30.969846 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52b744-4e5f-4ec1-8276-279c0923e2f2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:30.977316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ed6ee-f6a7-4dd3-aa90-0e0f88e6d9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:30.977969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ed6ee-f6a7-4dd3-aa90-0e0f88e6d9dd None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:30.978252 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ed6ee-f6a7-4dd3-aa90-0e0f88e6d9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:30.978529 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ed6ee-f6a7-4dd3-aa90-0e0f88e6d9dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:30.979362 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ed6ee-f6a7-4dd3-aa90-0e0f88e6d9dd None admin] RBAC: Adding query filter params (role.id=7ad29af380bd4e608c78235cbf9741b6, user.id=444e63e870084c44abf38bf00d4d3bb9, scope.system=all) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:30.979679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ed6ee-f6a7-4dd3-aa90-0e0f88e6d9dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:30.981112 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ed6ee-f6a7-4dd3-aa90-0e0f88e6d9dd None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:30.992928 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 162/326] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Jul 12 18:14:30 2022] GET /identity/v3/role_assignments?user.id=444e63e870084c44abf38bf00d4d3bb9&scope.system=all&role.id=7ad29af380bd4e608c78235cbf9741b6 => generated 510 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:30.994097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cee66c-47b8-44af-947f-02585f7f5845 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:30.994387 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cee66c-47b8-44af-947f-02585f7f5845 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:30.994666 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cee66c-47b8-44af-947f-02585f7f5845 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:31.000267 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 163/327] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:31.001730 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b27831-bd28-4bee-90af-ebb37b21ee2b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:31.002014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b27831-bd28-4bee-90af-ebb37b21ee2b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:31.002292 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b27831-bd28-4bee-90af-ebb37b21ee2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:31.005672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf724a9-3c60-4959-b3e2-087dc30acc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:31.007132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf724a9-3c60-4959-b3e2-087dc30acc60 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:31.007419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf724a9-3c60-4959-b3e2-087dc30acc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:31.007699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf724a9-3c60-4959-b3e2-087dc30acc60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:31.008944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf724a9-3c60-4959-b3e2-087dc30acc60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:31.010467 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf724a9-3c60-4959-b3e2-087dc30acc60 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:31.012342 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 165/328] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:31.017938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf724a9-3c60-4959-b3e2-087dc30acc60 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:31.020356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-23b27831-bd28-4bee-90af-ebb37b21ee2b None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:31.021622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-23b27831-bd28-4bee-90af-ebb37b21ee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:31.096219 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 164/329] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:31.119770 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b27831-bd28-4bee-90af-ebb37b21ee2b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:31.130292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf724a9-3c60-4959-b3e2-087dc30acc60 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:31.148052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:31.170315 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd821c-d5ba-4311-8058-a0701d4932ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:31.170315 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd821c-d5ba-4311-8058-a0701d4932ae None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:31.170604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd821c-d5ba-4311-8058-a0701d4932ae None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:31.170815 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd821c-d5ba-4311-8058-a0701d4932ae None admin] PATH_INFO: `/v3/groups` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:31.171456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd821c-d5ba-4311-8058-a0701d4932ae None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:31.172919 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd821c-d5ba-4311-8058-a0701d4932ae None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:31.193291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 166/330] 10.222.0.57 () {60 vars in 1134 bytes} [Tue Jul 12 18:14:31 2022] POST /identity/v3/groups => generated 226 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:14:31.244365 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b27831-bd28-4bee-90af-ebb37b21ee2b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:31.280653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0ea84-639b-40c0-ac98-555f36efb3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:31.281494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0ea84-639b-40c0-ac98-555f36efb3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:31.281769 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0ea84-639b-40c0-ac98-555f36efb3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:31.282038 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0ea84-639b-40c0-ac98-555f36efb3e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:31.293816 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0ea84-639b-40c0-ac98-555f36efb3e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:31.301675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-bdc0ea84-639b-40c0-ac98-555f36efb3e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:14:31.301675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:31.301675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:31.301675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:31.301675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:31.301675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:31.301675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:31.301675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:31.301675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:31.301675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:31.301675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:31.301675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:31.301675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:31.301675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:31.301675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:31.301675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:31.302618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:31.302618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:31.302618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:31.302618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:31.302618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:31.302618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:31.302618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:31.302618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:31.302618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:31.302618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:31.302618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:31.302618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:31.302618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:31.302618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:31.302618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:31.302618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:31.303961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:31.303961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:31.303961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:31.303961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:31.303961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:31.303961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:31.303961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:31.303961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:31.303961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:31.303961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:31.303961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:14:31.303961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:31.304858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 165/331] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:31.309607 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd821c-d5ba-4311-8058-a0701d4932ae None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:31.313478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:31.419303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd821c-d5ba-4311-8058-a0701d4932ae None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:31.453919 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b874807-5288-45a1-93a4-332bd5e717af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:31.454588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b874807-5288-45a1-93a4-332bd5e717af None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:31.454864 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b874807-5288-45a1-93a4-332bd5e717af None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:31.455224 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b874807-5288-45a1-93a4-332bd5e717af None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:31.455975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b874807-5288-45a1-93a4-332bd5e717af None admin] RBAC: Adding query filter params (name=reader) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:31.456278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b874807-5288-45a1-93a4-332bd5e717af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:31.457706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b874807-5288-45a1-93a4-332bd5e717af None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:31.466153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 167/332] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:31.471575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0ea84-639b-40c0-ac98-555f36efb3e3 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:31.559188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:31.586657 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0ea84-639b-40c0-ac98-555f36efb3e3 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:31.624650 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c585d71-05e7-40ec-838c-853d461da397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:31.625873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c585d71-05e7-40ec-838c-853d461da397 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:31.626326 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c585d71-05e7-40ec-838c-853d461da397 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:31.626766 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c585d71-05e7-40ec-838c-853d461da397 None admin] PATH_INFO: `/v3/users/e1ac7266459b49b6bb64d282dbefa861` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:31.628143 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c585d71-05e7-40ec-838c-853d461da397 None admin] RBAC: Authorizing `identity:get_user(user_id=e1ac7266459b49b6bb64d282dbefa861)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:31.629821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c585d71-05e7-40ec-838c-853d461da397 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:31.632500 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 166/333] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:31 2022] GET /identity/v3/users/e1ac7266459b49b6bb64d282dbefa861 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:31.638956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b874807-5288-45a1-93a4-332bd5e717af None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:31.717592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:31.762553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b874807-5288-45a1-93a4-332bd5e717af None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:31.802176 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9553433-c4a4-45b3-85e7-8a5c64d39053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:31.803050 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9553433-c4a4-45b3-85e7-8a5c64d39053 None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:31.803868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9553433-c4a4-45b3-85e7-8a5c64d39053 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:31.804150 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9553433-c4a4-45b3-85e7-8a5c64d39053 None admin] PATH_INFO: `/v3/system/users/e1ac7266459b49b6bb64d282dbefa861/roles/aec350b8d47248f1a54daf9304cdc462` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:31.805721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9553433-c4a4-45b3-85e7-8a5c64d39053 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e1ac7266459b49b6bb64d282dbefa861, role_id=aec350b8d47248f1a54daf9304cdc462)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:31.807112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9553433-c4a4-45b3-85e7-8a5c64d39053 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:31.815970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 168/334] 10.222.0.57 () {58 vars in 1334 bytes} [Tue Jul 12 18:14:31 2022] PUT /identity/v3/system/users/e1ac7266459b49b6bb64d282dbefa861/roles/aec350b8d47248f1a54daf9304cdc462 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:14:33.518224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6113b0-1f84-4c14-afe0-78225c11e0c0 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:33.519236 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6113b0-1f84-4c14-afe0-78225c11e0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:33.519726 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6113b0-1f84-4c14-afe0-78225c11e0c0 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:33.521342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 167/335] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:33.527337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcb1e6-53fe-4b5c-9ac0-0d81c28d99cd None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:33.527738 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcb1e6-53fe-4b5c-9ac0-0d81c28d99cd None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:33.527906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcb1e6-53fe-4b5c-9ac0-0d81c28d99cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:33.550381 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-27fcb1e6-53fe-4b5c-9ac0-0d81c28d99cd None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:33.551605 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-27fcb1e6-53fe-4b5c-9ac0-0d81c28d99cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:33.633369 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 169/336] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:33.655263 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6113b0-1f84-4c14-afe0-78225c11e0c0 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:33.803787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6113b0-1f84-4c14-afe0-78225c11e0c0 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:33.849963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25759d-d2fc-4bdc-b7ad-60ed631bd163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:33.851174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25759d-d2fc-4bdc-b7ad-60ed631bd163 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:33.851681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25759d-d2fc-4bdc-b7ad-60ed631bd163 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:33.852157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25759d-d2fc-4bdc-b7ad-60ed631bd163 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:33.863548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25759d-d2fc-4bdc-b7ad-60ed631bd163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:33.872205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-3e25759d-d2fc-4bdc-b7ad-60ed631bd163 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:33.872205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:33.872205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:33.872205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:33.872205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:33.872205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:33.872205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:33.872205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:33.872205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:33.872205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:33.872205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:33.872205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:33.872205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:33.872205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:33.872205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:33.872205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:33.873071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:33.873071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:33.873071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:33.873071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:33.873071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:33.873071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:33.873071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:33.873071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:33.873071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:33.873071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:33.873071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:33.873071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:33.873071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:33.873071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:33.873071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:33.873071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:33.873895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:33.873895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:33.873895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:33.873895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:33.873895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:33.873895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:33.873895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:33.873895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:33.873895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:33.873895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:33.873895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:33.873895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:33.876549 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 168/337] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:33.883063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcb1e6-53fe-4b5c-9ac0-0d81c28d99cd None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:33.988566 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:34.044810 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcb1e6-53fe-4b5c-9ac0-0d81c28d99cd None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:34.089238 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a5def-3497-4712-b98b-004c32f1635e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:34.089853 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a5def-3497-4712-b98b-004c32f1635e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:34.090132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a5def-3497-4712-b98b-004c32f1635e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:34.090400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a5def-3497-4712-b98b-004c32f1635e None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:34.091150 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a5def-3497-4712-b98b-004c32f1635e None admin] RBAC: Adding query filter params (name=member) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:34.091459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a5def-3497-4712-b98b-004c32f1635e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:34.092833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a5def-3497-4712-b98b-004c32f1635e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:34.105216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 170/338] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:34.110889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25759d-d2fc-4bdc-b7ad-60ed631bd163 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:34.137449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:34.277503 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25759d-d2fc-4bdc-b7ad-60ed631bd163 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:34.329994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2e62f-3233-4fa6-bb30-b1354d9df6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:34.330329 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf1e69-f02c-4ac1-933a-d16c77a8c964 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:34.330558 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf1e69-f02c-4ac1-933a-d16c77a8c964 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:34.330658 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2e62f-3233-4fa6-bb30-b1354d9df6ac None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:34.330832 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf1e69-f02c-4ac1-933a-d16c77a8c964 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:34.330923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2e62f-3233-4fa6-bb30-b1354d9df6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:34.331193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2e62f-3233-4fa6-bb30-b1354d9df6ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:34.332353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 171/339] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:14:34.342195 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4598376-eb54-4138-9558-bdf9b11ecdcb None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:34.342473 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4598376-eb54-4138-9558-bdf9b11ecdcb None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:34.342678 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4598376-eb54-4138-9558-bdf9b11ecdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:34.386310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d4598376-eb54-4138-9558-bdf9b11ecdcb None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:34.387524 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d4598376-eb54-4138-9558-bdf9b11ecdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:34.450924 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2e62f-3233-4fa6-bb30-b1354d9df6ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:34.452400 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2e62f-3233-4fa6-bb30-b1354d9df6ac None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:34.471447 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:34.506676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 172/340] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:34.508022 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653338b3-056b-4d42-9a9d-09e32b60f9a0 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:34.508312 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653338b3-056b-4d42-9a9d-09e32b60f9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:34.508587 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653338b3-056b-4d42-9a9d-09e32b60f9a0 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:34.509876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 173/341] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:34.518507 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45b374-79fb-44ed-b8c9-98805149bbe2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:34.518794 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45b374-79fb-44ed-b8c9-98805149bbe2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:34.519073 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45b374-79fb-44ed-b8c9-98805149bbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:34.543979 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-dc45b374-79fb-44ed-b8c9-98805149bbe2 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:34.545214 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-dc45b374-79fb-44ed-b8c9-98805149bbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:34.613317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 169/342] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:34.615897 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2e62f-3233-4fa6-bb30-b1354d9df6ac None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:34.652842 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:34.686404 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 174/343] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:34.687486 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45b374-79fb-44ed-b8c9-98805149bbe2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:34.815774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2e62f-3233-4fa6-bb30-b1354d9df6ac None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:34.836945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:34.861885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45b374-79fb-44ed-b8c9-98805149bbe2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:34.883670 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8353814-5992-4260-b04c-fb978a8e7227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:34.884736 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8353814-5992-4260-b04c-fb978a8e7227 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:34.885165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8353814-5992-4260-b04c-fb978a8e7227 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:34.885611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8353814-5992-4260-b04c-fb978a8e7227 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:34.904094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8353814-5992-4260-b04c-fb978a8e7227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:34.914133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-b8353814-5992-4260-b04c-fb978a8e7227 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:34.914133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:34.914133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:34.914133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:34.914133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:34.914133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:34.914133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:34.914133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:34.914133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:34.914133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:34.914133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:34.914133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:34.914133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:34.914133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:34.914133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:34.914133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:34.915241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:34.915241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:34.915241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:34.915241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:34.915241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:34.915241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:34.915241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:34.915241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:34.915241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:34.915241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:34.915241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:34.915241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:34.915241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:34.915241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:34.915241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:34.915241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:34.916045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:34.916045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:34.916045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:34.916045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:34.916045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:34.916045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:34.916045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:34.916045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:34.916045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:34.916045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:34.916045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:34.916045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:34.918421 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 170/344] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:14:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:34.919355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8353814-5992-4260-b04c-fb978a8e7227 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:34.922580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da69f91-0b17-42a3-9c44-1ab9d5cc916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:34.924623 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da69f91-0b17-42a3-9c44-1ab9d5cc916e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:34.925012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da69f91-0b17-42a3-9c44-1ab9d5cc916e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:34.925468 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da69f91-0b17-42a3-9c44-1ab9d5cc916e None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:34.929092 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da69f91-0b17-42a3-9c44-1ab9d5cc916e None admin] RBAC: Authorizing `identity:get_project(project_id=5fd455713ae940308a0af4cdfeb3c374)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:34.929092 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da69f91-0b17-42a3-9c44-1ab9d5cc916e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:34.933339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 175/345] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:34 2022] GET /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:34.934837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e943c10-7bee-4f0c-9842-81ad3751b9e0 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:34.937023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e943c10-7bee-4f0c-9842-81ad3751b9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:34.937519 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e943c10-7bee-4f0c-9842-81ad3751b9e0 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:34.939124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 176/346] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:34.940002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e943c10-7bee-4f0c-9842-81ad3751b9e0 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:35.011450 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:35.045890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8353814-5992-4260-b04c-fb978a8e7227 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:35.074288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e943c10-7bee-4f0c-9842-81ad3751b9e0 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:35.098015 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b026d-2d5b-44b3-871c-691de90b7eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:35.099162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b026d-2d5b-44b3-871c-691de90b7eeb None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:35.099606 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b026d-2d5b-44b3-871c-691de90b7eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:35.099887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b026d-2d5b-44b3-871c-691de90b7eeb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:35.116070 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b026d-2d5b-44b3-871c-691de90b7eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:35.118283 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59987875-e527-4e14-b316-254229860393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:35.118283 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59987875-e527-4e14-b316-254229860393 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:35.118283 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59987875-e527-4e14-b316-254229860393 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:35.118547 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59987875-e527-4e14-b316-254229860393 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:35.119226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59987875-e527-4e14-b316-254229860393 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:35.119529 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59987875-e527-4e14-b316-254229860393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:35.120896 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59987875-e527-4e14-b316-254229860393 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:35.126007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-c44b026d-2d5b-44b3-871c-691de90b7eeb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:35.126007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:35.126007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:35.126007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:35.126007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:35.126007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:35.126007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:35.126007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:35.126007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:35.126007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:35.126007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:35.126007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:35.126007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:35.126007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:35.126007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:35.126007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:35.126984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:35.126984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:35.126984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:35.126984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:35.126984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:35.126984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:35.126984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:35.126984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:35.126984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:35.126984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:35.126984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:35.126984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:35.126984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:35.126984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:35.126984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:35.126984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:35.128762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:35.128762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:35.128762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:35.128762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:35.128762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:35.128762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:35.128762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:35.128762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:35.128762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:35.128762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:35.128762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:35.128762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:35.128762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 171/347] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:35.128762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b026d-2d5b-44b3-871c-691de90b7eeb None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:35.136191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 177/348] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:14:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:35.138330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014584e1-7bb1-427c-b453-e7fa99168885 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:35.138614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014584e1-7bb1-427c-b453-e7fa99168885 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:35.138888 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014584e1-7bb1-427c-b453-e7fa99168885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:35.158063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-014584e1-7bb1-427c-b453-e7fa99168885 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:35.159246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-014584e1-7bb1-427c-b453-e7fa99168885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:35.166787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:35.258581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b026d-2d5b-44b3-871c-691de90b7eeb None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:35.265372 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 178/349] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:35.267102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f4bd4-909a-4f66-affa-ec3cf8cf17a5 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:35.267102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f4bd4-909a-4f66-affa-ec3cf8cf17a5 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:35.267395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f4bd4-909a-4f66-affa-ec3cf8cf17a5 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:35.269061 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 179/350] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:35.269808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f4bd4-909a-4f66-affa-ec3cf8cf17a5 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:35.300304 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0a0e3-2552-4f13-8d88-54074fdf2097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:35.301173 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0a0e3-2552-4f13-8d88-54074fdf2097 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:35.301492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0a0e3-2552-4f13-8d88-54074fdf2097 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:35.301773 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0a0e3-2552-4f13-8d88-54074fdf2097 None admin] PATH_INFO: `/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:35.311201 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0a0e3-2552-4f13-8d88-54074fdf2097 None admin] RBAC: Authorizing `identity:get_group(group_id=a88efa0ea0ad47a7acf0d244fc742b26)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:35.312687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0a0e3-2552-4f13-8d88-54074fdf2097 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:35.314413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 172/351] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Jul 12 18:14:35 2022] GET /identity/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:35.315179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0a0e3-2552-4f13-8d88-54074fdf2097 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:35.342876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:35.421150 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f4bd4-909a-4f66-affa-ec3cf8cf17a5 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:35.430614 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:35.441128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0a0e3-2552-4f13-8d88-54074fdf2097 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:35.469204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71e61a-ac0d-4950-acf4-df05696e7c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:35.470148 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71e61a-ac0d-4950-acf4-df05696e7c20 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:35.470569 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71e61a-ac0d-4950-acf4-df05696e7c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:35.470981 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71e61a-ac0d-4950-acf4-df05696e7c20 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:35.471907 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71e61a-ac0d-4950-acf4-df05696e7c20 None admin] RBAC: Adding query filter params (name=member) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:35.472409 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71e61a-ac0d-4950-acf4-df05696e7c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:35.473990 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71e61a-ac0d-4950-acf4-df05696e7c20 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:35.479999 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a6e5f-18b7-480e-84b3-4c1b542e5936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:35.480931 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a6e5f-18b7-480e-84b3-4c1b542e5936 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:35.481234 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a6e5f-18b7-480e-84b3-4c1b542e5936 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:35.481539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a6e5f-18b7-480e-84b3-4c1b542e5936 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:35.484628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 180/352] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:35.486519 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab671faa-e7a0-4aab-b065-377652bff63e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:35.487161 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab671faa-e7a0-4aab-b065-377652bff63e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:35.487763 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab671faa-e7a0-4aab-b065-377652bff63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:35.508928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ab671faa-e7a0-4aab-b065-377652bff63e None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:35.510452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ab671faa-e7a0-4aab-b065-377652bff63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:35.575504 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a6e5f-18b7-480e-84b3-4c1b542e5936 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:35.577196 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a6e5f-18b7-480e-84b3-4c1b542e5936 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:35.607774 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 181/353] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:35.608633 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab671faa-e7a0-4aab-b065-377652bff63e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:35.645603 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:35.693041 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:35.701693 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 173/354] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:35.702535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a6e5f-18b7-480e-84b3-4c1b542e5936 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:35.735851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab671faa-e7a0-4aab-b065-377652bff63e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:35.780202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79190f43-22a1-4c35-b752-25727b3db86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:35.781003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79190f43-22a1-4c35-b752-25727b3db86f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:35.781301 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79190f43-22a1-4c35-b752-25727b3db86f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:35.781580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79190f43-22a1-4c35-b752-25727b3db86f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:35.797432 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79190f43-22a1-4c35-b752-25727b3db86f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:35.805606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-79190f43-22a1-4c35-b752-25727b3db86f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:14:35.805606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:35.805606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:35.805606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:35.805606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:35.805606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:35.805606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:35.805606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:35.805606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:35.805606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:35.805606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:35.805606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:35.805606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:35.805606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:35.805606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:35.805606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:35.806459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:35.806459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:35.806459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:35.806459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:35.806459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:35.806459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:35.806459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:35.806459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:35.806459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:35.806459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:35.806459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:35.806459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:35.806459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:35.806459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:35.806459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:35.806459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:35.807237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:35.807237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:35.807237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:35.807237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:35.807237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:35.807237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:35.807237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:35.807237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:35.807237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:35.807237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:35.807237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:14:35.807237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:35.807237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 182/355] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:35.807881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79190f43-22a1-4c35-b752-25727b3db86f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:35.824679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a6e5f-18b7-480e-84b3-4c1b542e5936 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:35.864385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52f094-de82-454c-9df8-a32b9831afdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:35.865121 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52f094-de82-454c-9df8-a32b9831afdc None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:35.865440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52f094-de82-454c-9df8-a32b9831afdc None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:35.866190 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52f094-de82-454c-9df8-a32b9831afdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:35.866770 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52f094-de82-454c-9df8-a32b9831afdc None admin] RBAC: Adding query filter params (group.id=a88efa0ea0ad47a7acf0d244fc742b26, role.id=7ad29af380bd4e608c78235cbf9741b6, scope.project.id=5fd455713ae940308a0af4cdfeb3c374) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:35.867180 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52f094-de82-454c-9df8-a32b9831afdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:35.868541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52f094-de82-454c-9df8-a32b9831afdc None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:35.874564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 174/356] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Jul 12 18:14:35 2022] GET /identity/v3/role_assignments?group.id=a88efa0ea0ad47a7acf0d244fc742b26&scope.project.id=5fd455713ae940308a0af4cdfeb3c374&role.id=7ad29af380bd4e608c78235cbf9741b6 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:35.875814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f04e3-2784-4553-8c81-e6abc7fd6f8a None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:35.876101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f04e3-2784-4553-8c81-e6abc7fd6f8a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:35.876376 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f04e3-2784-4553-8c81-e6abc7fd6f8a None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:35.877672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 175/357] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:35.878383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f04e3-2784-4553-8c81-e6abc7fd6f8a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:35.936303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:35.946392 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79190f43-22a1-4c35-b752-25727b3db86f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:35.955560 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:35.998914 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02951271-1e63-4057-b792-7408740ab826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:35.999846 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02951271-1e63-4057-b792-7408740ab826 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:36.000134 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02951271-1e63-4057-b792-7408740ab826 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:36.000554 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02951271-1e63-4057-b792-7408740ab826 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:36.020831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f04e3-2784-4553-8c81-e6abc7fd6f8a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:36.079230 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cd2c3-ceae-41b4-aa47-ecc0162216e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:36.080113 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cd2c3-ceae-41b4-aa47-ecc0162216e4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:36.080577 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cd2c3-ceae-41b4-aa47-ecc0162216e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:36.080930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cd2c3-ceae-41b4-aa47-ecc0162216e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:36.083619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02951271-1e63-4057-b792-7408740ab826 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:36.085218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02951271-1e63-4057-b792-7408740ab826 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:36.096420 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558cd2c3-ceae-41b4-aa47-ecc0162216e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:36.105136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-558cd2c3-ceae-41b4-aa47-ecc0162216e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:36.105136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:36.105136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:36.105136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:36.105136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:36.105136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:36.105136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:36.105136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:36.105136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:36.105136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:36.105136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:36.105136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:36.105136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:36.105136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:36.105136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:36.105136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:36.107040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:36.107040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:36.107040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:36.107040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:36.107040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:36.107040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:36.107040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:36.107040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:36.107040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:36.107040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:36.107040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:36.107040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:36.107040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:36.107040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:36.107040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:36.107040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:36.107914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:36.107914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:36.107914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:36.107914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:36.107914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:36.107914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:36.107914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:36.107914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:36.107914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:36.107914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:36.107914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:36.107914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:36.110576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 176/358] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:14:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:36.111595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cd2c3-ceae-41b4-aa47-ecc0162216e4 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:36.210109 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:36.219215 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 183/359] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:36.220178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02951271-1e63-4057-b792-7408740ab826 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:36.237319 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cd2c3-ceae-41b4-aa47-ecc0162216e4 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:36.257652 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:36.277616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b47a5e-2b9a-4203-ae14-02cdbe1aa4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:36.278705 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b47a5e-2b9a-4203-ae14-02cdbe1aa4bc None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:36.279134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b47a5e-2b9a-4203-ae14-02cdbe1aa4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:36.279580 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b47a5e-2b9a-4203-ae14-02cdbe1aa4bc None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:36.282027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b47a5e-2b9a-4203-ae14-02cdbe1aa4bc None admin] RBAC: Authorizing `identity:get_project(project_id=5fd455713ae940308a0af4cdfeb3c374)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:36.283728 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b47a5e-2b9a-4203-ae14-02cdbe1aa4bc None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:36.285865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 177/360] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:36 2022] GET /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:36.287224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420220f3-63b7-4c29-9da8-c9f3c64046a9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:36.287747 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420220f3-63b7-4c29-9da8-c9f3c64046a9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:36.288203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420220f3-63b7-4c29-9da8-c9f3c64046a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:36.306840 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-420220f3-63b7-4c29-9da8-c9f3c64046a9 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:36.308807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-420220f3-63b7-4c29-9da8-c9f3c64046a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:36.339915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02951271-1e63-4057-b792-7408740ab826 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:36.388977 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8526e-5e76-4382-945c-8741fbe3b119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:36.389681 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8526e-5e76-4382-945c-8741fbe3b119 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:36.389967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8526e-5e76-4382-945c-8741fbe3b119 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:36.390244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8526e-5e76-4382-945c-8741fbe3b119 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:36.393205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8526e-5e76-4382-945c-8741fbe3b119 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:36.393554 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8526e-5e76-4382-945c-8741fbe3b119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:36.394950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8526e-5e76-4382-945c-8741fbe3b119 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:36.400059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 178/361] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:36.401201 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420220f3-63b7-4c29-9da8-c9f3c64046a9 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:36.409286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 184/362] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:36.409286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8526e-5e76-4382-945c-8741fbe3b119 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:36.476217 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:36.535886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420220f3-63b7-4c29-9da8-c9f3c64046a9 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:36.543604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8526e-5e76-4382-945c-8741fbe3b119 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:36.560587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:36.587160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee295a-42a1-4d65-b6b9-1069517511b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:36.587843 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee295a-42a1-4d65-b6b9-1069517511b6 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:36.588127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee295a-42a1-4d65-b6b9-1069517511b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:36.588397 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee295a-42a1-4d65-b6b9-1069517511b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:36.589158 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee295a-42a1-4d65-b6b9-1069517511b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:36.589534 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee295a-42a1-4d65-b6b9-1069517511b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:36.590939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee295a-42a1-4d65-b6b9-1069517511b6 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:36.601946 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812dc4b1-7bc0-4fb8-b994-9c876f02822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:36.602818 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dc4b1-7bc0-4fb8-b994-9c876f02822d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:36.603098 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dc4b1-7bc0-4fb8-b994-9c876f02822d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:36.603372 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dc4b1-7bc0-4fb8-b994-9c876f02822d None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:36.604606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812dc4b1-7bc0-4fb8-b994-9c876f02822d None admin] RBAC: Authorizing `identity:get_project(project_id=b83079b3240b49369bd78d73fd7c599c)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:36.606103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812dc4b1-7bc0-4fb8-b994-9c876f02822d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:36.608019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 185/363] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:36 2022] GET /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:36.608607 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812dc4b1-7bc0-4fb8-b994-9c876f02822d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:36.608853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 179/364] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:14:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:36.610065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee295a-42a1-4d65-b6b9-1069517511b6 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:36.745722 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812dc4b1-7bc0-4fb8-b994-9c876f02822d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:36.754546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee295a-42a1-4d65-b6b9-1069517511b6 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:36.777437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:36.791289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ef12e-652f-4832-814e-5d45b07035f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:36.792148 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ef12e-652f-4832-814e-5d45b07035f3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:36.792436 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ef12e-652f-4832-814e-5d45b07035f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:36.792711 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ef12e-652f-4832-814e-5d45b07035f3 None admin] PATH_INFO: `/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:36.794411 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ef12e-652f-4832-814e-5d45b07035f3 None admin] RBAC: Authorizing `identity:get_group(group_id=a88efa0ea0ad47a7acf0d244fc742b26)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:36.796824 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ef12e-652f-4832-814e-5d45b07035f3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:36.798700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 186/365] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Jul 12 18:14:36 2022] GET /identity/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:36.799247 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ef12e-652f-4832-814e-5d45b07035f3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:36.806049 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f3d0f-cc36-4eb2-bf36-e706d246d2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:36.807000 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f3d0f-cc36-4eb2-bf36-e706d246d2eb None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:36.807307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f3d0f-cc36-4eb2-bf36-e706d246d2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:36.807602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f3d0f-cc36-4eb2-bf36-e706d246d2eb None admin] PATH_INFO: `/v3/users/e1ac7266459b49b6bb64d282dbefa861` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:36.810271 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f3d0f-cc36-4eb2-bf36-e706d246d2eb None admin] RBAC: Authorizing `identity:get_user(user_id=e1ac7266459b49b6bb64d282dbefa861)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:36.812126 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f3d0f-cc36-4eb2-bf36-e706d246d2eb None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:36.817287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 180/366] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:14:36 2022] GET /identity/v3/users/e1ac7266459b49b6bb64d282dbefa861 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:36.817287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f3d0f-cc36-4eb2-bf36-e706d246d2eb None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:36.884576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:36.924400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ef12e-652f-4832-814e-5d45b07035f3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:36.952996 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f3d0f-cc36-4eb2-bf36-e706d246d2eb None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:36.983577 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19644b-d341-4fb0-9885-ea6e6705298e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:36.984395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19644b-d341-4fb0-9885-ea6e6705298e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:36.984675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19644b-d341-4fb0-9885-ea6e6705298e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:36.984947 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19644b-d341-4fb0-9885-ea6e6705298e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:36.999768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b25b6c-cebf-4e56-93c3-2342718d943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:37.000019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19644b-d341-4fb0-9885-ea6e6705298e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:37.001086 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b25b6c-cebf-4e56-93c3-2342718d943c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:37.001565 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b25b6c-cebf-4e56-93c3-2342718d943c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:37.002064 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b25b6c-cebf-4e56-93c3-2342718d943c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:37.013915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-ce19644b-d341-4fb0-9885-ea6e6705298e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:14:37.013915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:37.013915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:37.013915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:37.013915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:37.013915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:37.013915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:37.013915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:37.013915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:37.013915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:37.013915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:37.013915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:37.013915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:37.013915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:37.013915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:37.013915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:37.015097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:37.015097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:37.015097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:37.015097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:37.015097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:37.015097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:37.015097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:37.015097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:37.015097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:37.015097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:37.015097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:37.015097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:37.015097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:37.015097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:37.015097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:37.015097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:37.016147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:37.016147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:37.016147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:37.016147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:37.016147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:37.016147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:37.016147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:37.016147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:37.016147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:37.016147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:37.016147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:14:37.016147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:37.018530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 187/367] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:14:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:37.019364 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19644b-d341-4fb0-9885-ea6e6705298e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:37.088198 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:37.103544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b25b6c-cebf-4e56-93c3-2342718d943c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:37.106184 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b25b6c-cebf-4e56-93c3-2342718d943c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:37.143374 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19644b-d341-4fb0-9885-ea6e6705298e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:37.158082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:37.185013 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6990762-9089-4e5b-9182-48558bdcd4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:37.185989 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6990762-9089-4e5b-9182-48558bdcd4ed None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:37.186875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6990762-9089-4e5b-9182-48558bdcd4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:37.186875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6990762-9089-4e5b-9182-48558bdcd4ed None admin] PATH_INFO: `/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:37.187921 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6990762-9089-4e5b-9182-48558bdcd4ed None admin] RBAC: Authorizing `identity:get_group(group_id=a88efa0ea0ad47a7acf0d244fc742b26)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:37.189472 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6990762-9089-4e5b-9182-48558bdcd4ed None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:37.191327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 188/368] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Jul 12 18:14:37 2022] GET /identity/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:37.191979 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6990762-9089-4e5b-9182-48558bdcd4ed None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:37.228612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 181/369] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:37.228612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b25b6c-cebf-4e56-93c3-2342718d943c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:37.302278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6990762-9089-4e5b-9182-48558bdcd4ed None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:37.327107 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:37.340268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b25b6c-cebf-4e56-93c3-2342718d943c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:37.343018 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c52510-d2de-4556-9892-deb24c4a8708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:37.343673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c52510-d2de-4556-9892-deb24c4a8708 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:37.343960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c52510-d2de-4556-9892-deb24c4a8708 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:37.344238 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c52510-d2de-4556-9892-deb24c4a8708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:37.345067 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c52510-d2de-4556-9892-deb24c4a8708 None admin] RBAC: Adding query filter params (group.id=a88efa0ea0ad47a7acf0d244fc742b26, role.id=fb45aabab51d4c698f2da1840ff5920d, scope.project.id=5fd455713ae940308a0af4cdfeb3c374) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:37.345412 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c52510-d2de-4556-9892-deb24c4a8708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:37.346854 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c52510-d2de-4556-9892-deb24c4a8708 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:37.352952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 189/370] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Jul 12 18:14:37 2022] GET /identity/v3/role_assignments?group.id=a88efa0ea0ad47a7acf0d244fc742b26&scope.project.id=5fd455713ae940308a0af4cdfeb3c374&role.id=fb45aabab51d4c698f2da1840ff5920d => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:37.353762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c52510-d2de-4556-9892-deb24c4a8708 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:37.390031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6970215-15fc-4154-b833-d09930e99cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:37.390704 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6970215-15fc-4154-b833-d09930e99cdf None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:37.390987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6970215-15fc-4154-b833-d09930e99cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:37.391265 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6970215-15fc-4154-b833-d09930e99cdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:37.392114 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6970215-15fc-4154-b833-d09930e99cdf None admin] RBAC: Adding query filter params (role.id=aec350b8d47248f1a54daf9304cdc462, user.id=e1ac7266459b49b6bb64d282dbefa861, scope.system=all) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:37.392423 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6970215-15fc-4154-b833-d09930e99cdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:37.393945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6970215-15fc-4154-b833-d09930e99cdf None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:37.413307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 182/371] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Jul 12 18:14:37 2022] GET /identity/v3/role_assignments?user.id=e1ac7266459b49b6bb64d282dbefa861&scope.system=all&role.id=aec350b8d47248f1a54daf9304cdc462 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:37.413307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6970215-15fc-4154-b833-d09930e99cdf None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:37.425777 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:37.597604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c52510-d2de-4556-9892-deb24c4a8708 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:37.597817 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6970215-15fc-4154-b833-d09930e99cdf None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:37.640288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9f87c-9c52-466d-b42b-9543b2d9cb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:37.641170 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9f87c-9c52-466d-b42b-9543b2d9cb78 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:37.641481 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9f87c-9c52-466d-b42b-9543b2d9cb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:37.641759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9f87c-9c52-466d-b42b-9543b2d9cb78 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:37.642626 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9f87c-9c52-466d-b42b-9543b2d9cb78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:37.642939 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9f87c-9c52-466d-b42b-9543b2d9cb78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:37.643040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be098c85-8cc8-44e8-b8f4-2f6e14cf9ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:37.643614 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be098c85-8cc8-44e8-b8f4-2f6e14cf9ece None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:37.643901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be098c85-8cc8-44e8-b8f4-2f6e14cf9ece None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:37.644180 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be098c85-8cc8-44e8-b8f4-2f6e14cf9ece None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:37.644347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9f87c-9c52-466d-b42b-9543b2d9cb78 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:37.645020 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be098c85-8cc8-44e8-b8f4-2f6e14cf9ece None admin] RBAC: Adding query filter params (group.id=a88efa0ea0ad47a7acf0d244fc742b26, role.id=7ad29af380bd4e608c78235cbf9741b6, scope.project.id=b83079b3240b49369bd78d73fd7c599c) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:37.645368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be098c85-8cc8-44e8-b8f4-2f6e14cf9ece None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:37.646806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be098c85-8cc8-44e8-b8f4-2f6e14cf9ece None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:37.655241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 183/372] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Jul 12 18:14:37 2022] GET /identity/v3/role_assignments?group.id=a88efa0ea0ad47a7acf0d244fc742b26&scope.project.id=b83079b3240b49369bd78d73fd7c599c&role.id=7ad29af380bd4e608c78235cbf9741b6 => generated 260 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:37.656073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be098c85-8cc8-44e8-b8f4-2f6e14cf9ece None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:37.659286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 190/373] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:37.666999 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9f87c-9c52-466d-b42b-9543b2d9cb78 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:37.741675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:37.773024 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:37.782767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be098c85-8cc8-44e8-b8f4-2f6e14cf9ece None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:37.823115 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d39a6-c79c-4c67-ba08-38216bd684f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:37.824183 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d39a6-c79c-4c67-ba08-38216bd684f8 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:37.824474 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d39a6-c79c-4c67-ba08-38216bd684f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:37.824756 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d39a6-c79c-4c67-ba08-38216bd684f8 None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:37.826200 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d39a6-c79c-4c67-ba08-38216bd684f8 None admin] RBAC: Authorizing `identity:get_project(project_id=b83079b3240b49369bd78d73fd7c599c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:37.827682 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d39a6-c79c-4c67-ba08-38216bd684f8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:37.829816 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 184/374] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:37 2022] GET /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:37.836001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d39a6-c79c-4c67-ba08-38216bd684f8 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:37.904195 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9f87c-9c52-466d-b42b-9543b2d9cb78 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:37.948948 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d39a6-c79c-4c67-ba08-38216bd684f8 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:37.961737 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abe932-98bb-435b-93b0-f3da7672afbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:37.962455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abe932-98bb-435b-93b0-f3da7672afbe None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:37.962739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abe932-98bb-435b-93b0-f3da7672afbe None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:37.963016 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abe932-98bb-435b-93b0-f3da7672afbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:37.985149 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d10edd-e80d-4ffc-824f-b868fa41f4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:37.986048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d10edd-e80d-4ffc-824f-b868fa41f4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:37.986326 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d10edd-e80d-4ffc-824f-b868fa41f4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:37.986599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d10edd-e80d-4ffc-824f-b868fa41f4e1 None admin] PATH_INFO: `/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:37.987783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d10edd-e80d-4ffc-824f-b868fa41f4e1 None admin] RBAC: Authorizing `identity:get_group(group_id=a88efa0ea0ad47a7acf0d244fc742b26)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:37.989248 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d10edd-e80d-4ffc-824f-b868fa41f4e1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:37.991227 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 185/375] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Jul 12 18:14:37 2022] GET /identity/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:37.996898 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d10edd-e80d-4ffc-824f-b868fa41f4e1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:38.000629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:38.112415 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d10edd-e80d-4ffc-824f-b868fa41f4e1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:38.126230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abe932-98bb-435b-93b0-f3da7672afbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:38.127717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abe932-98bb-435b-93b0-f3da7672afbe None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:38.167468 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f547c-fc47-4d81-84e5-14266613cd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:38.168151 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f547c-fc47-4d81-84e5-14266613cd85 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:38.168643 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f547c-fc47-4d81-84e5-14266613cd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:38.168920 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f547c-fc47-4d81-84e5-14266613cd85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:38.170527 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f547c-fc47-4d81-84e5-14266613cd85 None admin] RBAC: Adding query filter params (group.id=a88efa0ea0ad47a7acf0d244fc742b26, role.id=fb45aabab51d4c698f2da1840ff5920d, scope.project.id=b83079b3240b49369bd78d73fd7c599c) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:38.170833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f547c-fc47-4d81-84e5-14266613cd85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:38.173006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f547c-fc47-4d81-84e5-14266613cd85 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:38.182889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 186/376] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Jul 12 18:14:37 2022] GET /identity/v3/role_assignments?group.id=a88efa0ea0ad47a7acf0d244fc742b26&scope.project.id=b83079b3240b49369bd78d73fd7c599c&role.id=fb45aabab51d4c698f2da1840ff5920d => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:38.184484 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bb793-f2a6-4af0-9759-2f6fc028b896 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:38.184774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bb793-f2a6-4af0-9759-2f6fc028b896 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:38.189791 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bb793-f2a6-4af0-9759-2f6fc028b896 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:38.191880 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:38.193037 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 187/377] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:38.199207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b45512-c95a-4183-b163-14e0b27b53fd None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:38.199656 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b45512-c95a-4183-b163-14e0b27b53fd None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:38.199940 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b45512-c95a-4183-b163-14e0b27b53fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:38.257355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a7b45512-c95a-4183-b163-14e0b27b53fd None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:38.257355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a7b45512-c95a-4183-b163-14e0b27b53fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:38.278640 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 191/378] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 18:14:38.293337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abe932-98bb-435b-93b0-f3da7672afbe None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:38.466869 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:38.486746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 188/379] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 12 18:14:38.522399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b45512-c95a-4183-b163-14e0b27b53fd None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:38.525126 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abe932-98bb-435b-93b0-f3da7672afbe None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:38.587591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1d7ef-2aa9-4456-add6-2c2347855cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:38.588839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1d7ef-2aa9-4456-add6-2c2347855cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:38.589370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1d7ef-2aa9-4456-add6-2c2347855cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:38.589839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1d7ef-2aa9-4456-add6-2c2347855cf8 None admin] PATH_INFO: `/v3/projects/9596f7aaab1542a3ad455f9c2becff96` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:38.591385 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1d7ef-2aa9-4456-add6-2c2347855cf8 None admin] RBAC: Authorizing `identity:get_project(project_id=9596f7aaab1542a3ad455f9c2becff96)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:38.593025 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1d7ef-2aa9-4456-add6-2c2347855cf8 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:38.595402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 192/380] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:38 2022] GET /identity/v3/projects/9596f7aaab1542a3ad455f9c2becff96 => generated 344 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:38.601953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1d7ef-2aa9-4456-add6-2c2347855cf8 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:38.627729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:38.729419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b45512-c95a-4183-b163-14e0b27b53fd None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:38.782777 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1d7ef-2aa9-4456-add6-2c2347855cf8 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:38.794775 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db659b-c2c8-418a-b817-568a075ecbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:38.795709 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db659b-c2c8-418a-b817-568a075ecbea None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:38.796106 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db659b-c2c8-418a-b817-568a075ecbea None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:38.796476 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db659b-c2c8-418a-b817-568a075ecbea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:38.815099 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db659b-c2c8-418a-b817-568a075ecbea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:38.823097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-78db659b-c2c8-418a-b817-568a075ecbea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:38.823097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:38.823097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:38.823097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:38.823097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:38.823097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:38.823097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:38.823097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:38.823097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:38.823097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:38.823097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:38.823097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:38.823097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:38.823097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:38.823097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:38.823097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:38.824414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:38.824414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:38.824414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:38.824414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:38.824414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:38.824414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:38.824414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:38.824414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:38.824414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:38.824414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:38.824414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:38.824414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:38.824414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:38.824414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:38.824414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:38.824414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:38.825211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:38.825211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:38.825211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:38.825211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:38.825211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:38.825211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:38.825211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:38.825211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:38.825211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:38.825211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:38.825211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:38.825211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:38.826049 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 189/381] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:38.833112 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db659b-c2c8-418a-b817-568a075ecbea None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:38.842928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c2eb5-c6f2-4633-a9c6-9cb7bc299902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:38.843670 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2eb5-c6f2-4633-a9c6-9cb7bc299902 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:38.843951 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2eb5-c6f2-4633-a9c6-9cb7bc299902 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:38.844227 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2eb5-c6f2-4633-a9c6-9cb7bc299902 None admin] PATH_INFO: `/v3/groups/11782a44a4594e009553dc77344fcd92` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:38.858875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c2eb5-c6f2-4633-a9c6-9cb7bc299902 None admin] RBAC: Authorizing `identity:get_group(group_id=11782a44a4594e009553dc77344fcd92)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:38.860334 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c2eb5-c6f2-4633-a9c6-9cb7bc299902 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:38.863299 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 193/382] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Jul 12 18:14:38 2022] GET /identity/v3/groups/11782a44a4594e009553dc77344fcd92 => generated 229 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:38.870777 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c2eb5-c6f2-4633-a9c6-9cb7bc299902 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:38.956117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:39.083377 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:39.106639 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db659b-c2c8-418a-b817-568a075ecbea None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:39.154376 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c2eb5-c6f2-4633-a9c6-9cb7bc299902 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:39.197275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38867a43-194f-4c76-91bc-2d039d386cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:39.197995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867a43-194f-4c76-91bc-2d039d386cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:39.198537 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867a43-194f-4c76-91bc-2d039d386cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:39.198818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867a43-194f-4c76-91bc-2d039d386cb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:39.199566 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38867a43-194f-4c76-91bc-2d039d386cb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:39.199875 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38867a43-194f-4c76-91bc-2d039d386cb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:39.201272 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38867a43-194f-4c76-91bc-2d039d386cb9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:39.215452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 190/383] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:39.220848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38867a43-194f-4c76-91bc-2d039d386cb9 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:39.226943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eba3d-51f9-4ba0-bff3-065751bdb812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:39.227599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eba3d-51f9-4ba0-bff3-065751bdb812 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:39.227881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eba3d-51f9-4ba0-bff3-065751bdb812 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:39.228153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eba3d-51f9-4ba0-bff3-065751bdb812 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:39.228977 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eba3d-51f9-4ba0-bff3-065751bdb812 None admin] RBAC: Adding query filter params (group.id=11782a44a4594e009553dc77344fcd92, role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.project.id=9596f7aaab1542a3ad455f9c2becff96) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:39.229319 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eba3d-51f9-4ba0-bff3-065751bdb812 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:39.230756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eba3d-51f9-4ba0-bff3-065751bdb812 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:39.246419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 194/384] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Jul 12 18:14:38 2022] GET /identity/v3/role_assignments?group.id=11782a44a4594e009553dc77344fcd92&scope.project.id=9596f7aaab1542a3ad455f9c2becff96&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 260 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:39.387575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38867a43-194f-4c76-91bc-2d039d386cb9 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:39.417118 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:39.436361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc18835-d8e4-4843-9dce-2c281ee5c16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:39.437226 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc18835-d8e4-4843-9dce-2c281ee5c16b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:39.437532 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc18835-d8e4-4843-9dce-2c281ee5c16b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:39.437808 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc18835-d8e4-4843-9dce-2c281ee5c16b None admin] PATH_INFO: `/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:39.442010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc18835-d8e4-4843-9dce-2c281ee5c16b None admin] RBAC: Authorizing `identity:get_group(group_id=a88efa0ea0ad47a7acf0d244fc742b26)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:39.443494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc18835-d8e4-4843-9dce-2c281ee5c16b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:39.445573 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 191/385] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Jul 12 18:14:39 2022] GET /identity/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:39.451079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eba3d-51f9-4ba0-bff3-065751bdb812 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:39.576293 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eba3d-51f9-4ba0-bff3-065751bdb812 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:39.620676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54431dde-2292-48ec-adb5-193735c924e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:39.621592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54431dde-2292-48ec-adb5-193735c924e5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:39.621878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54431dde-2292-48ec-adb5-193735c924e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:39.622157 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54431dde-2292-48ec-adb5-193735c924e5 None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:39.623395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54431dde-2292-48ec-adb5-193735c924e5 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd455713ae940308a0af4cdfeb3c374)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:39.624872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54431dde-2292-48ec-adb5-193735c924e5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:39.626623 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 195/386] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:39 2022] GET /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:39.633125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc18835-d8e4-4843-9dce-2c281ee5c16b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:39.820629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc18835-d8e4-4843-9dce-2c281ee5c16b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:39.865402 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3783f7-3a6b-4b5d-b193-9f7c4652dcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:39.866944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3783f7-3a6b-4b5d-b193-9f7c4652dcb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:39.867230 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3783f7-3a6b-4b5d-b193-9f7c4652dcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:39.867506 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3783f7-3a6b-4b5d-b193-9f7c4652dcb9 None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374/groups/a88efa0ea0ad47a7acf0d244fc742b26/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:39.874519 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3783f7-3a6b-4b5d-b193-9f7c4652dcb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fd455713ae940308a0af4cdfeb3c374, group_id=a88efa0ea0ad47a7acf0d244fc742b26, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:39.875991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3783f7-3a6b-4b5d-b193-9f7c4652dcb9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:39.891026 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 192/387] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Jul 12 18:14:39 2022] PUT /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374/groups/a88efa0ea0ad47a7acf0d244fc742b26/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:14:40.071511 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e2fe0-f6ec-4d15-9a22-22f5ba0cb380 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:40.072025 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e2fe0-f6ec-4d15-9a22-22f5ba0cb380 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:40.072025 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e2fe0-f6ec-4d15-9a22-22f5ba0cb380 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:40.073964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 196/388] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:40.079573 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171432d7-f072-42d4-9984-4cf38a403745 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:40.079869 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171432d7-f072-42d4-9984-4cf38a403745 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:40.080126 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171432d7-f072-42d4-9984-4cf38a403745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:40.102114 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-171432d7-f072-42d4-9984-4cf38a403745 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:40.103289 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-171432d7-f072-42d4-9984-4cf38a403745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:40.149093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:40.155961 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9deac71-5e6a-488f-93ed-88cf415a71c0 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:40.156411 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9deac71-5e6a-488f-93ed-88cf415a71c0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:40.156516 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9deac71-5e6a-488f-93ed-88cf415a71c0 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:40.158033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 197/389] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:14:40.164403 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7c7af-634b-45e6-b4ae-5c89ab0ed243 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:40.164695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7c7af-634b-45e6-b4ae-5c89ab0ed243 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:40.164973 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7c7af-634b-45e6-b4ae-5c89ab0ed243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:40.182782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 193/390] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:40.187419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b8c7c7af-634b-45e6-b4ae-5c89ab0ed243 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:40.187419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b8c7c7af-634b-45e6-b4ae-5c89ab0ed243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:40.191478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:40.206797 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171432d7-f072-42d4-9984-4cf38a403745 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:40.323111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 198/391] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:40.348863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171432d7-f072-42d4-9984-4cf38a403745 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:40.357604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7c7af-634b-45e6-b4ae-5c89ab0ed243 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:40.425794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b4bb3-fc80-4080-9c8e-f18b5bba2402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:40.426602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b4bb3-fc80-4080-9c8e-f18b5bba2402 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:40.426911 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b4bb3-fc80-4080-9c8e-f18b5bba2402 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:40.427152 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b4bb3-fc80-4080-9c8e-f18b5bba2402 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:40.448917 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b4bb3-fc80-4080-9c8e-f18b5bba2402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:40.460317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-f82b4bb3-fc80-4080-9c8e-f18b5bba2402 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:40.460317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:40.460317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:40.460317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:40.460317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:40.460317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:40.460317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:40.460317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:40.460317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:40.460317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:40.460317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:40.460317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:40.460317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:40.460317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:40.460317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:40.460317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:40.461290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:40.461290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:40.461290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:40.461290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:40.461290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:40.461290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:40.461290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:40.461290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:40.461290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:40.461290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:40.461290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:40.461290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:40.461290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:40.461290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:40.461290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:40.461290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:40.462274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:40.462274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:40.462274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:40.462274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:40.462274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:40.462274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:40.462274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:40.462274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:40.462274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:40.462274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:40.462274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:40.462274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:40.462274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 194/392] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:40.468789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b4bb3-fc80-4080-9c8e-f18b5bba2402 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:40.532720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7c7af-634b-45e6-b4ae-5c89ab0ed243 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:40.560342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:40.575915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac528cf-49a2-4a79-8dd3-fae2de14a257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:40.577055 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac528cf-49a2-4a79-8dd3-fae2de14a257 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:40.577576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac528cf-49a2-4a79-8dd3-fae2de14a257 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:40.578049 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac528cf-49a2-4a79-8dd3-fae2de14a257 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:40.589010 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac528cf-49a2-4a79-8dd3-fae2de14a257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:40.601507 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:40.603950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-1ac528cf-49a2-4a79-8dd3-fae2de14a257 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:40.603950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:40.603950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:40.603950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:40.603950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:40.603950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:40.603950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:40.603950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:40.603950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:40.603950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:40.603950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:40.603950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:40.603950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:40.603950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:40.603950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:40.603950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:40.604906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:40.604906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:40.604906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:40.604906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:40.604906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:40.604906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:40.604906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:40.604906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:40.604906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:40.604906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:40.604906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:40.604906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:40.604906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:40.604906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:40.604906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:40.604906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:40.605834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:40.605834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:40.605834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:40.605834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:40.605834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:40.605834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:40.605834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:40.605834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:40.605834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:40.605834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:40.605834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:40.605834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:40.609296 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 199/393] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:14:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:40.627812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac528cf-49a2-4a79-8dd3-fae2de14a257 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:40.693304 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b4bb3-fc80-4080-9c8e-f18b5bba2402 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:40.746678 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac528cf-49a2-4a79-8dd3-fae2de14a257 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:40.778556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ecd6e-3a27-4447-a853-b6a347a8fc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:40.779236 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ecd6e-3a27-4447-a853-b6a347a8fc61 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:40.779521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ecd6e-3a27-4447-a853-b6a347a8fc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:40.779798 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ecd6e-3a27-4447-a853-b6a347a8fc61 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:40.780554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ecd6e-3a27-4447-a853-b6a347a8fc61 None admin] RBAC: Adding query filter params (name=member) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:40.780864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ecd6e-3a27-4447-a853-b6a347a8fc61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:40.782290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ecd6e-3a27-4447-a853-b6a347a8fc61 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:40.783879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4acc511-8630-4f08-bfa6-00a1a5726db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:40.784552 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acc511-8630-4f08-bfa6-00a1a5726db1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:40.784837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acc511-8630-4f08-bfa6-00a1a5726db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:40.785117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acc511-8630-4f08-bfa6-00a1a5726db1 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:40.785892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acc511-8630-4f08-bfa6-00a1a5726db1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:40.786203 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acc511-8630-4f08-bfa6-00a1a5726db1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:40.787639 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acc511-8630-4f08-bfa6-00a1a5726db1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:40.797761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 200/394] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:14:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:40.805481 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 195/395] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:40.809309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4acc511-8630-4f08-bfa6-00a1a5726db1 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:40.816392 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f99028-da9d-4170-98f1-a2beea03fa0b None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:40.816721 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f99028-da9d-4170-98f1-a2beea03fa0b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:40.816955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f99028-da9d-4170-98f1-a2beea03fa0b None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:40.818381 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 196/396] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:14:40.825525 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8f4a8-e098-4283-9af1-4dceeea454b3 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:40.827008 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8f4a8-e098-4283-9af1-4dceeea454b3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:40.827706 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8f4a8-e098-4283-9af1-4dceeea454b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:40.846577 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-0de8f4a8-e098-4283-9af1-4dceeea454b3 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:40.848069 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0de8f4a8-e098-4283-9af1-4dceeea454b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:40.880642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:40.918542 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 197/397] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:40.919773 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8f4a8-e098-4283-9af1-4dceeea454b3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:40.922843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4acc511-8630-4f08-bfa6-00a1a5726db1 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:40.950759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:40.960887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38161c-36e9-4a7d-bdd0-c5eeb66f264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:40.961783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38161c-36e9-4a7d-bdd0-c5eeb66f264b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:40.962070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38161c-36e9-4a7d-bdd0-c5eeb66f264b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:40.962347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38161c-36e9-4a7d-bdd0-c5eeb66f264b None admin] PATH_INFO: `/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:40.963786 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38161c-36e9-4a7d-bdd0-c5eeb66f264b None admin] RBAC: Authorizing `identity:get_group(group_id=a88efa0ea0ad47a7acf0d244fc742b26)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:40.964980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38161c-36e9-4a7d-bdd0-c5eeb66f264b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:40.966927 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 201/398] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Jul 12 18:14:40 2022] GET /identity/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:40.971943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38161c-36e9-4a7d-bdd0-c5eeb66f264b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:41.030323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8f4a8-e098-4283-9af1-4dceeea454b3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:41.065621 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51929b11-ee1b-419c-b1b6-1aae80ec525a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:41.066763 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51929b11-ee1b-419c-b1b6-1aae80ec525a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:41.067243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51929b11-ee1b-419c-b1b6-1aae80ec525a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:41.067714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51929b11-ee1b-419c-b1b6-1aae80ec525a None admin] PATH_INFO: `/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:41.069143 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51929b11-ee1b-419c-b1b6-1aae80ec525a None admin] RBAC: Authorizing `identity:get_group(group_id=a88efa0ea0ad47a7acf0d244fc742b26)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:41.070818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51929b11-ee1b-419c-b1b6-1aae80ec525a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:41.072910 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 198/399] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Jul 12 18:14:40 2022] GET /identity/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:41.074320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51929b11-ee1b-419c-b1b6-1aae80ec525a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:41.078621 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38161c-36e9-4a7d-bdd0-c5eeb66f264b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:41.109082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:41.116716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3235a8f-9722-4cc0-bbbd-ab84ffb026f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:41.117579 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3235a8f-9722-4cc0-bbbd-ab84ffb026f2 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:41.117867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3235a8f-9722-4cc0-bbbd-ab84ffb026f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:41.118147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3235a8f-9722-4cc0-bbbd-ab84ffb026f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:41.128954 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3235a8f-9722-4cc0-bbbd-ab84ffb026f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:41.137309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-d3235a8f-9722-4cc0-bbbd-ab84ffb026f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:41.137309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:41.137309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:41.137309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:41.137309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:41.137309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:41.137309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:41.137309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:41.137309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:41.137309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:41.137309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:41.137309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:41.137309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:41.137309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:41.137309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:41.137309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:41.138713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:41.138713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:41.138713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:41.138713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:41.138713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:41.138713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:41.138713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:41.138713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:41.138713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:41.138713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:41.138713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:41.138713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:41.138713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:41.138713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:41.138713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:41.138713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:41.140043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:41.140043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:41.140043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:41.140043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:41.140043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:41.140043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:41.140043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:41.140043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:41.140043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:41.140043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:41.140043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:41.140043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:41.140043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 202/400] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:14:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:41.140043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3235a8f-9722-4cc0-bbbd-ab84ffb026f2 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:41.204203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:41.211384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51929b11-ee1b-419c-b1b6-1aae80ec525a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:41.250578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ba995-a229-4a5e-be93-784d78d81d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:41.251850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ba995-a229-4a5e-be93-784d78d81d65 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:41.252330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ba995-a229-4a5e-be93-784d78d81d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:41.252800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ba995-a229-4a5e-be93-784d78d81d65 None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:41.254302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ba995-a229-4a5e-be93-784d78d81d65 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd455713ae940308a0af4cdfeb3c374)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:41.256017 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ba995-a229-4a5e-be93-784d78d81d65 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:41.256244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3235a8f-9722-4cc0-bbbd-ab84ffb026f2 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:41.258521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 199/401] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:41 2022] GET /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:41.259554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ba995-a229-4a5e-be93-784d78d81d65 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:41.302317 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab8e84-ea34-43a0-959d-1b414f53580b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:41.303277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab8e84-ea34-43a0-959d-1b414f53580b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:41.303580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab8e84-ea34-43a0-959d-1b414f53580b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:41.303878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab8e84-ea34-43a0-959d-1b414f53580b None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:41.305349 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab8e84-ea34-43a0-959d-1b414f53580b None admin] RBAC: Authorizing `identity:get_project(project_id=b83079b3240b49369bd78d73fd7c599c)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:41.307049 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab8e84-ea34-43a0-959d-1b414f53580b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:41.313935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 203/402] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:41 2022] GET /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:41.314782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab8e84-ea34-43a0-959d-1b414f53580b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:41.366620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ba995-a229-4a5e-be93-784d78d81d65 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:41.382812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:41.403399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8f316-71d0-42d1-bcd3-b67de05c3210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:41.404414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8f316-71d0-42d1-bcd3-b67de05c3210 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:41.404702 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8f316-71d0-42d1-bcd3-b67de05c3210 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:41.405123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8f316-71d0-42d1-bcd3-b67de05c3210 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:41.406012 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8f316-71d0-42d1-bcd3-b67de05c3210 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:41.406413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8f316-71d0-42d1-bcd3-b67de05c3210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:41.408015 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8f316-71d0-42d1-bcd3-b67de05c3210 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:41.417706 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 200/403] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:14:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:41.418596 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8f316-71d0-42d1-bcd3-b67de05c3210 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:41.433133 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab8e84-ea34-43a0-959d-1b414f53580b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:41.448984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:41.472221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26a8c6-b8b9-4049-983b-edf16d0fe122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:41.473341 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26a8c6-b8b9-4049-983b-edf16d0fe122 None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:41.473770 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26a8c6-b8b9-4049-983b-edf16d0fe122 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:41.474211 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26a8c6-b8b9-4049-983b-edf16d0fe122 None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374/groups/a88efa0ea0ad47a7acf0d244fc742b26/roles/fb45aabab51d4c698f2da1840ff5920d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:41.477360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26a8c6-b8b9-4049-983b-edf16d0fe122 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fd455713ae940308a0af4cdfeb3c374, group_id=a88efa0ea0ad47a7acf0d244fc742b26, role_id=fb45aabab51d4c698f2da1840ff5920d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:41.479069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26a8c6-b8b9-4049-983b-edf16d0fe122 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:41.501937 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 204/404] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Jul 12 18:14:41 2022] PUT /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374/groups/a88efa0ea0ad47a7acf0d244fc742b26/roles/fb45aabab51d4c698f2da1840ff5920d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:14:41.501937 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26a8c6-b8b9-4049-983b-edf16d0fe122 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:41.577867 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8f316-71d0-42d1-bcd3-b67de05c3210 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:41.648793 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381c25d-3d57-40b7-92d5-2e2936cb9b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:41.649724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381c25d-3d57-40b7-92d5-2e2936cb9b46 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:41.650004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381c25d-3d57-40b7-92d5-2e2936cb9b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:41.650276 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381c25d-3d57-40b7-92d5-2e2936cb9b46 None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c/groups/a88efa0ea0ad47a7acf0d244fc742b26/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:41.653407 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381c25d-3d57-40b7-92d5-2e2936cb9b46 None admin] RBAC: Authorizing `identity:create_grant(project_id=b83079b3240b49369bd78d73fd7c599c, group_id=a88efa0ea0ad47a7acf0d244fc742b26, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:41.654889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381c25d-3d57-40b7-92d5-2e2936cb9b46 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:41.684639 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 201/405] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Jul 12 18:14:41 2022] PUT /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c/groups/a88efa0ea0ad47a7acf0d244fc742b26/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:14:41.719606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26a8c6-b8b9-4049-983b-edf16d0fe122 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:41.739837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:41.763868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cb58e-7525-4f83-8fc1-977c9824f800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:41.764882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cb58e-7525-4f83-8fc1-977c9824f800 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:41.765171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cb58e-7525-4f83-8fc1-977c9824f800 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:41.765498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cb58e-7525-4f83-8fc1-977c9824f800 None admin] PATH_INFO: `/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:41.766773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cb58e-7525-4f83-8fc1-977c9824f800 None admin] RBAC: Authorizing `identity:get_group(group_id=a88efa0ea0ad47a7acf0d244fc742b26)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:41.768288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cb58e-7525-4f83-8fc1-977c9824f800 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:41.770127 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 205/406] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Jul 12 18:14:41 2022] GET /identity/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:41.776398 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381c25d-3d57-40b7-92d5-2e2936cb9b46 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:41.859140 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08e09-5e63-438a-9e6d-438c0ccbe381 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:41.859474 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08e09-5e63-438a-9e6d-438c0ccbe381 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:41.859692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08e09-5e63-438a-9e6d-438c0ccbe381 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:41.861290 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 206/407] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:14:41.867395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dec28-a411-468d-8d48-71d564c4be1c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:41.867707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dec28-a411-468d-8d48-71d564c4be1c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:41.867961 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dec28-a411-468d-8d48-71d564c4be1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:41.887506 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:41.890958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-532dec28-a411-468d-8d48-71d564c4be1c None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:41.892822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-532dec28-a411-468d-8d48-71d564c4be1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:41.902847 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381c25d-3d57-40b7-92d5-2e2936cb9b46 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:41.944219 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71490f2b-094d-4d6f-a40e-d60947a05933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:41.945762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71490f2b-094d-4d6f-a40e-d60947a05933 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:41.946052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71490f2b-094d-4d6f-a40e-d60947a05933 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:41.946329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71490f2b-094d-4d6f-a40e-d60947a05933 None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:41.948582 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71490f2b-094d-4d6f-a40e-d60947a05933 None admin] RBAC: Authorizing `identity:get_project(project_id=b83079b3240b49369bd78d73fd7c599c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:41.950417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71490f2b-094d-4d6f-a40e-d60947a05933 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:41.953275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 202/408] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:41 2022] GET /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:41.958826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71490f2b-094d-4d6f-a40e-d60947a05933 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:41.982240 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 207/409] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:42.024729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dec28-a411-468d-8d48-71d564c4be1c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:42.104217 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71490f2b-094d-4d6f-a40e-d60947a05933 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:42.145479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3178d-4e5f-441e-b3d2-f8c93299f0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:42.146371 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3178d-4e5f-441e-b3d2-f8c93299f0e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:42.146654 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3178d-4e5f-441e-b3d2-f8c93299f0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:42.147488 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3178d-4e5f-441e-b3d2-f8c93299f0e8 None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c/groups/a88efa0ea0ad47a7acf0d244fc742b26/roles/fb45aabab51d4c698f2da1840ff5920d` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:42.153959 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3178d-4e5f-441e-b3d2-f8c93299f0e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b83079b3240b49369bd78d73fd7c599c, group_id=a88efa0ea0ad47a7acf0d244fc742b26, role_id=fb45aabab51d4c698f2da1840ff5920d)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:42.155380 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3178d-4e5f-441e-b3d2-f8c93299f0e8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:42.182051 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 203/410] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Jul 12 18:14:41 2022] PUT /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c/groups/a88efa0ea0ad47a7acf0d244fc742b26/roles/fb45aabab51d4c698f2da1840ff5920d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:14:42.195651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa4645-fbfa-4bf5-b5fe-82dd27d2731d None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:42.195939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa4645-fbfa-4bf5-b5fe-82dd27d2731d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:42.196214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa4645-fbfa-4bf5-b5fe-82dd27d2731d None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:42.197909 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 204/411] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:42.212713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e79b0-c71b-43ea-a2ac-58087f2607c6 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:42.215698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e79b0-c71b-43ea-a2ac-58087f2607c6 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:42.216337 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e79b0-c71b-43ea-a2ac-58087f2607c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:42.216807 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dec28-a411-468d-8d48-71d564c4be1c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:42.237424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:42.262000 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-872e79b0-c71b-43ea-a2ac-58087f2607c6 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:42.264456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-872e79b0-c71b-43ea-a2ac-58087f2607c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:42.274437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aadc8-aee6-4be1-b244-572d21e398bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:42.275246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aadc8-aee6-4be1-b244-572d21e398bc None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:42.275531 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aadc8-aee6-4be1-b244-572d21e398bc None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:42.275839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aadc8-aee6-4be1-b244-572d21e398bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:42.285913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:42.290919 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0aadc8-aee6-4be1-b244-572d21e398bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:42.309933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-be0aadc8-aee6-4be1-b244-572d21e398bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:14:42.309933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:42.309933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:42.309933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:42.309933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:42.309933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:42.309933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:42.309933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:42.309933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:42.309933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:42.309933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:42.309933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:42.309933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:42.309933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:42.309933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:42.309933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:42.310960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:42.310960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:42.310960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:42.310960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:42.310960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:42.310960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:42.310960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:42.310960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:42.310960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:42.310960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:42.310960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:42.310960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:42.310960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:42.310960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:42.310960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:42.310960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:42.311767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:42.311767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:42.311767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:42.311767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:42.311767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:42.311767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:42.311767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:42.311767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:42.311767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:42.311767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:42.311767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:14:42.311767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:42.311767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 208/412] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:14:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:42.319918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aadc8-aee6-4be1-b244-572d21e398bc None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:42.393370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 205/413] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:42.411904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e79b0-c71b-43ea-a2ac-58087f2607c6 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:42.447996 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aadc8-aee6-4be1-b244-572d21e398bc None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:42.488358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4a86b-1600-45d6-88be-abcc78082a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:42.489135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4a86b-1600-45d6-88be-abcc78082a6c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:42.489463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4a86b-1600-45d6-88be-abcc78082a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:42.489741 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4a86b-1600-45d6-88be-abcc78082a6c None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:42.490522 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4a86b-1600-45d6-88be-abcc78082a6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:42.490832 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4a86b-1600-45d6-88be-abcc78082a6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:42.492204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4a86b-1600-45d6-88be-abcc78082a6c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:42.501673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 209/414] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:42.507098 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4a86b-1600-45d6-88be-abcc78082a6c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:42.552899 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e79b0-c71b-43ea-a2ac-58087f2607c6 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:42.585755 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:42.624443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc312436-3ded-4e98-8d0a-cbb25899ef9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:42.625284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc312436-3ded-4e98-8d0a-cbb25899ef9e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:42.625610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc312436-3ded-4e98-8d0a-cbb25899ef9e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:42.625923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc312436-3ded-4e98-8d0a-cbb25899ef9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:42.655516 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc312436-3ded-4e98-8d0a-cbb25899ef9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:42.672588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-bc312436-3ded-4e98-8d0a-cbb25899ef9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:42.672588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:42.672588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:42.672588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:42.672588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:42.672588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:42.672588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:42.672588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:42.672588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:42.672588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:42.672588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:42.672588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:42.672588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:42.672588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:42.672588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:42.672588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:42.673507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:42.673507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:42.673507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:42.673507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:42.673507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:42.673507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:42.673507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:42.673507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:42.673507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:42.673507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:42.673507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:42.673507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:42.673507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:42.673507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:42.673507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:42.673507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:42.674320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:42.674320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:42.674320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:42.674320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:42.674320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:42.674320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:42.674320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:42.674320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:42.674320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:42.674320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:42.674320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:42.674320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:42.674320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 206/415] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:42.680031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc312436-3ded-4e98-8d0a-cbb25899ef9e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:42.685450 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4a86b-1600-45d6-88be-abcc78082a6c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:42.699431 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:42.756801 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed909032-60c6-461f-828b-20aeb76b28f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:42.757896 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed909032-60c6-461f-828b-20aeb76b28f4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:42.758175 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed909032-60c6-461f-828b-20aeb76b28f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:42.758448 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed909032-60c6-461f-828b-20aeb76b28f4 None admin] PATH_INFO: `/v3/groups/11782a44a4594e009553dc77344fcd92` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:42.761441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed909032-60c6-461f-828b-20aeb76b28f4 None admin] RBAC: Authorizing `identity:get_group(group_id=11782a44a4594e009553dc77344fcd92)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:42.762892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed909032-60c6-461f-828b-20aeb76b28f4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:42.764663 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 210/416] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Jul 12 18:14:42 2022] GET /identity/v3/groups/11782a44a4594e009553dc77344fcd92 => generated 229 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:42.770816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed909032-60c6-461f-828b-20aeb76b28f4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:42.856578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc312436-3ded-4e98-8d0a-cbb25899ef9e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:42.884255 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed909032-60c6-461f-828b-20aeb76b28f4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:42.891601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:42.905462 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598cca0-8a09-4e30-a96c-574019f624fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:42.906183 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598cca0-8a09-4e30-a96c-574019f624fd None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:42.906418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598cca0-8a09-4e30-a96c-574019f624fd None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:42.906696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598cca0-8a09-4e30-a96c-574019f624fd None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:42.907453 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598cca0-8a09-4e30-a96c-574019f624fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:42.907766 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598cca0-8a09-4e30-a96c-574019f624fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:42.910167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598cca0-8a09-4e30-a96c-574019f624fd None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:42.925754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 207/417] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:42.927023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756ec88-8ad5-4353-97ee-930321b5d13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:42.927899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756ec88-8ad5-4353-97ee-930321b5d13e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:42.928742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756ec88-8ad5-4353-97ee-930321b5d13e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:42.929083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756ec88-8ad5-4353-97ee-930321b5d13e None admin] PATH_INFO: `/v3/projects/9596f7aaab1542a3ad455f9c2becff96` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:42.930377 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756ec88-8ad5-4353-97ee-930321b5d13e None admin] RBAC: Authorizing `identity:get_project(project_id=9596f7aaab1542a3ad455f9c2becff96)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:42.931924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756ec88-8ad5-4353-97ee-930321b5d13e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:42.933663 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 211/418] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:42 2022] GET /identity/v3/projects/9596f7aaab1542a3ad455f9c2becff96 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:42.934595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598cca0-8a09-4e30-a96c-574019f624fd None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:42.940174 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756ec88-8ad5-4353-97ee-930321b5d13e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:43.089475 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756ec88-8ad5-4353-97ee-930321b5d13e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:43.092068 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:43.129281 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39427537-da85-40f6-9de1-1c96f4f79178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:43.129281 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39427537-da85-40f6-9de1-1c96f4f79178 None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:43.129281 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39427537-da85-40f6-9de1-1c96f4f79178 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:43.129281 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39427537-da85-40f6-9de1-1c96f4f79178 None admin] PATH_INFO: `/v3/projects/9596f7aaab1542a3ad455f9c2becff96/groups/11782a44a4594e009553dc77344fcd92/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:43.129695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39427537-da85-40f6-9de1-1c96f4f79178 None admin] RBAC: Authorizing `identity:create_grant(project_id=9596f7aaab1542a3ad455f9c2becff96, group_id=11782a44a4594e009553dc77344fcd92, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:43.130506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39427537-da85-40f6-9de1-1c96f4f79178 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:43.146915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 212/419] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Jul 12 18:14:42 2022] PUT /identity/v3/projects/9596f7aaab1542a3ad455f9c2becff96/groups/11782a44a4594e009553dc77344fcd92/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:14:43.153958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598cca0-8a09-4e30-a96c-574019f624fd None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:43.222512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1210dd-0193-444d-8c2b-7b2b453b5690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:43.223519 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1210dd-0193-444d-8c2b-7b2b453b5690 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:43.224016 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1210dd-0193-444d-8c2b-7b2b453b5690 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:43.224489 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1210dd-0193-444d-8c2b-7b2b453b5690 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:43.322576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1210dd-0193-444d-8c2b-7b2b453b5690 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:43.324320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1210dd-0193-444d-8c2b-7b2b453b5690 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:43.407033 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:43.441647 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 208/420] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:43.447080 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39427537-da85-40f6-9de1-1c96f4f79178 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:43.494344 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:43.581646 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39427537-da85-40f6-9de1-1c96f4f79178 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:43.629045 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d60f3-8da4-4b90-bb00-aa9cc18245d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:43.629950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d60f3-8da4-4b90-bb00-aa9cc18245d8 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:43.630236 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d60f3-8da4-4b90-bb00-aa9cc18245d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:43.630513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d60f3-8da4-4b90-bb00-aa9cc18245d8 None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:43.631751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d60f3-8da4-4b90-bb00-aa9cc18245d8 None admin] RBAC: Authorizing `identity:get_project(project_id=5fd455713ae940308a0af4cdfeb3c374)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:43.633233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d60f3-8da4-4b90-bb00-aa9cc18245d8 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:43.639452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 213/421] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:43 2022] GET /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:43.640818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1210dd-0193-444d-8c2b-7b2b453b5690 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:43.747022 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1210dd-0193-444d-8c2b-7b2b453b5690 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:43.782964 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66c509-1c35-4fff-bfb7-43e779b8505f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:43.783854 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66c509-1c35-4fff-bfb7-43e779b8505f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:43.784137 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66c509-1c35-4fff-bfb7-43e779b8505f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:43.784414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66c509-1c35-4fff-bfb7-43e779b8505f None admin] PATH_INFO: `/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:43.785725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66c509-1c35-4fff-bfb7-43e779b8505f None admin] RBAC: Authorizing `identity:get_group(group_id=a88efa0ea0ad47a7acf0d244fc742b26)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:43.787227 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66c509-1c35-4fff-bfb7-43e779b8505f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:43.792834 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 209/422] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Jul 12 18:14:43 2022] GET /identity/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:43.796358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d60f3-8da4-4b90-bb00-aa9cc18245d8 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:43.929938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d60f3-8da4-4b90-bb00-aa9cc18245d8 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:43.931839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:43.978765 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fb9dc-32bd-49d8-a42e-c1b73c05fe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:43.979426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fb9dc-32bd-49d8-a42e-c1b73c05fe8f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:43.979715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fb9dc-32bd-49d8-a42e-c1b73c05fe8f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:43.979994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fb9dc-32bd-49d8-a42e-c1b73c05fe8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:43.980829 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fb9dc-32bd-49d8-a42e-c1b73c05fe8f None admin] RBAC: Adding query filter params (group.id=a88efa0ea0ad47a7acf0d244fc742b26, role.id=7ad29af380bd4e608c78235cbf9741b6, scope.project.id=5fd455713ae940308a0af4cdfeb3c374) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:43.981147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fb9dc-32bd-49d8-a42e-c1b73c05fe8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:43.982628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fb9dc-32bd-49d8-a42e-c1b73c05fe8f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:43.989147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 214/423] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Jul 12 18:14:43 2022] GET /identity/v3/role_assignments?group.id=a88efa0ea0ad47a7acf0d244fc742b26&scope.project.id=5fd455713ae940308a0af4cdfeb3c374&role.id=7ad29af380bd4e608c78235cbf9741b6 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:44.050080 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6c720-4f03-4f24-a972-24ebf93c63df None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:44.050565 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6c720-4f03-4f24-a972-24ebf93c63df None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:44.050565 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6c720-4f03-4f24-a972-24ebf93c63df None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:44.052125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 210/424] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:44.057670 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a951242-26aa-4945-b0b4-a6637e0f868c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:44.057964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a951242-26aa-4945-b0b4-a6637e0f868c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:44.058246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a951242-26aa-4945-b0b4-a6637e0f868c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:44.076261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6a951242-26aa-4945-b0b4-a6637e0f868c None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:44.077513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6a951242-26aa-4945-b0b4-a6637e0f868c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:44.145231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e792f-22bb-44a8-948d-5af2887e4598 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:44.145569 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e792f-22bb-44a8-948d-5af2887e4598 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:44.145823 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e792f-22bb-44a8-948d-5af2887e4598 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:44.147912 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 211/425] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:14:44.165236 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7299a4-b113-49d3-a580-0c3b82fd653a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:44.165563 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7299a4-b113-49d3-a580-0c3b82fd653a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:44.165817 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7299a4-b113-49d3-a580-0c3b82fd653a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:44.189703 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1e7299a4-b113-49d3-a580-0c3b82fd653a None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:44.190929 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1e7299a4-b113-49d3-a580-0c3b82fd653a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:44.206439 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 215/426] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:44.241730 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:44.247982 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a951242-26aa-4945-b0b4-a6637e0f868c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:44.306153 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 212/427] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:44.333188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7299a4-b113-49d3-a580-0c3b82fd653a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:44.364155 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:44.373814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a951242-26aa-4945-b0b4-a6637e0f868c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:44.414137 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3eb0d-21cc-4c56-bbe2-59e6464af31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:44.415226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3eb0d-21cc-4c56-bbe2-59e6464af31c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:44.415653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3eb0d-21cc-4c56-bbe2-59e6464af31c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:44.416062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3eb0d-21cc-4c56-bbe2-59e6464af31c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:44.429164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3eb0d-21cc-4c56-bbe2-59e6464af31c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:44.437653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-39d3eb0d-21cc-4c56-bbe2-59e6464af31c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:44.437653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:44.437653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:44.437653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:44.437653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:44.437653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:44.437653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:44.437653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:44.437653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:44.437653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:44.437653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:44.437653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:44.437653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:44.437653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:44.437653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:44.437653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:44.438616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:44.438616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:44.438616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:44.438616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:44.438616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:44.438616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:44.438616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:44.438616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:44.438616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:44.438616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:44.438616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:44.438616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:44.438616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:44.438616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:44.438616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:44.438616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:44.439425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:44.439425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:44.439425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:44.439425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:44.439425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:44.439425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:44.439425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:44.439425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:44.439425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:44.439425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:44.439425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:44.439425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:44.442073 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 216/428] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:14:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:44.449597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3eb0d-21cc-4c56-bbe2-59e6464af31c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:44.468337 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7299a4-b113-49d3-a580-0c3b82fd653a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:44.517230 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38938b9-60ec-446e-b66e-095d56ab4bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:44.518398 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38938b9-60ec-446e-b66e-095d56ab4bda None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:44.518691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38938b9-60ec-446e-b66e-095d56ab4bda None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:44.518968 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38938b9-60ec-446e-b66e-095d56ab4bda None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:44.535479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38938b9-60ec-446e-b66e-095d56ab4bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:44.545554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-f38938b9-60ec-446e-b66e-095d56ab4bda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:44.545554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:44.545554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:44.545554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:44.545554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:44.545554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:44.545554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:44.545554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:44.545554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:44.545554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:44.545554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:44.545554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:44.545554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:44.545554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:44.545554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:44.545554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:44.546738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:44.546738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:44.546738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:44.546738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:44.546738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:44.546738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:44.546738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:44.546738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:44.546738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:44.546738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:44.546738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:44.546738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:44.546738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:44.546738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:44.546738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:44.546738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:44.547684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:44.547684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:44.547684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:44.547684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:44.547684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:44.547684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:44.547684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:44.547684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:44.547684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:44.547684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:44.547684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:14:44.547684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:44.550277 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 213/429] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:44.557286 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38938b9-60ec-446e-b66e-095d56ab4bda None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:44.592917 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3eb0d-21cc-4c56-bbe2-59e6464af31c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:44.602061 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:44.638753 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f6927-6b81-4bc3-b68b-061de2ca67d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:44.639418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f6927-6b81-4bc3-b68b-061de2ca67d4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:44.639755 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f6927-6b81-4bc3-b68b-061de2ca67d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:44.640214 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f6927-6b81-4bc3-b68b-061de2ca67d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:44.641450 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f6927-6b81-4bc3-b68b-061de2ca67d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:44.641766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f6927-6b81-4bc3-b68b-061de2ca67d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:44.643411 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f6927-6b81-4bc3-b68b-061de2ca67d4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:44.656685 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 217/430] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:14:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:44.663505 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f6927-6b81-4bc3-b68b-061de2ca67d4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:44.693426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:44.708461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38938b9-60ec-446e-b66e-095d56ab4bda None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:44.758705 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811566ba-3526-4d60-b781-55b266112ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:44.759385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811566ba-3526-4d60-b781-55b266112ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:44.759667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811566ba-3526-4d60-b781-55b266112ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:44.759943 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811566ba-3526-4d60-b781-55b266112ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:44.760708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811566ba-3526-4d60-b781-55b266112ef2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:44.761025 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811566ba-3526-4d60-b781-55b266112ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:44.762518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811566ba-3526-4d60-b781-55b266112ef2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:44.778465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 214/431] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:14:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:44.779857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811566ba-3526-4d60-b781-55b266112ef2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:44.805695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f6927-6b81-4bc3-b68b-061de2ca67d4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:44.862466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd7b1d-c4a3-43b8-8c91-277401cc6d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:44.863283 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd7b1d-c4a3-43b8-8c91-277401cc6d8e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:44.863568 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd7b1d-c4a3-43b8-8c91-277401cc6d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:44.863989 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd7b1d-c4a3-43b8-8c91-277401cc6d8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:44.901098 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:44.914651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811566ba-3526-4d60-b781-55b266112ef2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:44.942637 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd7b1d-c4a3-43b8-8c91-277401cc6d8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:44.944673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd7b1d-c4a3-43b8-8c91-277401cc6d8e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:44.955200 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a71c1-8244-42c3-b5b6-9d53d5f13aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:44.955852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a71c1-8244-42c3-b5b6-9d53d5f13aff None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:44.956434 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a71c1-8244-42c3-b5b6-9d53d5f13aff None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:44.956861 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a71c1-8244-42c3-b5b6-9d53d5f13aff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:44.963542 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:45.030319 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a71c1-8244-42c3-b5b6-9d53d5f13aff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:45.031776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a71c1-8244-42c3-b5b6-9d53d5f13aff None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:45.055019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 218/432] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:45.056579 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50f4d7-bb93-4f9e-a4fc-65dc1921e7eb None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:45.056868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50f4d7-bb93-4f9e-a4fc-65dc1921e7eb None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:45.057155 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50f4d7-bb93-4f9e-a4fc-65dc1921e7eb None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:45.058568 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 219/433] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:45.063056 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50f4d7-bb93-4f9e-a4fc-65dc1921e7eb None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:45.128123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:45.143517 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 215/434] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:45.145169 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f93a7-85e1-4475-88dc-e8fc476a4587 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:45.145492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f93a7-85e1-4475-88dc-e8fc476a4587 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:45.145765 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f93a7-85e1-4475-88dc-e8fc476a4587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:45.164083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7e9f93a7-85e1-4475-88dc-e8fc476a4587 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:45.165486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7e9f93a7-85e1-4475-88dc-e8fc476a4587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:45.175397 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50f4d7-bb93-4f9e-a4fc-65dc1921e7eb None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:45.194646 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:45.214360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b436a-563f-41ac-989c-d466308bb5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:45.215221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b436a-563f-41ac-989c-d466308bb5da None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:45.215501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b436a-563f-41ac-989c-d466308bb5da None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:45.215772 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b436a-563f-41ac-989c-d466308bb5da None admin] PATH_INFO: `/v3/projects/5fd455713ae940308a0af4cdfeb3c374` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:45.216982 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b436a-563f-41ac-989c-d466308bb5da None admin] RBAC: Authorizing `identity:get_project(project_id=5fd455713ae940308a0af4cdfeb3c374)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:45.218445 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b436a-563f-41ac-989c-d466308bb5da None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:45.220140 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 220/435] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:45 2022] GET /identity/v3/projects/5fd455713ae940308a0af4cdfeb3c374 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:45.225756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b436a-563f-41ac-989c-d466308bb5da None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:45.236244 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 216/436] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:45.237360 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f93a7-85e1-4475-88dc-e8fc476a4587 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:45.342662 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b436a-563f-41ac-989c-d466308bb5da None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:45.351846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f93a7-85e1-4475-88dc-e8fc476a4587 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:45.370509 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:45.380852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a98c16-9999-433c-81ae-4d797716ff9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:45.381711 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a98c16-9999-433c-81ae-4d797716ff9e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:45.381992 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a98c16-9999-433c-81ae-4d797716ff9e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:45.382265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a98c16-9999-433c-81ae-4d797716ff9e None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:45.383450 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a98c16-9999-433c-81ae-4d797716ff9e None admin] RBAC: Authorizing `identity:get_project(project_id=b83079b3240b49369bd78d73fd7c599c)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:45.384901 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a98c16-9999-433c-81ae-4d797716ff9e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:45.386615 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 221/437] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:45 2022] GET /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:45.387510 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a98c16-9999-433c-81ae-4d797716ff9e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:45.392507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dccf06-26a1-43cf-a2a4-7732050e73a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:45.393478 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dccf06-26a1-43cf-a2a4-7732050e73a2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:45.393757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dccf06-26a1-43cf-a2a4-7732050e73a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:45.394026 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dccf06-26a1-43cf-a2a4-7732050e73a2 None admin] PATH_INFO: `/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:45.395303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dccf06-26a1-43cf-a2a4-7732050e73a2 None admin] RBAC: Authorizing `identity:get_group(group_id=a88efa0ea0ad47a7acf0d244fc742b26)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:45.396815 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dccf06-26a1-43cf-a2a4-7732050e73a2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:45.398703 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 217/438] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Jul 12 18:14:45 2022] GET /identity/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:45.403832 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dccf06-26a1-43cf-a2a4-7732050e73a2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:45.451037 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:45.498198 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a98c16-9999-433c-81ae-4d797716ff9e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:45.511331 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dccf06-26a1-43cf-a2a4-7732050e73a2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:45.533960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048c37d-b614-4839-96c2-a29b157e211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:45.534771 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048c37d-b614-4839-96c2-a29b157e211b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:45.535050 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048c37d-b614-4839-96c2-a29b157e211b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:45.535386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048c37d-b614-4839-96c2-a29b157e211b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:45.547616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048c37d-b614-4839-96c2-a29b157e211b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:45.548198 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883186a1-79d0-474f-87ed-e9088e580798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:45.549040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883186a1-79d0-474f-87ed-e9088e580798 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:45.549341 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883186a1-79d0-474f-87ed-e9088e580798 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:45.549614 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883186a1-79d0-474f-87ed-e9088e580798 None admin] PATH_INFO: `/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:45.550766 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883186a1-79d0-474f-87ed-e9088e580798 None admin] RBAC: Authorizing `identity:get_group(group_id=a88efa0ea0ad47a7acf0d244fc742b26)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:45.552219 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883186a1-79d0-474f-87ed-e9088e580798 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:45.558907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 218/439] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Jul 12 18:14:45 2022] GET /identity/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:45.558907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883186a1-79d0-474f-87ed-e9088e580798 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:45.559100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-e048c37d-b614-4839-96c2-a29b157e211b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:45.559100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:45.559100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:45.559100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:45.559100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:45.559100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:45.559100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:45.559100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:45.559100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:45.559100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:45.559100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:45.559100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:45.559100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:45.559100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:45.559100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:45.559100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:45.559924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:45.559924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:45.559924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:45.559924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:45.559924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:45.559924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:45.559924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:45.559924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:45.559924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:45.559924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:45.559924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:45.559924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:45.559924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:45.559924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:45.559924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:45.559924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:45.560751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:45.560751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:45.560751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:45.560751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:45.560751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:45.560751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:45.560751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:45.560751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:45.560751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:45.560751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:45.560751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:45.560751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:45.560751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 222/440] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:14:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:45.560751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048c37d-b614-4839-96c2-a29b157e211b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:45.623233 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:45.672253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048c37d-b614-4839-96c2-a29b157e211b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:45.672916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883186a1-79d0-474f-87ed-e9088e580798 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:45.688469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:45.710044 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d41ff-7806-46c2-a8c6-9627b7c2e29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:45.710722 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d41ff-7806-46c2-a8c6-9627b7c2e29f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:45.710998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d41ff-7806-46c2-a8c6-9627b7c2e29f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:45.711266 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d41ff-7806-46c2-a8c6-9627b7c2e29f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:45.712087 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c742c-a481-465c-ac6f-87373b698c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:45.712199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d41ff-7806-46c2-a8c6-9627b7c2e29f None admin] RBAC: Adding query filter params (group.id=a88efa0ea0ad47a7acf0d244fc742b26, role.id=fb45aabab51d4c698f2da1840ff5920d, scope.project.id=5fd455713ae940308a0af4cdfeb3c374) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:45.712400 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d41ff-7806-46c2-a8c6-9627b7c2e29f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:45.712739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c742c-a481-465c-ac6f-87373b698c1e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:45.713024 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c742c-a481-465c-ac6f-87373b698c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:45.713326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c742c-a481-465c-ac6f-87373b698c1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:45.713864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d41ff-7806-46c2-a8c6-9627b7c2e29f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:45.714155 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c742c-a481-465c-ac6f-87373b698c1e None admin] RBAC: Adding query filter params (group.id=a88efa0ea0ad47a7acf0d244fc742b26, role.id=7ad29af380bd4e608c78235cbf9741b6, scope.project.id=b83079b3240b49369bd78d73fd7c599c) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:45.714470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c742c-a481-465c-ac6f-87373b698c1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:45.715898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c742c-a481-465c-ac6f-87373b698c1e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:45.720073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 219/441] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Jul 12 18:14:45 2022] GET /identity/v3/role_assignments?group.id=a88efa0ea0ad47a7acf0d244fc742b26&scope.project.id=5fd455713ae940308a0af4cdfeb3c374&role.id=fb45aabab51d4c698f2da1840ff5920d => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:45.720581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d41ff-7806-46c2-a8c6-9627b7c2e29f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:45.728165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 223/442] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Jul 12 18:14:45 2022] GET /identity/v3/role_assignments?group.id=a88efa0ea0ad47a7acf0d244fc742b26&scope.project.id=b83079b3240b49369bd78d73fd7c599c&role.id=7ad29af380bd4e608c78235cbf9741b6 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:45.735098 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afac36-e592-4fa4-9ea0-735e901095f6 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:45.735617 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afac36-e592-4fa4-9ea0-735e901095f6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:45.735904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afac36-e592-4fa4-9ea0-735e901095f6 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:45.737574 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 224/443] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:14:45.743608 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6868c-0570-4fb5-aec5-b43283043971 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:45.743921 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6868c-0570-4fb5-aec5-b43283043971 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:45.744163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6868c-0570-4fb5-aec5-b43283043971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:45.763078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-f2c6868c-0570-4fb5-aec5-b43283043971 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:45.764314 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f2c6868c-0570-4fb5-aec5-b43283043971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:45.852393 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d41ff-7806-46c2-a8c6-9627b7c2e29f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:45.854882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 225/444] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:45.874585 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:45.880932 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6868c-0570-4fb5-aec5-b43283043971 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:45.906922 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bb6b5-2042-4f76-aeb0-19e05bbfb622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:45.907880 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bb6b5-2042-4f76-aeb0-19e05bbfb622 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:45.908170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bb6b5-2042-4f76-aeb0-19e05bbfb622 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:45.908455 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bb6b5-2042-4f76-aeb0-19e05bbfb622 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:45.909237 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bb6b5-2042-4f76-aeb0-19e05bbfb622 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:45.909623 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bb6b5-2042-4f76-aeb0-19e05bbfb622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:45.912209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bb6b5-2042-4f76-aeb0-19e05bbfb622 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:45.925883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 220/445] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:14:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:45.934377 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bb6b5-2042-4f76-aeb0-19e05bbfb622 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:46.020665 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6868c-0570-4fb5-aec5-b43283043971 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:46.031257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:46.062065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bb6b5-2042-4f76-aeb0-19e05bbfb622 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:46.064891 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce43a9-eb65-4aa1-b9b1-eecdd217c61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:46.065746 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce43a9-eb65-4aa1-b9b1-eecdd217c61f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:46.066035 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce43a9-eb65-4aa1-b9b1-eecdd217c61f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:46.067105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce43a9-eb65-4aa1-b9b1-eecdd217c61f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:46.081180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce43a9-eb65-4aa1-b9b1-eecdd217c61f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:46.088427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-13ce43a9-eb65-4aa1-b9b1-eecdd217c61f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:14:46.088427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:46.088427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:46.088427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:46.088427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:46.088427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:46.088427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:46.088427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:46.088427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:46.088427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:46.088427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:46.088427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:46.088427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:46.088427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:46.088427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:46.088427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:46.089383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:46.089383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:46.089383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:46.089383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:46.089383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:46.089383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:46.089383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:46.089383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:46.089383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:46.089383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:46.089383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:46.089383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:46.089383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:46.089383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:46.089383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:46.089383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:46.090199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:46.090199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:46.090199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:46.090199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:46.090199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:46.090199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:46.090199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:46.090199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:46.090199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:46.090199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:46.090199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:14:46.090199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:46.090199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 226/446] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:14:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:46.097071 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce43a9-eb65-4aa1-b9b1-eecdd217c61f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:46.106479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d68787-2986-4634-9ca0-df283947f638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:46.107336 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d68787-2986-4634-9ca0-df283947f638 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:46.107618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d68787-2986-4634-9ca0-df283947f638 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:46.107892 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d68787-2986-4634-9ca0-df283947f638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:46.168085 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:46.194933 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d68787-2986-4634-9ca0-df283947f638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:46.196332 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d68787-2986-4634-9ca0-df283947f638 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:46.219887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce43a9-eb65-4aa1-b9b1-eecdd217c61f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:46.261443 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252c997-74f8-4a7e-9cb1-44db875248d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:46.262489 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252c997-74f8-4a7e-9cb1-44db875248d2 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:46.262977 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252c997-74f8-4a7e-9cb1-44db875248d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:46.263315 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252c997-74f8-4a7e-9cb1-44db875248d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:46.264129 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252c997-74f8-4a7e-9cb1-44db875248d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:46.264504 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252c997-74f8-4a7e-9cb1-44db875248d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:46.266035 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252c997-74f8-4a7e-9cb1-44db875248d2 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:46.278057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 227/447] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:46.280505 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252c997-74f8-4a7e-9cb1-44db875248d2 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:46.314046 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 221/448] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:46.319493 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:46.321127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d68787-2986-4634-9ca0-df283947f638 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:46.389073 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252c997-74f8-4a7e-9cb1-44db875248d2 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:46.400614 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:46.419653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d68787-2986-4634-9ca0-df283947f638 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:46.422353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca22fc-fd49-4565-870c-d220718f76b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:46.422998 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca22fc-fd49-4565-870c-d220718f76b9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:46.423283 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca22fc-fd49-4565-870c-d220718f76b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:46.423562 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca22fc-fd49-4565-870c-d220718f76b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:46.453434 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c2936-986e-417c-99e6-2c577c7a7de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:46.454244 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c2936-986e-417c-99e6-2c577c7a7de4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:46.454507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c2936-986e-417c-99e6-2c577c7a7de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:46.454782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c2936-986e-417c-99e6-2c577c7a7de4 None admin] PATH_INFO: `/v3/projects/b83079b3240b49369bd78d73fd7c599c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:46.455963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c2936-986e-417c-99e6-2c577c7a7de4 None admin] RBAC: Authorizing `identity:get_project(project_id=b83079b3240b49369bd78d73fd7c599c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:46.457472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c2936-986e-417c-99e6-2c577c7a7de4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:46.459168 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 222/449] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:46 2022] GET /identity/v3/projects/b83079b3240b49369bd78d73fd7c599c => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:46.464896 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c2936-986e-417c-99e6-2c577c7a7de4 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:46.491473 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca22fc-fd49-4565-870c-d220718f76b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:46.492932 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca22fc-fd49-4565-870c-d220718f76b9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:46.521909 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:46.565429 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c2936-986e-417c-99e6-2c577c7a7de4 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:46.593725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 228/450] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 18:14:46.599139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca22fc-fd49-4565-870c-d220718f76b9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:46.601013 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbb908-7c8b-4a40-b73e-a44992919754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:46.601889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbb908-7c8b-4a40-b73e-a44992919754 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:46.602165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbb908-7c8b-4a40-b73e-a44992919754 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:46.602433 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbb908-7c8b-4a40-b73e-a44992919754 None admin] PATH_INFO: `/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:46.603600 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbb908-7c8b-4a40-b73e-a44992919754 None admin] RBAC: Authorizing `identity:get_group(group_id=a88efa0ea0ad47a7acf0d244fc742b26)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:46.605042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbb908-7c8b-4a40-b73e-a44992919754 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:46.606743 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 223/451] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Jul 12 18:14:46 2022] GET /identity/v3/groups/a88efa0ea0ad47a7acf0d244fc742b26 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:46.612161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbb908-7c8b-4a40-b73e-a44992919754 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:46.630028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:46.700947 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca22fc-fd49-4565-870c-d220718f76b9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:46.710844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbb908-7c8b-4a40-b73e-a44992919754 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:46.729898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:46.736010 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cb7a7-8453-4642-8741-9d8a0521351c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:46.736864 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb7a7-8453-4642-8741-9d8a0521351c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:46.737149 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb7a7-8453-4642-8741-9d8a0521351c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:46.737455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb7a7-8453-4642-8741-9d8a0521351c None admin] PATH_INFO: `/v3/projects/9596f7aaab1542a3ad455f9c2becff96` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:46.738648 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cb7a7-8453-4642-8741-9d8a0521351c None admin] RBAC: Authorizing `identity:get_project(project_id=9596f7aaab1542a3ad455f9c2becff96)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:46.740085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cb7a7-8453-4642-8741-9d8a0521351c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:46.742343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 229/452] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:14:46 2022] GET /identity/v3/projects/9596f7aaab1542a3ad455f9c2becff96 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:46.744927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7eb0b-9eac-4963-86f3-991ed3c3ea8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:46.745604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7eb0b-9eac-4963-86f3-991ed3c3ea8c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:46.745883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7eb0b-9eac-4963-86f3-991ed3c3ea8c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:46.746155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7eb0b-9eac-4963-86f3-991ed3c3ea8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:46.746974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7eb0b-9eac-4963-86f3-991ed3c3ea8c None admin] RBAC: Adding query filter params (group.id=a88efa0ea0ad47a7acf0d244fc742b26, role.id=fb45aabab51d4c698f2da1840ff5920d, scope.project.id=b83079b3240b49369bd78d73fd7c599c) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:46.747279 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7eb0b-9eac-4963-86f3-991ed3c3ea8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:46.747636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cb7a7-8453-4642-8741-9d8a0521351c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:46.748695 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7eb0b-9eac-4963-86f3-991ed3c3ea8c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:46.754654 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 224/453] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Jul 12 18:14:46 2022] GET /identity/v3/role_assignments?group.id=a88efa0ea0ad47a7acf0d244fc742b26&scope.project.id=b83079b3240b49369bd78d73fd7c599c&role.id=fb45aabab51d4c698f2da1840ff5920d => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:46.849415 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cb7a7-8453-4642-8741-9d8a0521351c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:46.884891 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20834582-dd66-4402-8967-44df7368e046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:46.885781 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20834582-dd66-4402-8967-44df7368e046 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:46.886062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20834582-dd66-4402-8967-44df7368e046 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:46.886333 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20834582-dd66-4402-8967-44df7368e046 None admin] PATH_INFO: `/v3/groups/11782a44a4594e009553dc77344fcd92` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:46.887549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20834582-dd66-4402-8967-44df7368e046 None admin] RBAC: Authorizing `identity:get_group(group_id=11782a44a4594e009553dc77344fcd92)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:46.889014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20834582-dd66-4402-8967-44df7368e046 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:46.890675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 230/454] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Jul 12 18:14:46 2022] GET /identity/v3/groups/11782a44a4594e009553dc77344fcd92 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:46.896507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7eb0b-9eac-4963-86f3-991ed3c3ea8c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:46.978889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:46.998412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7eb0b-9eac-4963-86f3-991ed3c3ea8c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:47.031417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2c532-e1e0-462c-b04c-0e0a9a46aabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:47.032065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2c532-e1e0-462c-b04c-0e0a9a46aabf None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:47.032346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2c532-e1e0-462c-b04c-0e0a9a46aabf None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:47.032616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2c532-e1e0-462c-b04c-0e0a9a46aabf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:47.033469 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2c532-e1e0-462c-b04c-0e0a9a46aabf None admin] RBAC: Adding query filter params (group.id=11782a44a4594e009553dc77344fcd92, role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.project.id=9596f7aaab1542a3ad455f9c2becff96) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:47.033779 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2c532-e1e0-462c-b04c-0e0a9a46aabf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:47.035446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2c532-e1e0-462c-b04c-0e0a9a46aabf None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:47.041988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 225/455] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Jul 12 18:14:46 2022] GET /identity/v3/role_assignments?group.id=11782a44a4594e009553dc77344fcd92&scope.project.id=9596f7aaab1542a3ad455f9c2becff96&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:49.436943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085e0d1-29be-4839-a5ba-4c9696db4dba None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:49.438027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085e0d1-29be-4839-a5ba-4c9696db4dba None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:49.438517 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085e0d1-29be-4839-a5ba-4c9696db4dba None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:49.440332 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 231/456] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:49.446604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccaf02f-67e1-4d14-a9c4-e0c26bd28bce None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:49.447456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccaf02f-67e1-4d14-a9c4-e0c26bd28bce None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:49.447935 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccaf02f-67e1-4d14-a9c4-e0c26bd28bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:49.471275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-0ccaf02f-67e1-4d14-a9c4-e0c26bd28bce None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:49.472844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0ccaf02f-67e1-4d14-a9c4-e0c26bd28bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:49.563865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 226/457] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:49.613299 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085e0d1-29be-4839-a5ba-4c9696db4dba None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:49.689244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:49.741846 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085e0d1-29be-4839-a5ba-4c9696db4dba None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:49.775265 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9d7c8-c3e4-4741-8441-dec02009906c None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:49.775571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9d7c8-c3e4-4741-8441-dec02009906c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:49.775831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9d7c8-c3e4-4741-8441-dec02009906c None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:49.777470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 227/458] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:49.783100 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d780461-2ec3-4fa1-8a98-a0b95f7bd010 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:49.783602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d780461-2ec3-4fa1-8a98-a0b95f7bd010 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:49.784060 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d780461-2ec3-4fa1-8a98-a0b95f7bd010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:49.790070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7381ce-ab4e-41a8-834d-359dc371b31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:49.790867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7381ce-ab4e-41a8-834d-359dc371b31d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:49.791151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7381ce-ab4e-41a8-834d-359dc371b31d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:49.791430 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7381ce-ab4e-41a8-834d-359dc371b31d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:49.803072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7381ce-ab4e-41a8-834d-359dc371b31d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:49.804598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7381ce-ab4e-41a8-834d-359dc371b31d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:49.822932 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1d780461-2ec3-4fa1-8a98-a0b95f7bd010 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:49.824664 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1d780461-2ec3-4fa1-8a98-a0b95f7bd010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:49.825360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-4b7381ce-ab4e-41a8-834d-359dc371b31d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:49.825360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:49.825360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:49.825360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:49.825360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:49.825360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:49.825360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:49.825360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:49.825360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:49.825360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:49.825360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:49.825360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:49.825360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:14:49.825360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:14:49.825360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:14:49.826388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:14:49.826388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:49.826388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:49.826388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:49.826388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:49.826388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:49.826388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:49.826388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:49.826388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:49.826388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:49.826388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:49.826388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:49.826388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:49.826388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:49.826388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:49.826388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:49.826388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:49.827419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:14:49.827419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:14:49.827419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:49.827419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:49.829338 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 232/459] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:49.840963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7381ce-ab4e-41a8-834d-359dc371b31d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:49.918091 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 228/460] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:49.919872 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0215c1e-2062-4732-8812-793980415865 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:49.920365 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0215c1e-2062-4732-8812-793980415865 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:49.920820 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0215c1e-2062-4732-8812-793980415865 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:49.922518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 229/461] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:49.927223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95659c-ffb0-401b-9cd9-021dcd84b9cd None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:49.927710 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95659c-ffb0-401b-9cd9-021dcd84b9cd None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:49.928785 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95659c-ffb0-401b-9cd9-021dcd84b9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:49.936530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:49.949831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6b95659c-ffb0-401b-9cd9-021dcd84b9cd None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:49.951268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6b95659c-ffb0-401b-9cd9-021dcd84b9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:49.983038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7381ce-ab4e-41a8-834d-359dc371b31d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:50.003706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:50.023607 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367e975-c22a-4414-84fe-07ffb03fb01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:50.024602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367e975-c22a-4414-84fe-07ffb03fb01d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:50.025122 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367e975-c22a-4414-84fe-07ffb03fb01d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:50.025563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367e975-c22a-4414-84fe-07ffb03fb01d None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:50.026423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367e975-c22a-4414-84fe-07ffb03fb01d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:50.026897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367e975-c22a-4414-84fe-07ffb03fb01d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:50.028427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367e975-c22a-4414-84fe-07ffb03fb01d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:50.037324 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 230/462] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:50.039067 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95659c-ffb0-401b-9cd9-021dcd84b9cd None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:50.040960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 233/463] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:50.049163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367e975-c22a-4414-84fe-07ffb03fb01d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:50.155486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95659c-ffb0-401b-9cd9-021dcd84b9cd None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:50.157695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367e975-c22a-4414-84fe-07ffb03fb01d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:50.192245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d534240-51dc-4f14-9a20-1d33a9138c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:50.193332 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d534240-51dc-4f14-9a20-1d33a9138c01 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:50.193732 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905cb47-8cb9-45d2-9fff-539e96c75c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:50.194041 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d534240-51dc-4f14-9a20-1d33a9138c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:50.194396 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905cb47-8cb9-45d2-9fff-539e96c75c17 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:50.194655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d534240-51dc-4f14-9a20-1d33a9138c01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:50.194760 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905cb47-8cb9-45d2-9fff-539e96c75c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:50.194940 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905cb47-8cb9-45d2-9fff-539e96c75c17 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:50.195653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905cb47-8cb9-45d2-9fff-539e96c75c17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:50.197191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:50.197402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905cb47-8cb9-45d2-9fff-539e96c75c17 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:50.207416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d534240-51dc-4f14-9a20-1d33a9138c01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:50.209799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d534240-51dc-4f14-9a20-1d33a9138c01 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:50.220644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 234/464] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Jul 12 18:14:50 2022] POST /identity/v3/users => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:14:50.221569 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905cb47-8cb9-45d2-9fff-539e96c75c17 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:50.230555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-5d534240-51dc-4f14-9a20-1d33a9138c01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:50.230555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:50.230555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:50.230555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:50.230555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:50.230555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:50.230555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:50.230555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:50.230555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:50.230555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:50.230555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:50.230555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:50.230555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:14:50.230555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:14:50.230555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:14:50.231494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:14:50.231494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:50.231494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:50.231494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:50.231494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:50.231494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:50.231494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:50.231494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:50.231494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:50.231494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:50.231494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:50.231494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:50.231494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:50.231494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:50.231494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:50.231494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:50.231494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:50.232334 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:14:50.232334 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:14:50.232334 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:50.232334 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:50.234873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 231/465] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:50.236527 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e665ef-7cdd-4217-abb7-b74785ecd93f None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:50.237003 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e665ef-7cdd-4217-abb7-b74785ecd93f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:50.237470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e665ef-7cdd-4217-abb7-b74785ecd93f None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:50.239391 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 232/466] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:50.241567 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e665ef-7cdd-4217-abb7-b74785ecd93f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:50.273536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:50.369034 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905cb47-8cb9-45d2-9fff-539e96c75c17 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:50.390368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e665ef-7cdd-4217-abb7-b74785ecd93f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:50.410859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e8c42-2140-43bb-849e-8fdaa2bd3344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:50.411663 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e8c42-2140-43bb-849e-8fdaa2bd3344 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:50.411945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e8c42-2140-43bb-849e-8fdaa2bd3344 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:50.412750 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e8c42-2140-43bb-849e-8fdaa2bd3344 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:50.426916 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e8c42-2140-43bb-849e-8fdaa2bd3344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:50.429164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e8c42-2140-43bb-849e-8fdaa2bd3344 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:50.433287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab114ec-667a-4427-9867-99c54c1ec8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:50.433955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab114ec-667a-4427-9867-99c54c1ec8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:50.434241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab114ec-667a-4427-9867-99c54c1ec8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:50.434520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab114ec-667a-4427-9867-99c54c1ec8d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:50.435250 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab114ec-667a-4427-9867-99c54c1ec8d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:50.435976 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab114ec-667a-4427-9867-99c54c1ec8d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:50.438163 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab114ec-667a-4427-9867-99c54c1ec8d3 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:50.449001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-d77e8c42-2140-43bb-849e-8fdaa2bd3344 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:50.449001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:50.449001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:50.449001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:50.449001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:50.449001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:50.449001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:50.449001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:50.449001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:50.449001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:50.449001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:50.449001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:50.449001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:14:50.449001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:14:50.449001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:14:50.450509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:14:50.450509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:50.450509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:50.450509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:50.450509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:50.450509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:50.450509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:50.450509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:50.450509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:50.450509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:50.450509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:50.450509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:50.450509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:50.450509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:50.450509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:50.450509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:50.450509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:50.451337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:14:50.451337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:14:50.451337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:50.451337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:50.451337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 235/467] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:50.451337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee6992-b11e-4d21-89a1-62ba6a6eeb01 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:50.451337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee6992-b11e-4d21-89a1-62ba6a6eeb01 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:50.451337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee6992-b11e-4d21-89a1-62ba6a6eeb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:50.457861 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 233/468] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:50.464232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab114ec-667a-4427-9867-99c54c1ec8d3 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:50.471575 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-94ee6992-b11e-4d21-89a1-62ba6a6eeb01 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:50.472821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-94ee6992-b11e-4d21-89a1-62ba6a6eeb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:50.527841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:50.555347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 236/469] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:50.556645 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee6992-b11e-4d21-89a1-62ba6a6eeb01 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:50.587457 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:50.598166 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab114ec-667a-4427-9867-99c54c1ec8d3 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:50.635946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcc956-e936-4ada-9642-358b930668b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:50.636619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcc956-e936-4ada-9642-358b930668b6 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:50.636946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcc956-e936-4ada-9642-358b930668b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:50.637231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcc956-e936-4ada-9642-358b930668b6 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:50.638115 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bcc956-e936-4ada-9642-358b930668b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:50.639685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bcc956-e936-4ada-9642-358b930668b6 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:50.669359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 234/470] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Jul 12 18:14:50 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:14:50.670843 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcc956-e936-4ada-9642-358b930668b6 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:50.716024 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee6992-b11e-4d21-89a1-62ba6a6eeb01 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:50.787283 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da95a69-f2f2-49e1-bba7-ace4237ca9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:50.788430 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da95a69-f2f2-49e1-bba7-ace4237ca9ad None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:50.788952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da95a69-f2f2-49e1-bba7-ace4237ca9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:50.789537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da95a69-f2f2-49e1-bba7-ace4237ca9ad None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:50.790472 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da95a69-f2f2-49e1-bba7-ace4237ca9ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:50.791895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da95a69-f2f2-49e1-bba7-ace4237ca9ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:50.794236 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da95a69-f2f2-49e1-bba7-ace4237ca9ad None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:50.821664 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 237/471] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:50.829066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da95a69-f2f2-49e1-bba7-ace4237ca9ad None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:50.868838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcc956-e936-4ada-9642-358b930668b6 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:50.870942 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:50.917021 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f2ee8-3c1d-4c88-945b-0e327b113293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:50.918196 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f2ee8-3c1d-4c88-945b-0e327b113293 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:50.918722 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f2ee8-3c1d-4c88-945b-0e327b113293 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:50.919232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f2ee8-3c1d-4c88-945b-0e327b113293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:50.932774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f2ee8-3c1d-4c88-945b-0e327b113293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:50.934576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f2ee8-3c1d-4c88-945b-0e327b113293 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:50.937630 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:50.954330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-ba8f2ee8-3c1d-4c88-945b-0e327b113293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:50.954330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:50.954330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:50.954330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:50.954330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:50.954330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:50.954330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:50.954330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:50.954330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:50.954330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:50.954330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:50.954330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:50.954330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:14:50.954330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:14:50.954330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:14:50.955242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:14:50.955242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:50.955242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:50.955242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:50.955242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:50.955242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:50.955242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:50.955242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:50.955242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:50.955242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:50.955242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:50.955242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:50.955242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:50.955242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:50.955242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:50.955242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:50.955242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:50.956123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:14:50.956123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:14:50.956123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:50.956123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:50.958509 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 235/472] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:50.965065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f2ee8-3c1d-4c88-945b-0e327b113293 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:50.968325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da95a69-f2f2-49e1-bba7-ace4237ca9ad None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:51.018103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f98e5-1400-46a7-8bfe-27d8df6d54a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:51.019952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f98e5-1400-46a7-8bfe-27d8df6d54a0 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:51.019952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f98e5-1400-46a7-8bfe-27d8df6d54a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:51.019952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f98e5-1400-46a7-8bfe-27d8df6d54a0 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:51.020482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f98e5-1400-46a7-8bfe-27d8df6d54a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:51.022856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f98e5-1400-46a7-8bfe-27d8df6d54a0 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:51.060963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 238/473] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Jul 12 18:14:50 2022] POST /identity/v3/users => generated 248 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:14:51.062339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af72fa-aa81-410b-9d3f-b5085dcd8494 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:51.062629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af72fa-aa81-410b-9d3f-b5085dcd8494 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:51.062924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af72fa-aa81-410b-9d3f-b5085dcd8494 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:51.064172 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 239/474] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:51.070768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fca2e-50bf-45f6-9145-3be09182bcf6 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:51.071093 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fca2e-50bf-45f6-9145-3be09182bcf6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:51.071334 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fca2e-50bf-45f6-9145-3be09182bcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:51.087600 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f2ee8-3c1d-4c88-945b-0e327b113293 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:51.106477 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-bf1fca2e-50bf-45f6-9145-3be09182bcf6 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:51.107707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bf1fca2e-50bf-45f6-9145-3be09182bcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:51.126236 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec96d-88f5-4e4c-b633-103b245bfb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:51.126913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec96d-88f5-4e4c-b633-103b245bfb5a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:51.127203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec96d-88f5-4e4c-b633-103b245bfb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:51.127903 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec96d-88f5-4e4c-b633-103b245bfb5a None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:51.128222 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ec96d-88f5-4e4c-b633-103b245bfb5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:51.128553 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ec96d-88f5-4e4c-b633-103b245bfb5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:51.130032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ec96d-88f5-4e4c-b633-103b245bfb5a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:51.145236 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 236/475] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:51.154322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec96d-88f5-4e4c-b633-103b245bfb5a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:51.172998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:51.217499 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 240/476] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:51.252578 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fca2e-50bf-45f6-9145-3be09182bcf6 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:51.295801 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec96d-88f5-4e4c-b633-103b245bfb5a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:51.326308 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:51.334623 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32780df3-b662-481c-80de-df9792169431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:51.335306 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32780df3-b662-481c-80de-df9792169431 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:51.335583 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32780df3-b662-481c-80de-df9792169431 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:51.335855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32780df3-b662-481c-80de-df9792169431 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:51.336551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32780df3-b662-481c-80de-df9792169431 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:51.338051 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32780df3-b662-481c-80de-df9792169431 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:51.361624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 237/477] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Jul 12 18:14:51 2022] POST /identity/v3/users => generated 249 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:14:51.377670 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fca2e-50bf-45f6-9145-3be09182bcf6 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:51.425879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a2194-cd77-478e-af8d-2063bc9a2dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:51.426577 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a2194-cd77-478e-af8d-2063bc9a2dc0 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:51.426859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a2194-cd77-478e-af8d-2063bc9a2dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:51.427135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a2194-cd77-478e-af8d-2063bc9a2dc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:51.428476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a2194-cd77-478e-af8d-2063bc9a2dc0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:51.429943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a2194-cd77-478e-af8d-2063bc9a2dc0 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:51.439894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.sql.core [None req-5d8a2194-cd77-478e-af8d-2063bc9a2dc0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 18:14:51.439894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 18:14:51.439894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [parameters: {'id': 'b8d7422a3fa1445a8bc48907e60fcf16', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 18:14:51.439894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80226) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 18:14:51.457933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-5d8a2194-cd77-478e-af8d-2063bc9a2dc0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 18:14:51.457933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:51.457933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 18:14:51.457933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 18:14:51.457933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 18:14:51.457933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 18:14:51.457933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 18:14:51.457933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 18:14:51.457933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 18:14:51.457933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application conn.query(q) Jul 12 18:14:51.457933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 18:14:51.457933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 18:14:51.457933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 18:14:51.457933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application result.read() Jul 12 18:14:51.457933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 18:14:51.459814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 18:14:51.459814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 18:14:51.459814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 18:14:51.459814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 18:14:51.459814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 18:14:51.459814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 18:14:51.459814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 18:14:51.459814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 18:14:51.459814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:51.459814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 18:14:51.459814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:51.459814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:51.459814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 18:14:51.459814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 18:14:51.459814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 12 18:14:51.459814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return ref.to_dict() Jul 12 18:14:51.459814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 18:14:51.459814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application next(self.gen) Jul 12 18:14:51.460694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 18:14:51.460694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application yield resource Jul 12 18:14:51.460694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 18:14:51.460694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application next(self.gen) Jul 12 18:14:51.460694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 18:14:51.460694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 18:14:51.460694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 18:14:51.460694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 18:14:51.460694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 18:14:51.460694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise self.value Jul 12 18:14:51.460694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 18:14:51.460694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 18:14:51.460694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 18:14:51.460694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application session.commit() Jul 12 18:14:51.460694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 18:14:51.460694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 18:14:51.460694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 18:14:51.461585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 18:14:51.461585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 18:14:51.461585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self.session.flush() Jul 12 18:14:51.461585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 18:14:51.461585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 18:14:51.461585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 18:14:51.461585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 18:14:51.461585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 18:14:51.461585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application compat.raise_( Jul 12 18:14:51.461585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 18:14:51.461585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception Jul 12 18:14:51.461585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 18:14:51.461585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 18:14:51.461585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 18:14:51.461585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 18:14:51.461585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 18:14:51.461585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 18:14:51.462453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 18:14:51.462453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 18:14:51.462453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 18:14:51.462453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 18:14:51.462453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 18:14:51.462453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 18:14:51.462453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 18:14:51.462453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 18:14:51.462453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 18:14:51.462453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 18:14:51.462453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 18:14:51.462453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 18:14:51.462453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 18:14:51.462453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 18:14:51.462453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 18:14:51.462453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception Jul 12 18:14:51.463268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 18:14:51.463268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 18:14:51.463268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 18:14:51.463268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 18:14:51.463268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 18:14:51.463268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 18:14:51.463268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 18:14:51.463268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application conn.query(q) Jul 12 18:14:51.463268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 18:14:51.463268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 18:14:51.463268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 18:14:51.463268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application result.read() Jul 12 18:14:51.463268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 18:14:51.463268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 18:14:51.463268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 18:14:51.463268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 18:14:51.464030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 18:14:51.464030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 18:14:51.464030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 18:14:51.464030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 18:14:51.464030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 18:14:51.464030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 18:14:51.464030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [parameters: {'id': 'b8d7422a3fa1445a8bc48907e60fcf16', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 18:14:51.464030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 18:14:51.464030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:51.464030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:14:51.464030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:51.464030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:51.464030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:51.464030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:51.464030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:51.464030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:51.464897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:51.464897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:51.464897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:51.464897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:51.464897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:51.464897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:51.464897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 12 18:14:51.464897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 12 18:14:51.464897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:51.464897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:51.464897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 12 18:14:51.464897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 12 18:14:51.464897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 18:14:51.464897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 18:14:51.464897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 18:14:51.464897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:51.468288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 241/478] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Jul 12 18:14:51 2022] POST /identity/v3/roles => generated 144 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:51.468423 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32780df3-b662-481c-80de-df9792169431 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:51.553386 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:51.591454 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32780df3-b662-481c-80de-df9792169431 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:51.631877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c1a59-c3a7-4411-87cc-4170e74b4063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:51.632808 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c1a59-c3a7-4411-87cc-4170e74b4063 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:51.633093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c1a59-c3a7-4411-87cc-4170e74b4063 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:51.633405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c1a59-c3a7-4411-87cc-4170e74b4063 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:51.647554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c1a59-c3a7-4411-87cc-4170e74b4063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:51.656123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-ad6c1a59-c3a7-4411-87cc-4170e74b4063 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:51.656123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:51.656123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:51.656123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:51.656123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:51.656123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:51.656123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:51.656123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:51.656123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:51.656123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:51.656123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:51.656123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:51.656123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:51.656123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:51.656123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:51.656123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:51.657094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:51.657094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:51.657094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:51.657094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:51.657094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:51.657094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:51.657094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:51.657094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:51.657094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:51.657094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:51.657094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:51.657094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:51.657094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:51.657094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:51.657094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:51.657094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:51.657941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:51.657941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:51.657941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:51.657941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:51.657941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:51.657941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:51.657941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:51.657941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:51.657941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:51.657941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:51.657941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:14:51.657941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:51.657941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 238/479] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:14:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:51.664317 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a2194-cd77-478e-af8d-2063bc9a2dc0 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:51.778790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a2194-cd77-478e-af8d-2063bc9a2dc0 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:51.806098 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:51.815589 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225d873-35d5-40f5-831a-415afff2bb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:51.816463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225d873-35d5-40f5-831a-415afff2bb52 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:51.816896 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225d873-35d5-40f5-831a-415afff2bb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:51.817532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225d873-35d5-40f5-831a-415afff2bb52 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:51.818964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225d873-35d5-40f5-831a-415afff2bb52 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:51.819416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225d873-35d5-40f5-831a-415afff2bb52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:51.821058 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225d873-35d5-40f5-831a-415afff2bb52 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:51.830467 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 242/480] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:14:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:52.754225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c391c1f-6546-4a13-910d-394fe8a142ab None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:52.754728 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c391c1f-6546-4a13-910d-394fe8a142ab None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:52.755284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c391c1f-6546-4a13-910d-394fe8a142ab None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:52.757919 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 239/481] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:52.763084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaf7eb-6c4d-4e3c-88dd-92e6edc4333f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:52.763509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaf7eb-6c4d-4e3c-88dd-92e6edc4333f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:52.763646 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaf7eb-6c4d-4e3c-88dd-92e6edc4333f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:52.790294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-babaf7eb-6c4d-4e3c-88dd-92e6edc4333f None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:52.791512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-babaf7eb-6c4d-4e3c-88dd-92e6edc4333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:52.879912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 243/482] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:52.913978 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c391c1f-6546-4a13-910d-394fe8a142ab None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:53.066926 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c391c1f-6546-4a13-910d-394fe8a142ab None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:53.106939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:53.113754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c777f1-512a-453a-af96-550b491f666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:53.114891 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c777f1-512a-453a-af96-550b491f666a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:53.115906 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c777f1-512a-453a-af96-550b491f666a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:53.116225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c777f1-512a-453a-af96-550b491f666a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:53.129207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c777f1-512a-453a-af96-550b491f666a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:53.139295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-78c777f1-512a-453a-af96-550b491f666a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:14:53.139295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:53.139295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:53.139295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:53.139295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:53.139295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:53.139295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:53.139295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:53.139295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:53.139295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:53.139295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:53.139295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:53.139295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:53.139295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:53.139295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:53.139295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:53.141312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:53.141312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:53.141312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:53.141312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:53.141312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:53.141312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:53.141312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:53.141312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:53.141312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:53.141312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:53.141312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:53.141312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:53.141312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:53.141312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:53.141312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:53.141312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:53.142364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:53.142364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:53.142364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:53.142364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:53.142364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:53.142364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:53.142364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:53.142364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:53.142364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:53.142364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:53.142364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:14:53.142364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:53.142364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 240/483] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:14:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:53.148913 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaf7eb-6c4d-4e3c-88dd-92e6edc4333f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:53.197082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d90e7-d29e-4cc2-a68e-4244143486e3 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:53.197422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d90e7-d29e-4cc2-a68e-4244143486e3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:53.197653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d90e7-d29e-4cc2-a68e-4244143486e3 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:53.199418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 241/484] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:14:53.204280 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcb6e8-9e4f-4cee-8255-9ca846f188e1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:53.204568 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcb6e8-9e4f-4cee-8255-9ca846f188e1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:53.204845 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcb6e8-9e4f-4cee-8255-9ca846f188e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:53.231603 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-66fcb6e8-9e4f-4cee-8255-9ca846f188e1 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:53.232799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-66fcb6e8-9e4f-4cee-8255-9ca846f188e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:53.299918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaf7eb-6c4d-4e3c-88dd-92e6edc4333f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:53.334823 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:53.358303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 242/485] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:53.369972 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1594eb-d2ca-46d1-bc4b-5ab4d9477b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:53.370650 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1594eb-d2ca-46d1-bc4b-5ab4d9477b04 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:53.370932 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1594eb-d2ca-46d1-bc4b-5ab4d9477b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:53.371203 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1594eb-d2ca-46d1-bc4b-5ab4d9477b04 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:53.372016 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1594eb-d2ca-46d1-bc4b-5ab4d9477b04 None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:53.372328 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1594eb-d2ca-46d1-bc4b-5ab4d9477b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:53.373755 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1594eb-d2ca-46d1-bc4b-5ab4d9477b04 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:53.382086 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcb6e8-9e4f-4cee-8255-9ca846f188e1 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:53.382704 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 244/486] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:14:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:53.388083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1594eb-d2ca-46d1-bc4b-5ab4d9477b04 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:53.490439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcb6e8-9e4f-4cee-8255-9ca846f188e1 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:53.512122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:53.529406 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ef82a-7207-4442-8330-a001cecbe3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:53.530292 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ef82a-7207-4442-8330-a001cecbe3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:53.530576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ef82a-7207-4442-8330-a001cecbe3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:53.530947 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ef82a-7207-4442-8330-a001cecbe3a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:53.542105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ef82a-7207-4442-8330-a001cecbe3a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:53.550342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-c17ef82a-7207-4442-8330-a001cecbe3a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:14:53.550342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:53.550342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:53.550342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:53.550342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:53.550342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:53.550342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:53.550342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:53.550342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:53.550342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:53.550342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:53.550342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:53.550342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:53.550342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:53.550342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:53.550342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:53.551256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:53.551256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:53.551256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:53.551256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:53.551256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:53.551256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:53.551256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:53.551256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:53.551256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:53.551256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:53.551256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:53.551256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:53.551256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:53.551256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:53.551256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:53.551256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:53.552052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:53.552052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:53.552052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:53.552052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:53.552052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:53.552052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:53.552052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:53.552052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:53.552052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:53.552052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:53.552052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:14:53.552052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:53.557426 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 243/487] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:14:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:53.558786 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ef82a-7207-4442-8330-a001cecbe3a5 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:53.579550 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1594eb-d2ca-46d1-bc4b-5ab4d9477b04 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:53.615076 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ad7bc-0c40-4cae-813d-bb465fa0a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:53.616311 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ad7bc-0c40-4cae-813d-bb465fa0a835 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:53.616792 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ad7bc-0c40-4cae-813d-bb465fa0a835 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:53.617295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ad7bc-0c40-4cae-813d-bb465fa0a835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:53.628977 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ad7bc-0c40-4cae-813d-bb465fa0a835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:53.631282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ad7bc-0c40-4cae-813d-bb465fa0a835 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:53.650182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-615ad7bc-0c40-4cae-813d-bb465fa0a835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:53.650182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:53.650182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:53.650182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:53.650182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:53.650182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:53.650182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:53.650182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:53.650182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:53.650182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:53.650182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:53.650182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:53.650182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:14:53.650182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:14:53.650182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:14:53.651057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:14:53.651057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:53.651057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:53.651057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:53.651057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:53.651057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:53.651057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:53.651057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:53.651057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:53.651057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:53.651057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:53.651057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:53.651057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:53.651057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:53.651057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:53.651057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:53.651057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:53.651899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:14:53.651899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:14:53.651899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:53.651899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:53.653898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 245/488] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:53.659634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ad7bc-0c40-4cae-813d-bb465fa0a835 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:53.669480 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ef82a-7207-4442-8330-a001cecbe3a5 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:53.704264 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:53.708814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e14c98-c19e-4ebf-b0a4-9a5f24d7520a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:53.710103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e14c98-c19e-4ebf-b0a4-9a5f24d7520a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:53.710386 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e14c98-c19e-4ebf-b0a4-9a5f24d7520a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:53.710723 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e14c98-c19e-4ebf-b0a4-9a5f24d7520a None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:53.711539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e14c98-c19e-4ebf-b0a4-9a5f24d7520a None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:53.711910 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e14c98-c19e-4ebf-b0a4-9a5f24d7520a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:53.713412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e14c98-c19e-4ebf-b0a4-9a5f24d7520a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:53.727209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 244/489] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:14:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:53.728674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e14c98-c19e-4ebf-b0a4-9a5f24d7520a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:53.779968 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:53.800947 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ad7bc-0c40-4cae-813d-bb465fa0a835 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:53.837750 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5449592-08e2-41a9-a3e9-4048f05549a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:53.838755 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5449592-08e2-41a9-a3e9-4048f05549a7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:53.839234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5449592-08e2-41a9-a3e9-4048f05549a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:53.839732 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5449592-08e2-41a9-a3e9-4048f05549a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:53.840665 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5449592-08e2-41a9-a3e9-4048f05549a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:53.841165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5449592-08e2-41a9-a3e9-4048f05549a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:53.842751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5449592-08e2-41a9-a3e9-4048f05549a7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:53.843402 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e14c98-c19e-4ebf-b0a4-9a5f24d7520a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:53.855905 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 246/490] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:53.863373 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5449592-08e2-41a9-a3e9-4048f05549a7 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:53.880585 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ae182-e365-47eb-bf28-efc898583cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:53.881819 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ae182-e365-47eb-bf28-efc898583cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:53.882100 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ae182-e365-47eb-bf28-efc898583cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:53.882371 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ae182-e365-47eb-bf28-efc898583cf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:53.893904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ae182-e365-47eb-bf28-efc898583cf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:53.895624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ae182-e365-47eb-bf28-efc898583cf9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:53.913708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-311ae182-e365-47eb-bf28-efc898583cf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:53.913708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:53.913708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:53.913708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:53.913708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:53.913708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:53.913708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:53.913708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:53.913708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:53.913708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:53.913708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:53.913708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:53.913708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:14:53.913708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:14:53.913708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:14:53.914581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:14:53.914581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:53.914581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:53.914581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:53.914581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:53.914581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:53.914581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:53.914581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:53.914581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:53.914581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:53.914581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:53.914581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:53.914581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:53.914581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:53.914581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:53.914581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:53.914581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:53.915412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:14:53.915412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:14:53.915412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:53.915412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:53.919525 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 245/491] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:53.921076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcee815-5abd-48f8-b05a-0a0988119e10 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:53.921392 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcee815-5abd-48f8-b05a-0a0988119e10 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:53.921668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcee815-5abd-48f8-b05a-0a0988119e10 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:53.923401 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 246/492] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:53.924728 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcee815-5abd-48f8-b05a-0a0988119e10 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:53.967059 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:53.976551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5449592-08e2-41a9-a3e9-4048f05549a7 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:54.013841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951aa0db-84b4-45f8-b989-e4e15041e2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:54.014731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951aa0db-84b4-45f8-b989-e4e15041e2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:54.015017 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951aa0db-84b4-45f8-b989-e4e15041e2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:54.015287 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951aa0db-84b4-45f8-b989-e4e15041e2b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:54.023278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951aa0db-84b4-45f8-b989-e4e15041e2b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:54.024858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951aa0db-84b4-45f8-b989-e4e15041e2b3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:54.032068 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:54.041982 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcee815-5abd-48f8-b05a-0a0988119e10 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:54.043184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-951aa0db-84b4-45f8-b989-e4e15041e2b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:14:54.043184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:54.043184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:54.043184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:54.043184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:54.043184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:54.043184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:54.043184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:54.043184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:54.043184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:54.043184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:54.043184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:54.043184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:14:54.043184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:14:54.043184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:14:54.043184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:14:54.044069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:54.044069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:54.044069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:14:54.044069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:14:54.044069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:14:54.044069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:14:54.044069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:54.044069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:54.044069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:54.044069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:54.044069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:54.044069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:54.044069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:54.044069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:54.044069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:54.044069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:54.044069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:54.044069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:54.045602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:54.045602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:54.045602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:14:54.045602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:14:54.045602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:14:54.045602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:14:54.045602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:14:54.045602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:14:54.045602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:14:54.045602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:54.045602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 247/493] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Jul 12 18:14:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:54.046158 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fbf65-7760-4795-b4cf-0cc57de4f6ae None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:54.046395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fbf65-7760-4795-b4cf-0cc57de4f6ae None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:54.046599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fbf65-7760-4795-b4cf-0cc57de4f6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:54.065082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2f5fbf65-7760-4795-b4cf-0cc57de4f6ae None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:54.066383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2f5fbf65-7760-4795-b4cf-0cc57de4f6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:54.084462 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6b79c-cf1f-4cd9-9897-a497c169c941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:54.085655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6b79c-cf1f-4cd9-9897-a497c169c941 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:54.086131 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6b79c-cf1f-4cd9-9897-a497c169c941 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:54.086619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6b79c-cf1f-4cd9-9897-a497c169c941 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:54.087581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6b79c-cf1f-4cd9-9897-a497c169c941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:54.088081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6b79c-cf1f-4cd9-9897-a497c169c941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:54.089856 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6b79c-cf1f-4cd9-9897-a497c169c941 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:54.108804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 247/494] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:54.110162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6b79c-cf1f-4cd9-9897-a497c169c941 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:54.139161 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 248/495] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:54.140168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fbf65-7760-4795-b4cf-0cc57de4f6ae None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:54.218411 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6b79c-cf1f-4cd9-9897-a497c169c941 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:54.228103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:54.249086 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fbf65-7760-4795-b4cf-0cc57de4f6ae None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:54.257496 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df05b82-ed4e-435c-85f4-aedaa58af1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:54.258164 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df05b82-ed4e-435c-85f4-aedaa58af1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:54.258438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df05b82-ed4e-435c-85f4-aedaa58af1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:54.258712 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df05b82-ed4e-435c-85f4-aedaa58af1f7 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:54.259546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df05b82-ed4e-435c-85f4-aedaa58af1f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:54.259852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df05b82-ed4e-435c-85f4-aedaa58af1f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:54.261413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df05b82-ed4e-435c-85f4-aedaa58af1f7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:54.285506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779b7b1-c08f-4d2d-99d9-d4d6f94efbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:54.287691 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779b7b1-c08f-4d2d-99d9-d4d6f94efbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:54.287980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779b7b1-c08f-4d2d-99d9-d4d6f94efbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:54.288256 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779b7b1-c08f-4d2d-99d9-d4d6f94efbd8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:54.296773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779b7b1-c08f-4d2d-99d9-d4d6f94efbd8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:54.298554 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779b7b1-c08f-4d2d-99d9-d4d6f94efbd8 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:54.299147 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 248/496] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Jul 12 18:14:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:54.299961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df05b82-ed4e-435c-85f4-aedaa58af1f7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:54.318541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:54.320202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-d779b7b1-c08f-4d2d-99d9-d4d6f94efbd8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:14:54.320202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:54.320202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:54.320202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:54.320202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:54.320202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:54.320202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:54.320202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:54.320202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:54.320202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:54.320202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:54.320202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:54.320202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:14:54.320202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:14:54.320202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:14:54.320202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:14:54.321135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:54.321135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:54.321135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:14:54.321135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:14:54.321135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:14:54.321135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:14:54.321135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:54.321135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:54.321135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:54.321135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:54.321135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:54.321135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:54.321135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:54.321135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:54.321135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:54.321135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:54.321135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:54.321135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:54.322874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:54.322874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:54.322874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:14:54.322874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:14:54.322874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:14:54.322874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:14:54.322874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:14:54.322874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:14:54.322874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:14:54.322874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:54.326307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 249/497] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:54.327675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de68eb0-acff-4d55-bbec-3852d46d95b4 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:54.327970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de68eb0-acff-4d55-bbec-3852d46d95b4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:54.328246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de68eb0-acff-4d55-bbec-3852d46d95b4 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:54.329773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 250/498] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:54.330289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de68eb0-acff-4d55-bbec-3852d46d95b4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:54.411262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df05b82-ed4e-435c-85f4-aedaa58af1f7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:54.442948 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de68eb0-acff-4d55-bbec-3852d46d95b4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:54.446642 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e300dda-9b2f-4364-86c0-d50894115987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:54.447436 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e300dda-9b2f-4364-86c0-d50894115987 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:54.447715 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e300dda-9b2f-4364-86c0-d50894115987 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:54.447985 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e300dda-9b2f-4364-86c0-d50894115987 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:54.458165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e300dda-9b2f-4364-86c0-d50894115987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:54.466302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-7e300dda-9b2f-4364-86c0-d50894115987 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:14:54.466302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:54.466302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:54.466302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:54.466302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:54.466302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:54.466302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:54.466302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:54.466302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:54.466302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:54.466302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:54.466302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:54.466302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:54.466302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:54.466302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:54.466302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:54.467207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:54.467207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:54.467207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:54.467207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:54.467207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:54.467207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:54.467207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:54.467207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:54.467207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:54.467207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:54.467207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:54.467207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:54.467207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:54.467207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:54.467207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:54.467207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:54.467987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:54.467987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:54.467987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:54.467987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:54.467987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:54.467987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:54.467987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:54.467987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:54.467987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:54.467987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:54.467987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:14:54.467987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:54.467987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 249/499] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:14:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:54.468655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e300dda-9b2f-4364-86c0-d50894115987 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:54.485849 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ceaae-d6c2-43af-92a6-9bbc5e84d94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:54.486771 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ceaae-d6c2-43af-92a6-9bbc5e84d94c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:54.487126 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ceaae-d6c2-43af-92a6-9bbc5e84d94c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:54.487405 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ceaae-d6c2-43af-92a6-9bbc5e84d94c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:54.500816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:54.540746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:54.564655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ceaae-d6c2-43af-92a6-9bbc5e84d94c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:54.566148 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ceaae-d6c2-43af-92a6-9bbc5e84d94c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:54.573632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e300dda-9b2f-4364-86c0-d50894115987 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:54.608051 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34394c84-6b41-4647-a3af-e18076d190cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:54.608717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34394c84-6b41-4647-a3af-e18076d190cc None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:54.609003 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34394c84-6b41-4647-a3af-e18076d190cc None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:54.609304 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34394c84-6b41-4647-a3af-e18076d190cc None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:54.610144 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34394c84-6b41-4647-a3af-e18076d190cc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:54.610457 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34394c84-6b41-4647-a3af-e18076d190cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:54.611922 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34394c84-6b41-4647-a3af-e18076d190cc None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:54.628523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 250/500] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Jul 12 18:14:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:54.629735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757ebae-e672-4787-9ef5-7e8a46a43d62 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:54.630024 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757ebae-e672-4787-9ef5-7e8a46a43d62 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:54.630304 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757ebae-e672-4787-9ef5-7e8a46a43d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:54.645708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7757ebae-e672-4787-9ef5-7e8a46a43d62 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:54.647438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7757ebae-e672-4787-9ef5-7e8a46a43d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:54.665167 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 251/501] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:54.666014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ceaae-d6c2-43af-92a6-9bbc5e84d94c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:54.707097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:54.713057 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 251/502] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:54.714388 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5dc76-13bf-428c-82e8-0e62ac524322 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:54.714681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5dc76-13bf-428c-82e8-0e62ac524322 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:54.714960 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5dc76-13bf-428c-82e8-0e62ac524322 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:54.716202 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 252/503] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:54.716892 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5dc76-13bf-428c-82e8-0e62ac524322 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:54.775564 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ceaae-d6c2-43af-92a6-9bbc5e84d94c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:54.778693 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:54.808216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a3533-f484-4691-b744-37b6c483fbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:54.808832 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a3533-f484-4691-b744-37b6c483fbaa None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:54.809114 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a3533-f484-4691-b744-37b6c483fbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:54.809427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a3533-f484-4691-b744-37b6c483fbaa None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:54.810172 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a3533-f484-4691-b744-37b6c483fbaa None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:54.810506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a3533-f484-4691-b744-37b6c483fbaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:54.811879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a3533-f484-4691-b744-37b6c483fbaa None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:54.820444 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 252/504] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:14:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:54.821276 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a3533-f484-4691-b744-37b6c483fbaa None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:54.829161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5dc76-13bf-428c-82e8-0e62ac524322 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:54.862677 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5235403-7069-4304-a7f4-a70302455f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:54.863340 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5235403-7069-4304-a7f4-a70302455f4b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:54.863636 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5235403-7069-4304-a7f4-a70302455f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:54.863907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5235403-7069-4304-a7f4-a70302455f4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:54.920371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a3533-f484-4691-b744-37b6c483fbaa None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:54.922721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:54.930350 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5235403-7069-4304-a7f4-a70302455f4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:54.931822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5235403-7069-4304-a7f4-a70302455f4b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:54.955542 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba7b31-02c8-46fc-8042-4746c75ed49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:54.956327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba7b31-02c8-46fc-8042-4746c75ed49f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:54.956608 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba7b31-02c8-46fc-8042-4746c75ed49f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:54.956879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba7b31-02c8-46fc-8042-4746c75ed49f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:54.966742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba7b31-02c8-46fc-8042-4746c75ed49f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:54.968189 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba7b31-02c8-46fc-8042-4746c75ed49f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:54.986654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-38ba7b31-02c8-46fc-8042-4746c75ed49f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:54.986654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:54.986654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:54.986654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:54.986654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:54.986654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:54.986654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:54.986654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:54.986654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:54.986654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:54.986654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:54.986654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:54.986654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:14:54.986654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:14:54.986654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:14:54.987513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:14:54.987513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:54.987513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:54.987513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:54.987513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:54.987513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:54.987513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:54.987513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:54.987513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:54.987513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:54.987513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:54.987513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:54.987513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:54.987513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:54.987513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:54.987513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:54.987513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:54.988503 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:14:54.988503 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:14:54.988503 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:54.988503 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:54.988503 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 253/505] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:54.989171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0fa59-c71f-4f39-bc4d-3c593bc187df None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:54.989475 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0fa59-c71f-4f39-bc4d-3c593bc187df None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:54.989747 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0fa59-c71f-4f39-bc4d-3c593bc187df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:54.993780 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:55.006505 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-39f0fa59-c71f-4f39-bc4d-3c593bc187df None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:55.007708 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-39f0fa59-c71f-4f39-bc4d-3c593bc187df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:55.041150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 253/506] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:55.042204 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5235403-7069-4304-a7f4-a70302455f4b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:55.085401 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 254/507] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:55.086228 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0fa59-c71f-4f39-bc4d-3c593bc187df None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:55.147220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5235403-7069-4304-a7f4-a70302455f4b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:55.172294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:55.184863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5faa8-a734-43c0-a550-e70d81f3446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:55.185695 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5faa8-a734-43c0-a550-e70d81f3446c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:55.185975 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5faa8-a734-43c0-a550-e70d81f3446c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:55.186246 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5faa8-a734-43c0-a550-e70d81f3446c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:55.188928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0fa59-c71f-4f39-bc4d-3c593bc187df None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:55.196284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5faa8-a734-43c0-a550-e70d81f3446c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:55.204262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-3cd5faa8-a734-43c0-a550-e70d81f3446c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:14:55.204262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:55.204262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:55.204262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:55.204262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:55.204262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:55.204262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:55.204262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:55.204262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:55.204262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:55.204262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:55.204262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:55.204262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:55.204262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:55.204262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:55.204262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:55.205355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:55.205355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:55.205355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:55.205355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:55.205355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:55.205355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:55.205355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:55.205355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:55.205355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:55.205355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:55.205355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:55.205355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:55.205355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:55.205355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:55.205355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:55.205355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:55.206322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:55.206322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:55.206322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:55.206322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:55.206322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:55.206322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:55.206322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:55.206322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:55.206322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:55.206322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:55.206322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:14:55.206322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:55.206322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 254/508] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:14:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:55.206322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5faa8-a734-43c0-a550-e70d81f3446c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:55.227753 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa7434-22b6-44e3-8178-159de6ac2cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:55.228787 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa7434-22b6-44e3-8178-159de6ac2cec None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:55.228897 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:55.228973 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa7434-22b6-44e3-8178-159de6ac2cec None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:55.229102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa7434-22b6-44e3-8178-159de6ac2cec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:55.239096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa7434-22b6-44e3-8178-159de6ac2cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:55.240619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa7434-22b6-44e3-8178-159de6ac2cec None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:55.258146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-72aa7434-22b6-44e3-8178-159de6ac2cec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:55.258146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:55.258146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:55.258146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:55.258146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:55.258146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:55.258146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:55.258146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:55.258146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:55.258146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:55.258146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:55.258146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:55.258146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:14:55.258146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:14:55.258146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:14:55.259006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:14:55.259006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:55.259006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:55.259006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:55.259006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:55.259006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:55.259006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:55.259006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:55.259006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:55.259006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:55.259006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:55.259006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:55.259006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:55.259006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:55.259006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:55.259006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:55.259006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:55.259853 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:14:55.259853 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:14:55.259853 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:55.259853 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:55.259853 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 255/509] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:55.260444 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa7434-22b6-44e3-8178-159de6ac2cec None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:55.318572 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5faa8-a734-43c0-a550-e70d81f3446c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:55.360564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff4896-e6a5-4374-9725-b28fa9e3d9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:55.361129 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff4896-e6a5-4374-9725-b28fa9e3d9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:55.361443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff4896-e6a5-4374-9725-b28fa9e3d9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:55.361713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff4896-e6a5-4374-9725-b28fa9e3d9b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:55.362431 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff4896-e6a5-4374-9725-b28fa9e3d9b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:55.362737 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff4896-e6a5-4374-9725-b28fa9e3d9b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:55.364126 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff4896-e6a5-4374-9725-b28fa9e3d9b2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:55.368575 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa7434-22b6-44e3-8178-159de6ac2cec None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:55.375605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 255/510] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:55.377939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff4896-e6a5-4374-9725-b28fa9e3d9b2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:55.402517 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e19251-695a-4616-ab38-0a7efc1abbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:55.403308 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e19251-695a-4616-ab38-0a7efc1abbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:55.403592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e19251-695a-4616-ab38-0a7efc1abbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:55.403876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e19251-695a-4616-ab38-0a7efc1abbe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:55.410434 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:55.416407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e19251-695a-4616-ab38-0a7efc1abbe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:55.417915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e19251-695a-4616-ab38-0a7efc1abbe6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:55.435110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-44e19251-695a-4616-ab38-0a7efc1abbe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:55.435110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:55.435110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:55.435110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:55.435110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:55.435110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:55.435110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:55.435110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:55.435110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:55.435110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:55.435110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:55.435110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:55.435110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:14:55.435110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:14:55.435110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:14:55.435962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:14:55.435962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:55.435962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:55.435962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:55.435962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:55.435962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:55.435962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:55.435962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:55.435962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:55.435962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:55.435962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:55.435962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:55.435962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:55.435962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:55.435962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:55.435962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:55.435962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:55.436795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:14:55.436795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:14:55.436795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:55.436795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:55.436795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 256/511] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:55.437408 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e19251-695a-4616-ab38-0a7efc1abbe6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:55.459729 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:55.478777 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff4896-e6a5-4374-9725-b28fa9e3d9b2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:55.510960 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d3675-42e1-421a-bf63-7f18d74bacd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:55.511741 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d3675-42e1-421a-bf63-7f18d74bacd4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:55.512022 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d3675-42e1-421a-bf63-7f18d74bacd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:55.512294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d3675-42e1-421a-bf63-7f18d74bacd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:55.522653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d3675-42e1-421a-bf63-7f18d74bacd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:55.524114 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d3675-42e1-421a-bf63-7f18d74bacd4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:55.538684 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e19251-695a-4616-ab38-0a7efc1abbe6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:55.541988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-df9d3675-42e1-421a-bf63-7f18d74bacd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:55.541988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:55.541988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:55.541988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:55.541988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:55.541988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:55.541988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:55.541988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:55.541988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:55.541988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:55.541988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:55.541988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:55.541988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:14:55.541988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:14:55.541988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:14:55.542958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:14:55.542958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:55.542958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:55.542958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:55.542958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:55.542958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:55.542958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:55.542958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:55.542958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:55.542958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:55.542958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:55.542958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:55.542958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:55.542958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:55.542958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:55.542958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:55.542958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:55.543841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:14:55.543841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:14:55.543841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:55.543841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:55.543841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 256/512] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:55.544370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d3675-42e1-421a-bf63-7f18d74bacd4 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:55.572340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ad9a4-a60d-4bc8-924c-b382c0b65e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:55.573006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ad9a4-a60d-4bc8-924c-b382c0b65e59 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:55.573553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ad9a4-a60d-4bc8-924c-b382c0b65e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:55.573834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ad9a4-a60d-4bc8-924c-b382c0b65e59 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:55.574571 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ad9a4-a60d-4bc8-924c-b382c0b65e59 None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:55.574872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ad9a4-a60d-4bc8-924c-b382c0b65e59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:55.576245 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ad9a4-a60d-4bc8-924c-b382c0b65e59 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:55.584733 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 257/513] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:14:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:55.585522 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ad9a4-a60d-4bc8-924c-b382c0b65e59 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:55.635014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:55.654303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d3675-42e1-421a-bf63-7f18d74bacd4 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:55.681658 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ad9a4-a60d-4bc8-924c-b382c0b65e59 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:55.682475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:55.692370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a3637-febe-4d59-b600-8403b5e7033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:55.693028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a3637-febe-4d59-b600-8403b5e7033e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:55.693828 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a3637-febe-4d59-b600-8403b5e7033e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:55.694282 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a3637-febe-4d59-b600-8403b5e7033e None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:55.695248 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a3637-febe-4d59-b600-8403b5e7033e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:55.695558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a3637-febe-4d59-b600-8403b5e7033e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:55.696978 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a3637-febe-4d59-b600-8403b5e7033e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:55.709546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 257/514] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:55.710490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a3637-febe-4d59-b600-8403b5e7033e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:55.719864 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782661d5-1115-4083-b08f-e7b748505e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:55.720652 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782661d5-1115-4083-b08f-e7b748505e72 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:55.720932 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782661d5-1115-4083-b08f-e7b748505e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:55.721204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782661d5-1115-4083-b08f-e7b748505e72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:55.728209 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782661d5-1115-4083-b08f-e7b748505e72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:55.729701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782661d5-1115-4083-b08f-e7b748505e72 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:55.744423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-782661d5-1115-4083-b08f-e7b748505e72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:14:55.744423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:55.744423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:55.744423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:55.744423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:55.744423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:55.744423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:55.744423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:55.744423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:55.744423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:55.744423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:55.744423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:55.744423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:14:55.744423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:14:55.744423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:14:55.745462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:14:55.745462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:55.745462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:55.745462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:55.745462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:55.745462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:55.745462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:55.745462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:55.745462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:55.745462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:55.745462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:55.745462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:55.745462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:55.745462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:55.745462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:55.745462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:55.745462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:55.746360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:14:55.746360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:14:55.746360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:14:55.746360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:14:55.746360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:14:55.746360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:14:55.746360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:14:55.746360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:55.746360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 258/515] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:14:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:55.746838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782661d5-1115-4083-b08f-e7b748505e72 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:55.822157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a3637-febe-4d59-b600-8403b5e7033e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:55.856671 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd23ed-4d9c-4fc1-ab2f-2e915bfff79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:55.857346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd23ed-4d9c-4fc1-ab2f-2e915bfff79d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:55.857622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd23ed-4d9c-4fc1-ab2f-2e915bfff79d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:55.857898 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd23ed-4d9c-4fc1-ab2f-2e915bfff79d None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:55.858621 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd23ed-4d9c-4fc1-ab2f-2e915bfff79d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:55.858846 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782661d5-1115-4083-b08f-e7b748505e72 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:55.859198 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd23ed-4d9c-4fc1-ab2f-2e915bfff79d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:55.860318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd23ed-4d9c-4fc1-ab2f-2e915bfff79d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:55.872055 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 258/516] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:55.878173 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:55.878265 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd23ed-4d9c-4fc1-ab2f-2e915bfff79d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:55.899642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942da85-b19d-4a40-b15d-0b821959bfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:55.900234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942da85-b19d-4a40-b15d-0b821959bfcf None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:55.900517 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942da85-b19d-4a40-b15d-0b821959bfcf None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:55.900795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942da85-b19d-4a40-b15d-0b821959bfcf None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:55.901530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942da85-b19d-4a40-b15d-0b821959bfcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:55.901837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942da85-b19d-4a40-b15d-0b821959bfcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:55.903200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942da85-b19d-4a40-b15d-0b821959bfcf None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:55.914831 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 259/517] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:55.915624 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942da85-b19d-4a40-b15d-0b821959bfcf None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:55.929226 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:55.977600 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd23ed-4d9c-4fc1-ab2f-2e915bfff79d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:56.010330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b790955-37ed-4c1d-89b0-c4b4656658ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:56.011112 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b790955-37ed-4c1d-89b0-c4b4656658ed None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:56.011389 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b790955-37ed-4c1d-89b0-c4b4656658ed None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:56.011657 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b790955-37ed-4c1d-89b0-c4b4656658ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:56.014226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942da85-b19d-4a40-b15d-0b821959bfcf None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:56.022808 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b790955-37ed-4c1d-89b0-c4b4656658ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:56.024276 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b790955-37ed-4c1d-89b0-c4b4656658ed None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:56.040887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-1b790955-37ed-4c1d-89b0-c4b4656658ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:56.040887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:56.040887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:56.040887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:56.040887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:56.040887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:56.040887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:56.040887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:56.040887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:56.040887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:56.040887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:56.040887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:56.040887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:14:56.040887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:14:56.040887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:14:56.041774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:14:56.041774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:56.041774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:56.041774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:56.041774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:56.041774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:56.041774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:56.041774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:56.041774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:56.041774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:56.041774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:56.041774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:56.041774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:56.041774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:56.041774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:56.041774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:56.041774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:56.042604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:14:56.042604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:14:56.042604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:56.042604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:56.046717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 259/518] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:56.047461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b790955-37ed-4c1d-89b0-c4b4656658ed None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:56.048239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25b768-9c47-4a69-8645-08bbf883ee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:56.049033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25b768-9c47-4a69-8645-08bbf883ee67 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:56.049350 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25b768-9c47-4a69-8645-08bbf883ee67 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:56.049628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25b768-9c47-4a69-8645-08bbf883ee67 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:56.057733 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25b768-9c47-4a69-8645-08bbf883ee67 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:56.059177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25b768-9c47-4a69-8645-08bbf883ee67 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:56.074844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-ad25b768-9c47-4a69-8645-08bbf883ee67 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 18:14:56.074844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:56.074844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:56.074844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:56.074844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:56.074844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:56.074844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:56.074844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:56.074844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:56.074844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:56.074844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:56.074844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:56.074844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:14:56.074844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:14:56.074844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:14:56.074844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:14:56.075726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:56.075726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:56.075726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:14:56.075726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:14:56.075726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:14:56.075726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:14:56.075726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:56.075726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:56.075726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:56.075726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:56.075726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:56.075726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:56.075726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:56.075726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:56.075726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:56.075726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:56.075726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:56.075726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:56.076584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:56.076584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:56.076584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:14:56.076584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:14:56.076584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:14:56.076584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:14:56.076584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:14:56.076584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:14:56.076584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 18:14:56.076584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:56.076584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 260/519] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:14:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:56.077147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25b768-9c47-4a69-8645-08bbf883ee67 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:56.107472 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:56.148783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b790955-37ed-4c1d-89b0-c4b4656658ed None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:56.151134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:56.175343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25b768-9c47-4a69-8645-08bbf883ee67 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:56.182772 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbae07-7b44-4d93-812b-00fbb6e4e30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:56.183490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbae07-7b44-4d93-812b-00fbb6e4e30e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:56.183778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbae07-7b44-4d93-812b-00fbb6e4e30e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:56.184055 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbae07-7b44-4d93-812b-00fbb6e4e30e None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:56.184838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbae07-7b44-4d93-812b-00fbb6e4e30e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:56.185149 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbae07-7b44-4d93-812b-00fbb6e4e30e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:56.186633 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbae07-7b44-4d93-812b-00fbb6e4e30e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:56.204742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 260/520] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:14:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:56.205460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbae07-7b44-4d93-812b-00fbb6e4e30e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:56.209396 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f260f7a-f741-41d7-8f94-3908fbe5e4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:56.210183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f260f7a-f741-41d7-8f94-3908fbe5e4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:56.210463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f260f7a-f741-41d7-8f94-3908fbe5e4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:56.210735 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f260f7a-f741-41d7-8f94-3908fbe5e4f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:56.217434 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f260f7a-f741-41d7-8f94-3908fbe5e4f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:56.218865 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f260f7a-f741-41d7-8f94-3908fbe5e4f6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:56.232911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-3f260f7a-f741-41d7-8f94-3908fbe5e4f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:14:56.232911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:56.232911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:56.232911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:56.232911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:56.232911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:56.232911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:56.232911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:56.232911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:56.232911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:56.232911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:56.232911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:56.232911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:14:56.232911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:14:56.232911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:14:56.233950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:14:56.233950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:56.233950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:56.233950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:56.233950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:56.233950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:56.233950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:56.233950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:56.233950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:56.233950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:56.233950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:56.233950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:56.233950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:56.233950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:56.233950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:56.233950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:56.233950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:56.234980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:14:56.234980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:14:56.234980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:14:56.234980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:14:56.234980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:14:56.234980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:14:56.234980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:14:56.234980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:56.234980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 261/521] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:14:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:56.238213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f260f7a-f741-41d7-8f94-3908fbe5e4f6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:56.309200 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbae07-7b44-4d93-812b-00fbb6e4e30e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:56.327786 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:56.336626 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f260f7a-f741-41d7-8f94-3908fbe5e4f6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:56.342834 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97321a45-9306-44e2-a9ba-88f1590faead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:56.343499 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97321a45-9306-44e2-a9ba-88f1590faead None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:56.343791 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97321a45-9306-44e2-a9ba-88f1590faead None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:56.344065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97321a45-9306-44e2-a9ba-88f1590faead None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:56.344763 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97321a45-9306-44e2-a9ba-88f1590faead None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:56.346250 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97321a45-9306-44e2-a9ba-88f1590faead None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:56.365774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 261/522] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Jul 12 18:14:56 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:14:56.367359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97321a45-9306-44e2-a9ba-88f1590faead None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:56.372473 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037eb9a9-1abb-4bc6-89bd-3487090716e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:56.373429 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eb9a9-1abb-4bc6-89bd-3487090716e0 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:56.373850 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eb9a9-1abb-4bc6-89bd-3487090716e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:56.374297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eb9a9-1abb-4bc6-89bd-3487090716e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:56.375230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037eb9a9-1abb-4bc6-89bd-3487090716e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:56.375683 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037eb9a9-1abb-4bc6-89bd-3487090716e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:56.378792 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037eb9a9-1abb-4bc6-89bd-3487090716e0 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:56.393666 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:56.399104 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 262/523] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:56.399104 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037eb9a9-1abb-4bc6-89bd-3487090716e0 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:56.481051 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97321a45-9306-44e2-a9ba-88f1590faead None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:56.520928 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea938cc1-6386-4a87-bba4-040e6a8b1898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:56.521587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea938cc1-6386-4a87-bba4-040e6a8b1898 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:56.521890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea938cc1-6386-4a87-bba4-040e6a8b1898 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:56.522136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea938cc1-6386-4a87-bba4-040e6a8b1898 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:56.523608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea938cc1-6386-4a87-bba4-040e6a8b1898 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:56.523608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea938cc1-6386-4a87-bba4-040e6a8b1898 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:56.523764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037eb9a9-1abb-4bc6-89bd-3487090716e0 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:56.525523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea938cc1-6386-4a87-bba4-040e6a8b1898 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:56.544859 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 262/524] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Jul 12 18:14:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:56.545719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea938cc1-6386-4a87-bba4-040e6a8b1898 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:56.571800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678518b2-9d76-4d2a-b207-5ec0b2114dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:56.572746 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678518b2-9d76-4d2a-b207-5ec0b2114dda None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:56.573036 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678518b2-9d76-4d2a-b207-5ec0b2114dda None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:56.573594 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678518b2-9d76-4d2a-b207-5ec0b2114dda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:56.574695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678518b2-9d76-4d2a-b207-5ec0b2114dda None admin] RBAC: Adding query filter params (role.id=82fa784b33dd4fe19c62367f39ac45b2, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=a7c1bb51c2b642ffa4708122d826fc67) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:56.575792 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678518b2-9d76-4d2a-b207-5ec0b2114dda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:56.576888 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678518b2-9d76-4d2a-b207-5ec0b2114dda None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:56.583672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 263/525] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:56 2022] GET /identity/v3/role_assignments?user.id=a7c1bb51c2b642ffa4708122d826fc67&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=82fa784b33dd4fe19c62367f39ac45b2 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:56.585407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678518b2-9d76-4d2a-b207-5ec0b2114dda None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:56.617710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:56.642261 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:56.676993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea938cc1-6386-4a87-bba4-040e6a8b1898 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:56.725806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c39ea-ba0c-4374-aeab-fe1d0ae56305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:56.726568 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c39ea-ba0c-4374-aeab-fe1d0ae56305 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:56.727311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c39ea-ba0c-4374-aeab-fe1d0ae56305 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:56.727311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c39ea-ba0c-4374-aeab-fe1d0ae56305 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:56.728247 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c39ea-ba0c-4374-aeab-fe1d0ae56305 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:56.728625 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c39ea-ba0c-4374-aeab-fe1d0ae56305 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:56.730286 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c39ea-ba0c-4374-aeab-fe1d0ae56305 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:56.749086 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678518b2-9d76-4d2a-b207-5ec0b2114dda None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:56.749435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 263/526] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:14:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:56.750886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c39ea-ba0c-4374-aeab-fe1d0ae56305 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:56.789222 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d02c8b-e8f4-45d3-b896-2772ca4d891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:56.790268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d02c8b-e8f4-45d3-b896-2772ca4d891a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:56.790622 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d02c8b-e8f4-45d3-b896-2772ca4d891a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:56.790969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d02c8b-e8f4-45d3-b896-2772ca4d891a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:56.799416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d02c8b-e8f4-45d3-b896-2772ca4d891a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:56.800974 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d02c8b-e8f4-45d3-b896-2772ca4d891a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:56.816900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-55d02c8b-e8f4-45d3-b896-2772ca4d891a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 18:14:56.816900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:56.816900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:56.816900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:56.816900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:56.816900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:56.816900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:56.816900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:56.816900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:56.816900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:56.816900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:56.816900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:56.816900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:14:56.816900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:14:56.816900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:14:56.816900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:14:56.817851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:56.817851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:56.817851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:14:56.817851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:14:56.817851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:14:56.817851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:14:56.817851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:56.817851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:56.817851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:56.817851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:56.817851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:56.817851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:56.817851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:56.817851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:56.817851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:56.817851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:56.817851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:56.817851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:56.818967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:56.818967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:56.818967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:14:56.818967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:14:56.818967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:14:56.818967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:14:56.818967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:14:56.818967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:14:56.818967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 18:14:56.818967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:56.818967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 264/527] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:14:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:56.819679 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d02c8b-e8f4-45d3-b896-2772ca4d891a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:56.887820 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c39ea-ba0c-4374-aeab-fe1d0ae56305 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:56.906856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:56.933028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d02c8b-e8f4-45d3-b896-2772ca4d891a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:56.936758 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859485c-2517-4b5e-a18f-42e5a0e940d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:56.937622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859485c-2517-4b5e-a18f-42e5a0e940d7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:56.938077 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859485c-2517-4b5e-a18f-42e5a0e940d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:56.938500 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859485c-2517-4b5e-a18f-42e5a0e940d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:56.950278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:56.975835 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e084db-6b86-4a46-8fa1-6e1f14f9cabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:56.976955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e084db-6b86-4a46-8fa1-6e1f14f9cabb None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:56.977552 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e084db-6b86-4a46-8fa1-6e1f14f9cabb None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:56.978061 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e084db-6b86-4a46-8fa1-6e1f14f9cabb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:56.979476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e084db-6b86-4a46-8fa1-6e1f14f9cabb None admin] RBAC: Adding query filter params (role.id=82fa784b33dd4fe19c62367f39ac45b2, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=faf61fd1e2ab426bbbbcc8dc7d552942) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:56.980106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e084db-6b86-4a46-8fa1-6e1f14f9cabb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:56.982516 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e084db-6b86-4a46-8fa1-6e1f14f9cabb None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:56.991608 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 265/528] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:56 2022] GET /identity/v3/role_assignments?user.id=faf61fd1e2ab426bbbbcc8dc7d552942&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=82fa784b33dd4fe19c62367f39ac45b2 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:56.993224 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e084db-6b86-4a46-8fa1-6e1f14f9cabb None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:57.034554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859485c-2517-4b5e-a18f-42e5a0e940d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:57.036245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859485c-2517-4b5e-a18f-42e5a0e940d7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:57.132865 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e084db-6b86-4a46-8fa1-6e1f14f9cabb None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:57.149017 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 264/529] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:14:57.165618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859485c-2517-4b5e-a18f-42e5a0e940d7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:57.177711 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aeb30e-7747-447f-9cf2-06f39f3a8ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:57.177711 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aeb30e-7747-447f-9cf2-06f39f3a8ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:57.177971 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aeb30e-7747-447f-9cf2-06f39f3a8ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:57.178291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aeb30e-7747-447f-9cf2-06f39f3a8ff3 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:57.179150 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aeb30e-7747-447f-9cf2-06f39f3a8ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:57.180039 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aeb30e-7747-447f-9cf2-06f39f3a8ff3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:57.181105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aeb30e-7747-447f-9cf2-06f39f3a8ff3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:57.208595 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:57.220580 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:57.225332 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 266/530] 10.222.0.57 () {56 vars in 1139 bytes} [Tue Jul 12 18:14:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:57.231064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aeb30e-7747-447f-9cf2-06f39f3a8ff3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:57.290021 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859485c-2517-4b5e-a18f-42e5a0e940d7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:57.328283 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76c5a3-570d-4003-89b3-0b087d62730a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:57.329331 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76c5a3-570d-4003-89b3-0b087d62730a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:57.329719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76c5a3-570d-4003-89b3-0b087d62730a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:57.330230 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76c5a3-570d-4003-89b3-0b087d62730a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:57.342918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76c5a3-570d-4003-89b3-0b087d62730a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:57.344767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76c5a3-570d-4003-89b3-0b087d62730a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:57.365180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aeb30e-7747-447f-9cf2-06f39f3a8ff3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:57.373296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-ac76c5a3-570d-4003-89b3-0b087d62730a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:57.373296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:57.373296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:57.373296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:57.373296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:57.373296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:57.373296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:57.373296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:57.373296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:57.373296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:57.373296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:57.373296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:57.373296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:14:57.373296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:14:57.373296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:14:57.374630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:14:57.374630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:57.374630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:57.374630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:57.374630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:57.374630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:57.374630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:57.374630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:57.374630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:57.374630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:57.374630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:57.374630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:57.374630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:57.374630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:57.374630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:57.374630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:57.374630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:57.375963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:14:57.375963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:14:57.375963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:57.375963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:57.375963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 265/531] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:57.375963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76c5a3-570d-4003-89b3-0b087d62730a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:57.455350 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253fd58-ad6b-4108-981a-a73dd6e3c8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:57.456357 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253fd58-ad6b-4108-981a-a73dd6e3c8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:57.456874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253fd58-ad6b-4108-981a-a73dd6e3c8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:57.457344 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253fd58-ad6b-4108-981a-a73dd6e3c8a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:57.488856 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:57.511190 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76c5a3-570d-4003-89b3-0b087d62730a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:57.574301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423dc86-916e-433c-8be0-fba134caae06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:57.574986 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423dc86-916e-433c-8be0-fba134caae06 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:57.575381 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423dc86-916e-433c-8be0-fba134caae06 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:57.575567 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423dc86-916e-433c-8be0-fba134caae06 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:57.576281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423dc86-916e-433c-8be0-fba134caae06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:57.576593 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423dc86-916e-433c-8be0-fba134caae06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:57.585663 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:57.586234 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423dc86-916e-433c-8be0-fba134caae06 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:57.590358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253fd58-ad6b-4108-981a-a73dd6e3c8a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:57.592248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253fd58-ad6b-4108-981a-a73dd6e3c8a5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:57.612694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 266/532] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:57.618647 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423dc86-916e-433c-8be0-fba134caae06 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:57.759226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 267/533] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:14:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 18:14:57.770007 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253fd58-ad6b-4108-981a-a73dd6e3c8a5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:57.817313 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423dc86-916e-433c-8be0-fba134caae06 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:57.883113 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b3e93-6445-4319-bd3e-7f1385d666fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:57.884798 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b3e93-6445-4319-bd3e-7f1385d666fe None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:57.885286 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b3e93-6445-4319-bd3e-7f1385d666fe None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:57.886941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b3e93-6445-4319-bd3e-7f1385d666fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:57.904823 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b3e93-6445-4319-bd3e-7f1385d666fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:57.906930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b3e93-6445-4319-bd3e-7f1385d666fe None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:57.941368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-f04b3e93-6445-4319-bd3e-7f1385d666fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:14:57.941368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:57.941368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:57.941368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:57.941368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:57.941368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:57.941368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:57.941368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:57.941368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:57.941368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:57.941368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:57.941368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:57.941368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:14:57.941368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:14:57.941368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:14:57.942472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:14:57.942472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:57.942472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:57.942472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:57.942472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:57.942472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:57.942472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:57.942472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:57.942472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:57.942472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:57.942472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:57.942472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:57.942472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:57.942472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:57.942472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:57.942472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:57.942472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:57.943555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:14:57.943555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:14:57.943555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:14:57.943555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:14:57.943555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:14:57.943555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:14:57.943555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:14:57.943555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:57.948645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 267/534] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:14:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:57.953084 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b3e93-6445-4319-bd3e-7f1385d666fe None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:57.953600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:57.960334 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253fd58-ad6b-4108-981a-a73dd6e3c8a5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:57.979772 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:58.000816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cfecd-7b25-4ed2-bf13-c63e476e8717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:58.001651 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cfecd-7b25-4ed2-bf13-c63e476e8717 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:58.001939 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cfecd-7b25-4ed2-bf13-c63e476e8717 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:58.002321 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cfecd-7b25-4ed2-bf13-c63e476e8717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:58.013298 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cfecd-7b25-4ed2-bf13-c63e476e8717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:58.015041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cfecd-7b25-4ed2-bf13-c63e476e8717 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:58.036644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-461cfecd-7b25-4ed2-bf13-c63e476e8717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:58.036644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:58.036644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:58.036644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:58.036644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:58.036644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:58.036644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:58.036644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:58.036644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:58.036644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:58.036644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:58.036644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:58.036644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:14:58.036644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:14:58.036644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:14:58.038179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:14:58.038179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:58.038179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:58.038179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:58.038179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:58.038179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:58.038179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:58.038179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:58.038179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:58.038179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:58.038179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:58.038179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:58.038179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:58.038179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:58.038179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:58.038179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:58.038179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:58.039310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:14:58.039310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:14:58.039310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:58.039310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:58.039310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 268/535] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:58.044335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cfecd-7b25-4ed2-bf13-c63e476e8717 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:58.155009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cfecd-7b25-4ed2-bf13-c63e476e8717 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:58.191654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cca44e-301f-4f78-bffc-49bea0237c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:58.192452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cca44e-301f-4f78-bffc-49bea0237c01 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:58.192806 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cca44e-301f-4f78-bffc-49bea0237c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:58.193176 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cca44e-301f-4f78-bffc-49bea0237c01 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:58.193988 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cca44e-301f-4f78-bffc-49bea0237c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:58.194368 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cca44e-301f-4f78-bffc-49bea0237c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:58.195953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cca44e-301f-4f78-bffc-49bea0237c01 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:58.209676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 269/536] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:58.215249 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cca44e-301f-4f78-bffc-49bea0237c01 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:58.228540 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:58.229074 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b3e93-6445-4319-bd3e-7f1385d666fe None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:58.305652 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a95a2e-f7eb-40e7-a309-53f83853f5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:58.306317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a95a2e-f7eb-40e7-a309-53f83853f5fd None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:58.306605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a95a2e-f7eb-40e7-a309-53f83853f5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:58.306885 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a95a2e-f7eb-40e7-a309-53f83853f5fd None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:58.307675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a95a2e-f7eb-40e7-a309-53f83853f5fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:58.307989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a95a2e-f7eb-40e7-a309-53f83853f5fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:58.309465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a95a2e-f7eb-40e7-a309-53f83853f5fd None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:58.336892 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 268/537] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:14:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:58.343204 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a95a2e-f7eb-40e7-a309-53f83853f5fd None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:58.401010 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cca44e-301f-4f78-bffc-49bea0237c01 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:58.438226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a72140-4de5-4363-9995-a4bcb3f3aec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:58.439106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a72140-4de5-4363-9995-a4bcb3f3aec7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:58.439453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a72140-4de5-4363-9995-a4bcb3f3aec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:58.439733 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a72140-4de5-4363-9995-a4bcb3f3aec7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:58.449181 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a72140-4de5-4363-9995-a4bcb3f3aec7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:58.450726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a72140-4de5-4363-9995-a4bcb3f3aec7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:58.467852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-c9a72140-4de5-4363-9995-a4bcb3f3aec7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:14:58.467852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:58.467852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:58.467852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:58.467852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:58.467852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:58.467852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:58.467852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:58.467852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:58.467852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:58.467852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:58.467852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:58.467852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:14:58.467852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:14:58.467852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:14:58.468790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:14:58.468790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:58.468790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:58.468790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:58.468790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:58.468790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:58.468790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:58.468790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:58.468790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:58.468790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:58.468790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:58.468790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:58.468790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:58.468790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:58.468790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:58.468790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:58.468790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:58.469895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:14:58.469895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:14:58.469895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:14:58.469895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:14:58.469895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:14:58.469895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:14:58.469895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:14:58.469895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:58.469895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 270/538] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:14:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:58.481023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a72140-4de5-4363-9995-a4bcb3f3aec7 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:58.494345 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:58.564416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a95a2e-f7eb-40e7-a309-53f83853f5fd None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:58.595427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:58.613683 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a72140-4de5-4363-9995-a4bcb3f3aec7 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:58.623332 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26ff15-e752-405f-9a9c-b3538e06ede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:58.624284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26ff15-e752-405f-9a9c-b3538e06ede4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:58.624703 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26ff15-e752-405f-9a9c-b3538e06ede4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:58.625115 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26ff15-e752-405f-9a9c-b3538e06ede4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:58.626198 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26ff15-e752-405f-9a9c-b3538e06ede4 None admin] RBAC: Adding query filter params (role.id=82fa784b33dd4fe19c62367f39ac45b2, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=5602d0a51329412ab6e908e7787531a7) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:58.626647 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26ff15-e752-405f-9a9c-b3538e06ede4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:58.628319 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26ff15-e752-405f-9a9c-b3538e06ede4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:58.641493 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 269/539] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:58 2022] GET /identity/v3/role_assignments?user.id=5602d0a51329412ab6e908e7787531a7&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=82fa784b33dd4fe19c62367f39ac45b2 => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:58.643451 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c555d00-5aaf-4027-bd57-080af19e2391 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:58.643945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c555d00-5aaf-4027-bd57-080af19e2391 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:58.644412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c555d00-5aaf-4027-bd57-080af19e2391 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:58.647117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 270/540] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:58.652214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9fb50-0eda-4dff-9b22-e7f412218339 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:58.652676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5018f-4a97-4939-9a63-81c6173f6f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:58.653069 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9fb50-0eda-4dff-9b22-e7f412218339 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:58.653373 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5018f-4a97-4939-9a63-81c6173f6f6e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:58.653660 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5018f-4a97-4939-9a63-81c6173f6f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:58.653942 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5018f-4a97-4939-9a63-81c6173f6f6e None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:58.654169 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9fb50-0eda-4dff-9b22-e7f412218339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:58.654745 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5018f-4a97-4939-9a63-81c6173f6f6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:58.655205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5018f-4a97-4939-9a63-81c6173f6f6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:58.657285 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5018f-4a97-4939-9a63-81c6173f6f6e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:58.677565 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 271/541] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:14:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:58.683615 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5018f-4a97-4939-9a63-81c6173f6f6e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:58.689678 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-98b9fb50-0eda-4dff-9b22-e7f412218339 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:58.690877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-98b9fb50-0eda-4dff-9b22-e7f412218339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:58.833680 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 271/542] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:14:58.858695 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9fb50-0eda-4dff-9b22-e7f412218339 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:58.867698 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5018f-4a97-4939-9a63-81c6173f6f6e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:58.902428 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:58.919721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d9c52-ead8-4e6b-b91f-7ed86cdbd20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:58.920398 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d9c52-ead8-4e6b-b91f-7ed86cdbd20a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:58.920675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d9c52-ead8-4e6b-b91f-7ed86cdbd20a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:58.920955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d9c52-ead8-4e6b-b91f-7ed86cdbd20a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:58.922012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d9c52-ead8-4e6b-b91f-7ed86cdbd20a None admin] RBAC: Adding query filter params (role.id=82fa784b33dd4fe19c62367f39ac45b2, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=b6dc63ae259842209831040cbf45d316) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:58.922330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d9c52-ead8-4e6b-b91f-7ed86cdbd20a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:58.923786 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d9c52-ead8-4e6b-b91f-7ed86cdbd20a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:58.939839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 272/543] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:14:58 2022] GET /identity/v3/role_assignments?user.id=b6dc63ae259842209831040cbf45d316&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=82fa784b33dd4fe19c62367f39ac45b2 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:58.987054 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:59.038385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9fb50-0eda-4dff-9b22-e7f412218339 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:59.085378 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea976242-e6f7-402d-b1d7-63152a171fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:59.086187 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea976242-e6f7-402d-b1d7-63152a171fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:59.086468 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea976242-e6f7-402d-b1d7-63152a171fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:59.086748 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea976242-e6f7-402d-b1d7-63152a171fd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:59.094167 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796e96a-791e-4cca-a2a5-829f4a51a1a1 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:59.094669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796e96a-791e-4cca-a2a5-829f4a51a1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:59.094770 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796e96a-791e-4cca-a2a5-829f4a51a1a1 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:59.096434 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 273/544] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:59.107378 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea976242-e6f7-402d-b1d7-63152a171fd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:59.108067 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3bf89-78bb-4d80-950f-14a3fed7d7e8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:59.108364 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3bf89-78bb-4d80-950f-14a3fed7d7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:59.108640 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3bf89-78bb-4d80-950f-14a3fed7d7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:59.115270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-ea976242-e6f7-402d-b1d7-63152a171fd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:14:59.115270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:59.115270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:59.115270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:59.115270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:59.115270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:59.115270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:59.115270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:59.115270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:59.115270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:59.115270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:59.115270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:59.115270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:59.115270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:59.115270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:59.115270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:59.116139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:59.116139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:59.116139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:59.116139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:59.116139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:59.116139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:59.116139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:59.116139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:59.116139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:59.116139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:59.116139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:59.116139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:59.116139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:59.116139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:59.116139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:59.116139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:59.117384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:59.117384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:59.117384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:59.117384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:59.117384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:59.117384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:59.117384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:59.117384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:59.117384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:59.117384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:59.117384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:14:59.117384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:59.117384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 272/545] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:14:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:59.122821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea976242-e6f7-402d-b1d7-63152a171fd7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:59.133366 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-94f3bf89-78bb-4d80-950f-14a3fed7d7e8 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:59.134584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-94f3bf89-78bb-4d80-950f-14a3fed7d7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:59.215461 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 274/546] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:59.245220 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3bf89-78bb-4d80-950f-14a3fed7d7e8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:59.304428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea976242-e6f7-402d-b1d7-63152a171fd7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:59.346579 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:59.370012 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52577255-c1b0-4fa3-b9a8-bf37afe26d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:59.370685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52577255-c1b0-4fa3-b9a8-bf37afe26d44 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:59.370967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52577255-c1b0-4fa3-b9a8-bf37afe26d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:59.371241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52577255-c1b0-4fa3-b9a8-bf37afe26d44 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:59.371990 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52577255-c1b0-4fa3-b9a8-bf37afe26d44 None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:59.372298 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52577255-c1b0-4fa3-b9a8-bf37afe26d44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:59.373718 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52577255-c1b0-4fa3-b9a8-bf37afe26d44 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:59.389441 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 273/547] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:14:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:59.395821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3bf89-78bb-4d80-950f-14a3fed7d7e8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:59.397864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52577255-c1b0-4fa3-b9a8-bf37afe26d44 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:59.450223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:59.452771 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edd26d-ee8e-4123-9ad1-521235038091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:59.453608 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edd26d-ee8e-4123-9ad1-521235038091 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:59.453897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edd26d-ee8e-4123-9ad1-521235038091 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:59.454159 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edd26d-ee8e-4123-9ad1-521235038091 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:59.468319 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edd26d-ee8e-4123-9ad1-521235038091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:14:59.476720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-94edd26d-ee8e-4123-9ad1-521235038091 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:14:59.476720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:59.476720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:59.476720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:59.476720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:59.476720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:59.476720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:59.476720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:59.476720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:59.476720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:59.476720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:59.476720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:59.476720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:14:59.476720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:14:59.476720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:14:59.476720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:14:59.477597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:14:59.477597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:14:59.477597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:14:59.477597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:14:59.477597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:59.477597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:59.477597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:59.477597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:59.477597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:59.477597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:59.477597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:59.477597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:59.477597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:59.477597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:59.477597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:59.477597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:59.478837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:59.478837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:59.478837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:59.478837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:59.478837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:14:59.478837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:14:59.478837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:14:59.478837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:14:59.478837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:14:59.478837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:14:59.478837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:14:59.478837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:14:59.478837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 275/548] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:14:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:14:59.484169 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edd26d-ee8e-4123-9ad1-521235038091 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:59.541806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52577255-c1b0-4fa3-b9a8-bf37afe26d44 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:59.584177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9f5bb-70c0-4c21-b4e8-f4494c7d52fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:59.584976 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9f5bb-70c0-4c21-b4e8-f4494c7d52fe None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:59.586199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9f5bb-70c0-4c21-b4e8-f4494c7d52fe None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:59.586199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9f5bb-70c0-4c21-b4e8-f4494c7d52fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:59.600139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9f5bb-70c0-4c21-b4e8-f4494c7d52fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:59.602228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9f5bb-70c0-4c21-b4e8-f4494c7d52fe None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:59.604881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edd26d-ee8e-4123-9ad1-521235038091 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:59.624083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-97c9f5bb-70c0-4c21-b4e8-f4494c7d52fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:59.624083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:59.624083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:59.624083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:59.624083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:59.624083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:59.624083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:59.624083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:59.624083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:59.624083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:59.624083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:59.624083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:59.624083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:14:59.624083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:14:59.624083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:14:59.625661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:14:59.625661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:59.625661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:59.625661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:59.625661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:59.625661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:59.625661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:59.625661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:59.625661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:59.625661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:59.625661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:59.625661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:59.625661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:59.625661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:59.625661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:59.625661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:59.625661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:59.626761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:14:59.626761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:14:59.626761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:59.626761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:59.626761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 274/549] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:59.627023 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27280767-40ac-43ea-b4af-2158d43fc9fa None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:59.627351 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27280767-40ac-43ea-b4af-2158d43fc9fa None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:59.627453 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27280767-40ac-43ea-b4af-2158d43fc9fa None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:59.629428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 275/550] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:59.635607 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decaccd-3ff7-4b69-8598-37c2bea91df8 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:59.635894 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decaccd-3ff7-4b69-8598-37c2bea91df8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:59.636170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decaccd-3ff7-4b69-8598-37c2bea91df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:59.644806 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c6faa-8130-4d19-806e-2e37bb181ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:59.645692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c6faa-8130-4d19-806e-2e37bb181ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:59.646162 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c6faa-8130-4d19-806e-2e37bb181ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:59.646645 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c6faa-8130-4d19-806e-2e37bb181ec7 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:59.647565 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c6faa-8130-4d19-806e-2e37bb181ec7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:59.648071 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c6faa-8130-4d19-806e-2e37bb181ec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:59.649660 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c6faa-8130-4d19-806e-2e37bb181ec7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:59.654667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-4decaccd-3ff7-4b69-8598-37c2bea91df8 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:59.656290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4decaccd-3ff7-4b69-8598-37c2bea91df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:59.659124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 276/551] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:14:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:14:59.660212 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c6faa-8130-4d19-806e-2e37bb181ec7 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:59.693632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:59.725916 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:59.732130 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 276/552] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:14:59.733370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decaccd-3ff7-4b69-8598-37c2bea91df8 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:59.817007 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c6faa-8130-4d19-806e-2e37bb181ec7 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:59.857995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decaccd-3ff7-4b69-8598-37c2bea91df8 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:59.862072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab669d2-137b-4033-9a56-7c2d9e52a69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:59.863043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab669d2-137b-4033-9a56-7c2d9e52a69e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:59.863319 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab669d2-137b-4033-9a56-7c2d9e52a69e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:59.863589 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab669d2-137b-4033-9a56-7c2d9e52a69e None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:59.864312 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab669d2-137b-4033-9a56-7c2d9e52a69e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:14:59.864611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab669d2-137b-4033-9a56-7c2d9e52a69e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:59.867284 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab669d2-137b-4033-9a56-7c2d9e52a69e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:59.888105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 277/553] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:14:59.889141 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab669d2-137b-4033-9a56-7c2d9e52a69e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:59.910528 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0277133-0394-4f23-9303-06908f3a8917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:59.911982 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0277133-0394-4f23-9303-06908f3a8917 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:59.913360 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0277133-0394-4f23-9303-06908f3a8917 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:59.913360 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0277133-0394-4f23-9303-06908f3a8917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:59.927730 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0277133-0394-4f23-9303-06908f3a8917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:59.930479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0277133-0394-4f23-9303-06908f3a8917 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:59.954368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-c0277133-0394-4f23-9303-06908f3a8917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:59.954368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:14:59.954368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:14:59.954368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:14:59.954368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:14:59.954368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:14:59.954368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:14:59.954368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:14:59.954368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:14:59.954368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:14:59.954368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:14:59.954368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:14:59.954368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:14:59.954368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:14:59.954368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:14:59.955422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:14:59.955422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:14:59.955422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:14:59.955422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:14:59.955422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:14:59.955422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:14:59.955422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:14:59.955422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:14:59.955422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:14:59.955422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:14:59.955422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:14:59.955422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:14:59.955422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:14:59.955422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:14:59.955422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:14:59.955422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:14:59.955422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:14:59.956282 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:14:59.956282 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:14:59.956282 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:14:59.956282 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:14:59.959728 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 277/554] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:14:59.961227 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0277133-0394-4f23-9303-06908f3a8917 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:59.987940 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:00.028200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab669d2-137b-4033-9a56-7c2d9e52a69e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:00.038724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:00.070784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94329ea-4f12-486d-ad19-380077d00872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:00.071563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94329ea-4f12-486d-ad19-380077d00872 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:00.071893 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94329ea-4f12-486d-ad19-380077d00872 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:00.072171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94329ea-4f12-486d-ad19-380077d00872 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:00.080232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0277133-0394-4f23-9303-06908f3a8917 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:00.083843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94329ea-4f12-486d-ad19-380077d00872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:00.092265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-b94329ea-4f12-486d-ad19-380077d00872 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:00.092265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:00.092265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:00.092265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:00.092265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:00.092265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:00.092265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:00.092265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:00.092265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:00.092265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:00.092265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:00.092265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:00.092265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:00.092265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:00.092265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:00.092265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:00.093348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:00.093348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:00.093348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:00.093348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:00.093348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:00.093348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:00.093348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:00.093348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:00.093348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:00.093348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:00.093348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:00.093348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:00.093348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:00.093348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:00.093348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:00.093348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:00.094858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:00.094858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:00.094858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:00.094858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:00.094858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:00.094858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:00.094858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:00.094858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:00.094858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:00.094858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:00.094858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:00.094858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:00.098880 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 278/555] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:14:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:00.100176 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94329ea-4f12-486d-ad19-380077d00872 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:00.124625 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1beb7cf-bd0b-47ac-9d16-7114b71082a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:00.125930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beb7cf-bd0b-47ac-9d16-7114b71082a3 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:00.126358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beb7cf-bd0b-47ac-9d16-7114b71082a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:00.127010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beb7cf-bd0b-47ac-9d16-7114b71082a3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:00.137073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1beb7cf-bd0b-47ac-9d16-7114b71082a3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:00.139562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1beb7cf-bd0b-47ac-9d16-7114b71082a3 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:00.163501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-f1beb7cf-bd0b-47ac-9d16-7114b71082a3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:15:00.163501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:00.163501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:00.163501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:00.163501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:00.163501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:00.163501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:00.163501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:00.163501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:00.163501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:00.163501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:00.163501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:00.163501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:00.163501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:00.163501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:00.163501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:00.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:00.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:00.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:00.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:00.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:00.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:00.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:00.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:00.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:00.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:00.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:00.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:00.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:00.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:00.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:00.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:00.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:00.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:00.166161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:00.166161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:00.166161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:00.166161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:00.166161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:00.166161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:00.166161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:00.166161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:00.166161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:15:00.166161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:00.173701 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 278/556] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:14:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:00.174367 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1beb7cf-bd0b-47ac-9d16-7114b71082a3 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:00.220043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94329ea-4f12-486d-ad19-380077d00872 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:00.259251 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f42ff4-9171-4c27-bbdf-a292f548f20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:00.259987 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f42ff4-9171-4c27-bbdf-a292f548f20f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:00.260282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f42ff4-9171-4c27-bbdf-a292f548f20f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:00.260692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f42ff4-9171-4c27-bbdf-a292f548f20f None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:00.261596 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f42ff4-9171-4c27-bbdf-a292f548f20f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:00.261910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f42ff4-9171-4c27-bbdf-a292f548f20f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:00.263284 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f42ff4-9171-4c27-bbdf-a292f548f20f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:00.276534 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 279/557] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:00.277403 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f42ff4-9171-4c27-bbdf-a292f548f20f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:00.278383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:00.304007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1beb7cf-bd0b-47ac-9d16-7114b71082a3 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:00.317771 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:00.350932 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a4054-c008-4875-bb96-33b10cd62b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:00.352364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a4054-c008-4875-bb96-33b10cd62b65 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:00.352850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a4054-c008-4875-bb96-33b10cd62b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:00.353612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a4054-c008-4875-bb96-33b10cd62b65 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:00.354707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a4054-c008-4875-bb96-33b10cd62b65 None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:00.355704 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a4054-c008-4875-bb96-33b10cd62b65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:00.357741 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a4054-c008-4875-bb96-33b10cd62b65 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:00.369832 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 279/558] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:15:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:00.370912 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a4054-c008-4875-bb96-33b10cd62b65 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:00.405200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f42ff4-9171-4c27-bbdf-a292f548f20f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:00.445773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01d72d-4847-46b5-8c41-ec38b69d8c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:00.446525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01d72d-4847-46b5-8c41-ec38b69d8c3b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:00.446745 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01d72d-4847-46b5-8c41-ec38b69d8c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:00.447042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01d72d-4847-46b5-8c41-ec38b69d8c3b None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:00.447876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01d72d-4847-46b5-8c41-ec38b69d8c3b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:00.448186 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01d72d-4847-46b5-8c41-ec38b69d8c3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:00.450168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01d72d-4847-46b5-8c41-ec38b69d8c3b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:00.474075 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 280/559] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Jul 12 18:15:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:00.474075 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01d72d-4847-46b5-8c41-ec38b69d8c3b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:00.504189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a4054-c008-4875-bb96-33b10cd62b65 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:00.539993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4beb5af-e648-499c-96e9-0ce657ee0e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:00.540720 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4beb5af-e648-499c-96e9-0ce657ee0e33 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:00.541008 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4beb5af-e648-499c-96e9-0ce657ee0e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:00.541305 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4beb5af-e648-499c-96e9-0ce657ee0e33 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:00.549406 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4beb5af-e648-499c-96e9-0ce657ee0e33 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:00.550877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4beb5af-e648-499c-96e9-0ce657ee0e33 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:00.566245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-e4beb5af-e648-499c-96e9-0ce657ee0e33 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:15:00.566245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:00.566245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:00.566245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:00.566245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:00.566245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:00.566245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:00.566245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:00.566245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:00.566245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:00.566245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:00.566245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:00.566245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:00.566245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:00.566245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:00.566245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:00.567165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:00.567165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:00.567165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:00.567165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:00.567165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:00.567165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:00.567165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:00.567165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:00.567165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:00.567165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:00.567165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:00.567165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:00.567165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:00.567165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:00.567165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:00.567165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:00.567165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:00.567165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:00.569329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:00.569329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:00.569329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:00.569329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:00.569329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:00.569329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:00.569329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:00.569329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:00.569329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:15:00.569329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:00.569329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 280/560] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Jul 12 18:15:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:00.569329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4beb5af-e648-499c-96e9-0ce657ee0e33 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:00.572106 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:00.588176 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:00.605408 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01d72d-4847-46b5-8c41-ec38b69d8c3b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:00.643532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df5ac7-0c81-4164-8d83-7c926cbbedee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:00.645140 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df5ac7-0c81-4164-8d83-7c926cbbedee None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:00.645891 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df5ac7-0c81-4164-8d83-7c926cbbedee None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:00.646425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df5ac7-0c81-4164-8d83-7c926cbbedee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:00.662431 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df5ac7-0c81-4164-8d83-7c926cbbedee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:00.665091 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df5ac7-0c81-4164-8d83-7c926cbbedee None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:00.689634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-f6df5ac7-0c81-4164-8d83-7c926cbbedee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:00.689634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:00.689634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:00.689634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:00.689634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:00.689634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:00.689634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:00.689634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:00.689634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:00.689634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:00.689634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:00.689634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:00.689634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:00.689634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:00.689634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:00.690559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:00.690559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:00.690559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:00.690559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:00.690559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:00.690559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:00.690559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:00.690559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:00.690559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:00.690559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:00.690559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:00.690559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:00.690559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:00.690559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:00.690559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:00.690559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:00.690559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:00.691461 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:00.691461 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:00.691461 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:00.691461 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:00.694682 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 281/561] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:00.696285 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df5ac7-0c81-4164-8d83-7c926cbbedee None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:00.698072 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4beb5af-e648-499c-96e9-0ce657ee0e33 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:00.744821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdf034-a997-48f4-b508-7a346dd2593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:00.745658 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdf034-a997-48f4-b508-7a346dd2593b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:00.746047 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdf034-a997-48f4-b508-7a346dd2593b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:00.746443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdf034-a997-48f4-b508-7a346dd2593b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:00.815441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df5ac7-0c81-4164-8d83-7c926cbbedee None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:00.829346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdf034-a997-48f4-b508-7a346dd2593b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:00.831710 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdf034-a997-48f4-b508-7a346dd2593b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:00.834432 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:00.855367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3530d5-6387-4d4c-90b9-aac27a1a2934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:00.856274 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3530d5-6387-4d4c-90b9-aac27a1a2934 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:00.856726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3530d5-6387-4d4c-90b9-aac27a1a2934 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:00.857144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3530d5-6387-4d4c-90b9-aac27a1a2934 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:00.858427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3530d5-6387-4d4c-90b9-aac27a1a2934 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:00.859153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3530d5-6387-4d4c-90b9-aac27a1a2934 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:00.861189 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3530d5-6387-4d4c-90b9-aac27a1a2934 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:00.865409 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:00.887671 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 282/562] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Jul 12 18:15:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:00.889288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3530d5-6387-4d4c-90b9-aac27a1a2934 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:00.943674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 281/563] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:15:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:15:00.944386 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdf034-a997-48f4-b508-7a346dd2593b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:01.009547 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3530d5-6387-4d4c-90b9-aac27a1a2934 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:01.049159 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdf034-a997-48f4-b508-7a346dd2593b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:01.049717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c25dbc-20e2-47b6-892c-6f6b30846862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:01.050151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c25dbc-20e2-47b6-892c-6f6b30846862 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:01.050439 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c25dbc-20e2-47b6-892c-6f6b30846862 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:01.050767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c25dbc-20e2-47b6-892c-6f6b30846862 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:01.051440 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c25dbc-20e2-47b6-892c-6f6b30846862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:01.051750 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c25dbc-20e2-47b6-892c-6f6b30846862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:01.053301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:01.053721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c25dbc-20e2-47b6-892c-6f6b30846862 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:01.066014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 283/564] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:01.067230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d32dc-d226-4efc-9cee-7000ef9dcbce None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:01.067524 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d32dc-d226-4efc-9cee-7000ef9dcbce None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:01.067861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d32dc-d226-4efc-9cee-7000ef9dcbce None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:01.069299 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 284/565] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:01.069836 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d32dc-d226-4efc-9cee-7000ef9dcbce None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:01.098718 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efcead-d184-4b3f-a938-7b20d755f599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:01.100433 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efcead-d184-4b3f-a938-7b20d755f599 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:01.100999 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efcead-d184-4b3f-a938-7b20d755f599 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:01.101464 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efcead-d184-4b3f-a938-7b20d755f599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:01.112530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efcead-d184-4b3f-a938-7b20d755f599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:01.114252 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efcead-d184-4b3f-a938-7b20d755f599 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:01.128204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:01.135839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-54efcead-d184-4b3f-a938-7b20d755f599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:01.135839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:01.135839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:01.135839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:01.135839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:01.135839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:01.135839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:01.135839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:01.135839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:01.135839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:01.135839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:01.135839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:01.135839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:01.135839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:01.135839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:01.136886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:01.136886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:01.136886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:01.136886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:01.136886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:01.136886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:01.136886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:01.136886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:01.136886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:01.136886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:01.136886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:01.136886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:01.136886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:01.136886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:01.136886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:01.136886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:01.136886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:01.138006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:01.138006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:01.138006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:01.138006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:01.144053 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 282/566] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:01.145072 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efcead-d184-4b3f-a938-7b20d755f599 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:01.180380 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d32dc-d226-4efc-9cee-7000ef9dcbce None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:01.225465 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e14b7-0196-4212-8208-70eb0d99afa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:01.226883 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e14b7-0196-4212-8208-70eb0d99afa7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:01.227457 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e14b7-0196-4212-8208-70eb0d99afa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:01.227975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e14b7-0196-4212-8208-70eb0d99afa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:01.242016 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e14b7-0196-4212-8208-70eb0d99afa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:01.244345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e14b7-0196-4212-8208-70eb0d99afa7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:01.248322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efcead-d184-4b3f-a938-7b20d755f599 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:01.264975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-f83e14b7-0196-4212-8208-70eb0d99afa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:01.264975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:01.264975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:01.264975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:01.264975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:01.264975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:01.264975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:01.264975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:01.264975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:01.264975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:01.264975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:01.264975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:01.264975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:01.264975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:01.264975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:01.266103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:01.266103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:01.266103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:01.266103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:01.266103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:01.266103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:01.266103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:01.266103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:01.266103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:01.266103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:01.266103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:01.266103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:01.266103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:01.266103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:01.266103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:01.266103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:01.266103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:01.267048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:01.267048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:01.267048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:01.267048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:01.267048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 285/567] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:01.267739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa48762-466a-44b1-bfe8-07420dba9f7c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:01.267739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa48762-466a-44b1-bfe8-07420dba9f7c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:01.267980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa48762-466a-44b1-bfe8-07420dba9f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:01.285643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2fa48762-466a-44b1-bfe8-07420dba9f7c None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:01.286733 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9c23a-a6cb-45a9-8d96-faeb95840833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:01.286864 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2fa48762-466a-44b1-bfe8-07420dba9f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:01.288096 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9c23a-a6cb-45a9-8d96-faeb95840833 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:01.288384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9c23a-a6cb-45a9-8d96-faeb95840833 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:01.288656 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9c23a-a6cb-45a9-8d96-faeb95840833 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:01.297071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9c23a-a6cb-45a9-8d96-faeb95840833 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:01.298620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9c23a-a6cb-45a9-8d96-faeb95840833 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:01.313858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-afa9c23a-a6cb-45a9-8d96-faeb95840833 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:15:01.313858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:01.313858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:01.313858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:01.313858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:01.313858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:01.313858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:01.313858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:01.313858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:01.313858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:01.313858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:01.313858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:01.313858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:01.313858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:01.313858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:01.313858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:01.314818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:01.314818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:01.314818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:01.314818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:01.314818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:01.314818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:01.314818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:01.314818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:01.314818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:01.314818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:01.314818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:01.314818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:01.314818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:01.314818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:01.314818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:01.314818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:01.314818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:01.314818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:01.320511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:01.320511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:01.320511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:01.320511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:01.320511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:01.320511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:01.320511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:01.320511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:01.320511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:15:01.320511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:01.320511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 283/568] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:15:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:01.320511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9c23a-a6cb-45a9-8d96-faeb95840833 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:01.331992 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:01.355923 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 286/569] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:15:01.357535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021b537-ac9a-446b-9996-787cd31565fc None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:01.358070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021b537-ac9a-446b-9996-787cd31565fc None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:01.358203 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021b537-ac9a-446b-9996-787cd31565fc None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:01.359486 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 287/570] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:01.360117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021b537-ac9a-446b-9996-787cd31565fc None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:01.399575 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:01.420032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9c23a-a6cb-45a9-8d96-faeb95840833 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:01.453901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f9022-6f70-428a-a9ec-03987fe8296f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:01.454577 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f9022-6f70-428a-a9ec-03987fe8296f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:01.454858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f9022-6f70-428a-a9ec-03987fe8296f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:01.455221 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f9022-6f70-428a-a9ec-03987fe8296f None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:01.455929 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f9022-6f70-428a-a9ec-03987fe8296f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:01.456232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f9022-6f70-428a-a9ec-03987fe8296f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:01.457629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f9022-6f70-428a-a9ec-03987fe8296f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:01.464343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021b537-ac9a-446b-9996-787cd31565fc None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:01.469351 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 284/571] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:01.470147 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f9022-6f70-428a-a9ec-03987fe8296f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:01.501291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5035525-335d-4b0c-a618-b9a19a8fba0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:01.501949 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5035525-335d-4b0c-a618-b9a19a8fba0e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:01.502230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5035525-335d-4b0c-a618-b9a19a8fba0e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:01.502498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5035525-335d-4b0c-a618-b9a19a8fba0e None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:01.503277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5035525-335d-4b0c-a618-b9a19a8fba0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:01.503502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5035525-335d-4b0c-a618-b9a19a8fba0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:01.504866 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5035525-335d-4b0c-a618-b9a19a8fba0e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:01.515691 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 288/572] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:01.516843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978d83c-e29a-4ecd-a427-8750921a40f3 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:01.517127 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978d83c-e29a-4ecd-a427-8750921a40f3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:01.517439 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978d83c-e29a-4ecd-a427-8750921a40f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:01.533821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d978d83c-e29a-4ecd-a427-8750921a40f3 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:01.535000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d978d83c-e29a-4ecd-a427-8750921a40f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:01.543696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:01.582120 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f9022-6f70-428a-a9ec-03987fe8296f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:01.602842 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 289/573] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:15:01.603683 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978d83c-e29a-4ecd-a427-8750921a40f3 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:01.629737 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:01.629998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b8b50-e6ba-402e-a8f3-a228a58a6d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:01.631183 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b8b50-e6ba-402e-a8f3-a228a58a6d3d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:01.631468 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b8b50-e6ba-402e-a8f3-a228a58a6d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:01.631746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b8b50-e6ba-402e-a8f3-a228a58a6d3d None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:01.632584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b8b50-e6ba-402e-a8f3-a228a58a6d3d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:01.632893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b8b50-e6ba-402e-a8f3-a228a58a6d3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:01.634376 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b8b50-e6ba-402e-a8f3-a228a58a6d3d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:01.652002 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 285/574] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Jul 12 18:15:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:01.652811 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b8b50-e6ba-402e-a8f3-a228a58a6d3d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:01.702890 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978d83c-e29a-4ecd-a427-8750921a40f3 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:01.735784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58893c3a-1c83-4ba7-b6ad-9c3c4a109bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:01.736576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58893c3a-1c83-4ba7-b6ad-9c3c4a109bdd None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:01.736862 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58893c3a-1c83-4ba7-b6ad-9c3c4a109bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:01.737148 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58893c3a-1c83-4ba7-b6ad-9c3c4a109bdd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:01.747119 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58893c3a-1c83-4ba7-b6ad-9c3c4a109bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:01.748323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b8b50-e6ba-402e-a8f3-a228a58a6d3d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:01.754978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-58893c3a-1c83-4ba7-b6ad-9c3c4a109bdd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:01.754978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:01.754978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:01.754978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:01.754978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:01.754978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:01.754978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:01.754978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:01.754978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:01.754978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:01.754978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:01.754978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:01.754978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:01.754978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:01.754978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:01.754978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:01.756418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:01.756418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:01.756418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:01.756418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:01.756418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:01.756418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:01.756418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:01.756418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:01.756418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:01.756418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:01.756418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:01.756418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:01.756418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:01.756418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:01.756418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:01.756418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:01.762482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:01.762482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:01.762482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:01.762482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:01.762482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:01.762482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:01.762482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:01.762482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:01.762482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:01.762482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:01.762482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:01.762482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:01.762482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 290/575] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:15:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:01.762482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58893c3a-1c83-4ba7-b6ad-9c3c4a109bdd None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:01.777391 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:01.783368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2ec31-2636-4902-8735-32bf2a13e97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:01.784166 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2ec31-2636-4902-8735-32bf2a13e97e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:01.784448 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2ec31-2636-4902-8735-32bf2a13e97e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:01.784723 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2ec31-2636-4902-8735-32bf2a13e97e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:01.791690 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2ec31-2636-4902-8735-32bf2a13e97e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:01.793195 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2ec31-2636-4902-8735-32bf2a13e97e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:01.806970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-51e2ec31-2636-4902-8735-32bf2a13e97e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:01.806970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:01.806970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:01.806970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:01.806970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:01.806970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:01.806970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:01.806970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:01.806970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:01.806970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:01.806970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:01.806970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:01.806970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:01.806970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:01.806970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:01.807821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:01.807821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:01.807821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:01.807821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:01.807821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:01.807821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:01.807821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:01.807821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:01.807821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:01.807821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:01.807821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:01.807821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:01.807821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:01.807821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:01.807821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:01.807821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:01.807821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:01.808806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:01.808806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:01.808806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:01.808806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:01.808806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:01.808806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:01.808806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:01.808806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:01.813164 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 286/576] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:01.813949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2ec31-2636-4902-8735-32bf2a13e97e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:01.848737 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:01.864425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58893c3a-1c83-4ba7-b6ad-9c3c4a109bdd None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:01.898017 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe73f5-9e5c-4e29-bd6d-7eceb5d1eb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:01.898798 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe73f5-9e5c-4e29-bd6d-7eceb5d1eb6b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:01.899082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe73f5-9e5c-4e29-bd6d-7eceb5d1eb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:01.899356 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe73f5-9e5c-4e29-bd6d-7eceb5d1eb6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:01.905899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe73f5-9e5c-4e29-bd6d-7eceb5d1eb6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:01.907345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe73f5-9e5c-4e29-bd6d-7eceb5d1eb6b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:01.913463 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2ec31-2636-4902-8735-32bf2a13e97e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:01.921855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-aefe73f5-9e5c-4e29-bd6d-7eceb5d1eb6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:01.921855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:01.921855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:01.921855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:01.921855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:01.921855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:01.921855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:01.921855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:01.921855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:01.921855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:01.921855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:01.921855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:01.921855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:01.921855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:01.921855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:01.922892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:01.922892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:01.922892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:01.922892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:01.922892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:01.922892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:01.922892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:01.922892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:01.922892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:01.922892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:01.922892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:01.922892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:01.922892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:01.922892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:01.922892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:01.922892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:01.922892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:01.923811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:01.923811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:01.923811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:01.923811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:01.923811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:01.923811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:01.923811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:01.923811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:01.923811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 291/577] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:01.923811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe73f5-9e5c-4e29-bd6d-7eceb5d1eb6b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:01.950054 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc30f8-6410-40db-844d-20868852e2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:01.950842 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc30f8-6410-40db-844d-20868852e2be None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:01.951124 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc30f8-6410-40db-844d-20868852e2be None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:01.951398 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc30f8-6410-40db-844d-20868852e2be None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:01.962077 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc30f8-6410-40db-844d-20868852e2be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:01.969683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-cdcc30f8-6410-40db-844d-20868852e2be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:01.969683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:01.969683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:01.969683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:01.969683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:01.969683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:01.969683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:01.969683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:01.969683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:01.969683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:01.969683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:01.969683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:01.969683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:01.969683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:01.969683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:01.969683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:01.970655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:01.970655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:01.970655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:01.970655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:01.970655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:01.970655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:01.970655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:01.970655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:01.970655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:01.970655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:01.970655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:01.970655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:01.970655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:01.970655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:01.970655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:01.970655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:01.971471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:01.971471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:01.971471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:01.971471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:01.971471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:01.971471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:01.971471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:01.971471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:01.971471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:01.971471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:01.971471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:01.971471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:01.971471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 287/578] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:15:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:01.972157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc30f8-6410-40db-844d-20868852e2be None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:02.023178 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:02.026964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe73f5-9e5c-4e29-bd6d-7eceb5d1eb6b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:02.061411 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908ee1b-fcc8-4799-8075-67bd857b5a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:02.062204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908ee1b-fcc8-4799-8075-67bd857b5a30 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:02.062495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908ee1b-fcc8-4799-8075-67bd857b5a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:02.062768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908ee1b-fcc8-4799-8075-67bd857b5a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:02.072589 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908ee1b-fcc8-4799-8075-67bd857b5a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:02.074081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc30f8-6410-40db-844d-20868852e2be None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:02.074514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908ee1b-fcc8-4799-8075-67bd857b5a30 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:02.081123 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:02.093101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-7908ee1b-fcc8-4799-8075-67bd857b5a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:02.093101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:02.093101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:02.093101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:02.093101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:02.093101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:02.093101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:02.093101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:02.093101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:02.093101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:02.093101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:02.093101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:02.093101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:02.093101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:02.093101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:02.094019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:02.094019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:02.094019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:02.094019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:02.094019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:02.094019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:02.094019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:02.094019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:02.094019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:02.094019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:02.094019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:02.094019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:02.094019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:02.094019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:02.094019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:02.094019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:02.094019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:02.094898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:02.094898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:02.094898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:02.094898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:02.094898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 292/579] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:02.095165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908ee1b-fcc8-4799-8075-67bd857b5a30 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:02.112504 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b699e-0870-4c9c-8a87-c4182fd68039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:02.113107 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b699e-0870-4c9c-8a87-c4182fd68039 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:02.113416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b699e-0870-4c9c-8a87-c4182fd68039 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:02.113977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b699e-0870-4c9c-8a87-c4182fd68039 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:02.114426 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b699e-0870-4c9c-8a87-c4182fd68039 None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:02.114732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b699e-0870-4c9c-8a87-c4182fd68039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:02.116137 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b699e-0870-4c9c-8a87-c4182fd68039 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:02.123904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 288/580] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:15:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:02.124675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b699e-0870-4c9c-8a87-c4182fd68039 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:02.198222 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908ee1b-fcc8-4799-8075-67bd857b5a30 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:02.222316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b699e-0870-4c9c-8a87-c4182fd68039 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:02.231661 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcaff1b-2134-47a1-ae67-ce19cfff41cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:02.232312 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcaff1b-2134-47a1-ae67-ce19cfff41cd None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:02.232592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcaff1b-2134-47a1-ae67-ce19cfff41cd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:02.232864 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcaff1b-2134-47a1-ae67-ce19cfff41cd None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:02.233673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcaff1b-2134-47a1-ae67-ce19cfff41cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:02.233981 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcaff1b-2134-47a1-ae67-ce19cfff41cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:02.235399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcaff1b-2134-47a1-ae67-ce19cfff41cd None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:02.235924 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:02.247893 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 293/581] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:02.248695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcaff1b-2134-47a1-ae67-ce19cfff41cd None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:02.259967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a48a73-a78e-47a1-b260-dbde3de4be7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:02.260619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a48a73-a78e-47a1-b260-dbde3de4be7c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:02.260903 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a48a73-a78e-47a1-b260-dbde3de4be7c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:02.261215 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a48a73-a78e-47a1-b260-dbde3de4be7c None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:02.262027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a48a73-a78e-47a1-b260-dbde3de4be7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:02.262339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a48a73-a78e-47a1-b260-dbde3de4be7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:02.263771 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a48a73-a78e-47a1-b260-dbde3de4be7c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:02.276148 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 289/582] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:02.276923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a48a73-a78e-47a1-b260-dbde3de4be7c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:02.310413 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:02.353685 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcaff1b-2134-47a1-ae67-ce19cfff41cd None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:02.375707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a48a73-a78e-47a1-b260-dbde3de4be7c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:02.387107 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4384c-5100-495c-a86b-90d5ec8dcec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:02.387798 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4384c-5100-495c-a86b-90d5ec8dcec8 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:02.388085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4384c-5100-495c-a86b-90d5ec8dcec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:02.388369 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4384c-5100-495c-a86b-90d5ec8dcec8 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:02.389107 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4384c-5100-495c-a86b-90d5ec8dcec8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:02.389444 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4384c-5100-495c-a86b-90d5ec8dcec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:02.390855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4384c-5100-495c-a86b-90d5ec8dcec8 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:02.398659 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 294/583] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:15:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:02.399435 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4384c-5100-495c-a86b-90d5ec8dcec8 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:02.408630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f8107-c144-48cf-b4f2-97dd3fd402cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:02.409305 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f8107-c144-48cf-b4f2-97dd3fd402cf None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:02.409592 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f8107-c144-48cf-b4f2-97dd3fd402cf None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:02.409873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f8107-c144-48cf-b4f2-97dd3fd402cf None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:02.410590 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f8107-c144-48cf-b4f2-97dd3fd402cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:02.410899 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f8107-c144-48cf-b4f2-97dd3fd402cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:02.412762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f8107-c144-48cf-b4f2-97dd3fd402cf None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:02.424004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 290/584] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:02.424629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f8107-c144-48cf-b4f2-97dd3fd402cf None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:02.458819 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:02.500337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4384c-5100-495c-a86b-90d5ec8dcec8 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:02.519640 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:02.524842 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f8107-c144-48cf-b4f2-97dd3fd402cf None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:02.533786 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8fe02-7e2d-46d5-b5e9-42cec91251d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:02.534565 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8fe02-7e2d-46d5-b5e9-42cec91251d3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:02.534851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8fe02-7e2d-46d5-b5e9-42cec91251d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:02.535128 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8fe02-7e2d-46d5-b5e9-42cec91251d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:02.546163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8fe02-7e2d-46d5-b5e9-42cec91251d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:02.547620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8fe02-7e2d-46d5-b5e9-42cec91251d3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:02.558799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0accd5-24f9-4637-9e31-27f3ee23f873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:02.559693 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0accd5-24f9-4637-9e31-27f3ee23f873 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:02.559977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0accd5-24f9-4637-9e31-27f3ee23f873 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:02.560254 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0accd5-24f9-4637-9e31-27f3ee23f873 None admin] PATH_INFO: `/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/a7c1bb51c2b642ffa4708122d826fc67/roles/82fa784b33dd4fe19c62367f39ac45b2` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:02.565549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-6ab8fe02-7e2d-46d5-b5e9-42cec91251d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:02.565549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:02.565549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:02.565549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:02.565549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:02.565549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:02.565549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:02.565549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:02.565549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:02.565549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:02.565549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:02.565549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:02.565549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:02.565549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:02.565549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:02.566598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:02.566598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:02.566598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:02.566598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:02.566598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:02.566598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:02.566598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:02.566598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:02.566598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:02.566598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:02.566598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:02.566598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:02.566598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:02.566598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:02.566598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:02.566598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:02.566598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:02.567520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:02.567520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:02.567520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:02.567520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:02.567520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 295/585] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:02.567814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8fe02-7e2d-46d5-b5e9-42cec91251d3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:02.575766 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0accd5-24f9-4637-9e31-27f3ee23f873 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fee99b2e9234f88ac79ff70429b6f20, user_id=a7c1bb51c2b642ffa4708122d826fc67, role_id=82fa784b33dd4fe19c62367f39ac45b2)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:02.577283 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0accd5-24f9-4637-9e31-27f3ee23f873 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:02.589904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 291/586] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:15:02 2022] PUT /identity/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/a7c1bb51c2b642ffa4708122d826fc67/roles/82fa784b33dd4fe19c62367f39ac45b2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:15:02.590696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0accd5-24f9-4637-9e31-27f3ee23f873 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:02.697155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:02.706245 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8fe02-7e2d-46d5-b5e9-42cec91251d3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:02.718872 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0accd5-24f9-4637-9e31-27f3ee23f873 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:02.756362 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead55e3-243f-49ba-85ed-27784c216b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:02.757022 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead55e3-243f-49ba-85ed-27784c216b26 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:02.757325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead55e3-243f-49ba-85ed-27784c216b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:02.757597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead55e3-243f-49ba-85ed-27784c216b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:02.757837 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaeb49-5025-4386-a30e-e621387880e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:02.758418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead55e3-243f-49ba-85ed-27784c216b26 None admin] RBAC: Adding query filter params (role.id=82fa784b33dd4fe19c62367f39ac45b2, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=ade969d7aa3d49c08782a68ec5997382) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:02.758635 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaeb49-5025-4386-a30e-e621387880e7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:02.758767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead55e3-243f-49ba-85ed-27784c216b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:02.758954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaeb49-5025-4386-a30e-e621387880e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:02.759187 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaeb49-5025-4386-a30e-e621387880e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:02.760150 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead55e3-243f-49ba-85ed-27784c216b26 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:02.769409 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 296/587] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:15:02 2022] GET /identity/v3/role_assignments?user.id=ade969d7aa3d49c08782a68ec5997382&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=82fa784b33dd4fe19c62367f39ac45b2 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:02.769829 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfaeb49-5025-4386-a30e-e621387880e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:02.770354 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead55e3-243f-49ba-85ed-27784c216b26 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:02.771868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfaeb49-5025-4386-a30e-e621387880e7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:02.794059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-4dfaeb49-5025-4386-a30e-e621387880e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:02.794059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:02.794059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:02.794059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:02.794059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:02.794059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:02.794059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:02.794059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:02.794059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:02.794059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:02.794059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:02.794059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:02.794059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:02.794059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:02.794059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:02.795028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:02.795028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:02.795028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:02.795028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:02.795028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:02.795028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:02.795028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:02.795028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:02.795028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:02.795028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:02.795028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:02.795028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:02.795028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:02.795028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:02.795028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:02.795028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:02.795028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:02.795907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:02.795907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:02.795907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:02.795907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:02.795907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 292/588] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:02.797095 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaeb49-5025-4386-a30e-e621387880e7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:02.827147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:02.899104 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead55e3-243f-49ba-85ed-27784c216b26 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:02.938149 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaeb49-5025-4386-a30e-e621387880e7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:02.949547 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58febdeb-7f07-4fe0-bb5d-103e8ab6b8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:02.950592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58febdeb-7f07-4fe0-bb5d-103e8ab6b8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:02.951001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58febdeb-7f07-4fe0-bb5d-103e8ab6b8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:02.951417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58febdeb-7f07-4fe0-bb5d-103e8ab6b8c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:02.960400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58febdeb-7f07-4fe0-bb5d-103e8ab6b8c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:02.962644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58febdeb-7f07-4fe0-bb5d-103e8ab6b8c4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:02.975946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a63007-b1e2-4702-95f5-5ccaaf329392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:02.976710 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a63007-b1e2-4702-95f5-5ccaaf329392 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:02.977089 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a63007-b1e2-4702-95f5-5ccaaf329392 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:02.977505 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a63007-b1e2-4702-95f5-5ccaaf329392 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:02.978318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a63007-b1e2-4702-95f5-5ccaaf329392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:02.978699 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a63007-b1e2-4702-95f5-5ccaaf329392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:02.980179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a63007-b1e2-4702-95f5-5ccaaf329392 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:02.980291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-58febdeb-7f07-4fe0-bb5d-103e8ab6b8c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:02.980291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:02.980291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:02.980291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:02.980291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:02.980291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:02.980291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:02.980291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:02.980291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:02.980291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:02.980291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:02.980291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:02.980291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:02.980291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:02.980291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:02.981102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:02.981102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:02.981102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:02.981102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:02.981102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:02.981102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:02.981102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:02.981102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:02.981102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:02.981102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:02.981102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:02.981102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:02.981102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:02.981102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:02.981102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:02.981102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:02.981102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:02.982592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:02.982592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:02.982592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:02.982592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:02.982592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:02.982592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:02.982592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:02.982592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:02.987109 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 297/589] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:02.988118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58febdeb-7f07-4fe0-bb5d-103e8ab6b8c4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:02.997781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:02.998965 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 293/590] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:03.000075 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a63007-b1e2-4702-95f5-5ccaaf329392 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:03.108463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:03.116029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58febdeb-7f07-4fe0-bb5d-103e8ab6b8c4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:03.116465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a63007-b1e2-4702-95f5-5ccaaf329392 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:03.151565 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce81f28-23ed-4c61-9e07-5a30a61b4354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:03.152231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce81f28-23ed-4c61-9e07-5a30a61b4354 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:03.152509 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce81f28-23ed-4c61-9e07-5a30a61b4354 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:03.152828 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce81f28-23ed-4c61-9e07-5a30a61b4354 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:03.153596 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce81f28-23ed-4c61-9e07-5a30a61b4354 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:03.153903 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce81f28-23ed-4c61-9e07-5a30a61b4354 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:03.155352 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce81f28-23ed-4c61-9e07-5a30a61b4354 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:03.156980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dd4f7-3b87-4827-8b46-7e28059b89bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:03.157935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dd4f7-3b87-4827-8b46-7e28059b89bb None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:03.158363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dd4f7-3b87-4827-8b46-7e28059b89bb None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:03.158806 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dd4f7-3b87-4827-8b46-7e28059b89bb None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:03.159725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dd4f7-3b87-4827-8b46-7e28059b89bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:03.160177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dd4f7-3b87-4827-8b46-7e28059b89bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:03.161760 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dd4f7-3b87-4827-8b46-7e28059b89bb None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:03.167758 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 294/591] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:03.173432 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce81f28-23ed-4c61-9e07-5a30a61b4354 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:03.175630 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 298/592] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:03.176706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dd4f7-3b87-4827-8b46-7e28059b89bb None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:03.237677 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:03.285383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce81f28-23ed-4c61-9e07-5a30a61b4354 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:03.288187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dd4f7-3b87-4827-8b46-7e28059b89bb None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:03.323730 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e753d-42c9-4a84-bb2f-33893fe38d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:03.324534 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e753d-42c9-4a84-bb2f-33893fe38d33 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:03.324824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e753d-42c9-4a84-bb2f-33893fe38d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:03.325095 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e753d-42c9-4a84-bb2f-33893fe38d33 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:03.328458 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380791a-cbec-4549-b59e-35a4dacf8306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:03.329541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380791a-cbec-4549-b59e-35a4dacf8306 None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:03.329968 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380791a-cbec-4549-b59e-35a4dacf8306 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:03.330386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380791a-cbec-4549-b59e-35a4dacf8306 None admin] PATH_INFO: `/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/faf61fd1e2ab426bbbbcc8dc7d552942/roles/82fa784b33dd4fe19c62367f39ac45b2` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:03.332795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e753d-42c9-4a84-bb2f-33893fe38d33 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:03.334799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e753d-42c9-4a84-bb2f-33893fe38d33 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:03.346741 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380791a-cbec-4549-b59e-35a4dacf8306 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fee99b2e9234f88ac79ff70429b6f20, user_id=faf61fd1e2ab426bbbbcc8dc7d552942, role_id=82fa784b33dd4fe19c62367f39ac45b2)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:03.348358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380791a-cbec-4549-b59e-35a4dacf8306 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:03.350035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-852e753d-42c9-4a84-bb2f-33893fe38d33 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 18:15:03.350035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:03.350035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:03.350035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:03.350035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:03.350035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:03.350035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:03.350035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:03.350035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:03.350035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:03.350035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:03.350035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:03.350035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:03.350035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:03.350035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:03.350035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:03.351157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:03.351157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:03.351157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:03.351157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:03.351157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:03.351157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:03.351157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:03.351157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:03.351157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:03.351157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:03.351157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:03.351157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:03.351157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:03.351157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:03.351157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:03.351157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:03.351157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:03.351157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:03.352123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:03.352123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:03.352123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:03.352123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:03.352123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:03.352123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:03.352123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:03.352123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:03.352123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 18:15:03.352123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:03.352123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 295/593] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:15:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:03.352728 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e753d-42c9-4a84-bb2f-33893fe38d33 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:03.367160 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 299/594] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:15:03 2022] PUT /identity/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/faf61fd1e2ab426bbbbcc8dc7d552942/roles/82fa784b33dd4fe19c62367f39ac45b2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:15:03.368222 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380791a-cbec-4549-b59e-35a4dacf8306 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:03.378567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:03.468838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e753d-42c9-4a84-bb2f-33893fe38d33 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:03.487169 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380791a-cbec-4549-b59e-35a4dacf8306 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:03.488620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:03.526830 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5800c6-c6d5-4fb8-9f59-9599b582aa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:03.527526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5800c6-c6d5-4fb8-9f59-9599b582aa46 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:03.527812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5800c6-c6d5-4fb8-9f59-9599b582aa46 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:03.528226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5800c6-c6d5-4fb8-9f59-9599b582aa46 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:03.529174 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5800c6-c6d5-4fb8-9f59-9599b582aa46 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:03.529523 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5800c6-c6d5-4fb8-9f59-9599b582aa46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:03.531098 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5800c6-c6d5-4fb8-9f59-9599b582aa46 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:03.532950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add899a-02ad-4358-8eaf-06f413a6b075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:03.534165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add899a-02ad-4358-8eaf-06f413a6b075 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:03.534706 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add899a-02ad-4358-8eaf-06f413a6b075 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:03.535199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add899a-02ad-4358-8eaf-06f413a6b075 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:03.549394 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add899a-02ad-4358-8eaf-06f413a6b075 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:03.557294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add899a-02ad-4358-8eaf-06f413a6b075 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:03.557510 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 300/595] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Jul 12 18:15:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:03.558002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5800c6-c6d5-4fb8-9f59-9599b582aa46 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:03.587293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-7add899a-02ad-4358-8eaf-06f413a6b075 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 18:15:03.587293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:03.587293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:03.587293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:03.587293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:03.587293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:03.587293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:03.587293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:03.587293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:03.587293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:03.587293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:03.587293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:03.587293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:03.587293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:03.587293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:03.587293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:03.588308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:03.588308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:03.588308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:03.588308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:03.588308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:03.588308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:03.588308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:03.588308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:03.588308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:03.588308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:03.588308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:03.588308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:03.588308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:03.588308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:03.588308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:03.588308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:03.588308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:03.588308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:03.589223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:03.589223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:03.589223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:03.589223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:03.589223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:03.589223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:03.589223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:03.589223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:03.589223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 18:15:03.589223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:03.591425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 296/596] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:15:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:03.596902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add899a-02ad-4358-8eaf-06f413a6b075 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:03.645636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:03.687541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5800c6-c6d5-4fb8-9f59-9599b582aa46 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:03.711874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add899a-02ad-4358-8eaf-06f413a6b075 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:03.725577 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bbe2e-407c-4466-b4f3-bfe310b0a20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:03.726545 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bbe2e-407c-4466-b4f3-bfe310b0a20f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:03.726922 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bbe2e-407c-4466-b4f3-bfe310b0a20f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:03.727385 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bbe2e-407c-4466-b4f3-bfe310b0a20f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:03.738398 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bbe2e-407c-4466-b4f3-bfe310b0a20f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:03.740019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bbe2e-407c-4466-b4f3-bfe310b0a20f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:03.749766 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6ad6d-e2d2-477c-aaf7-4c67ca2e5c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:03.750648 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6ad6d-e2d2-477c-aaf7-4c67ca2e5c49 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:03.751075 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6ad6d-e2d2-477c-aaf7-4c67ca2e5c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:03.751489 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6ad6d-e2d2-477c-aaf7-4c67ca2e5c49 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:03.752489 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6ad6d-e2d2-477c-aaf7-4c67ca2e5c49 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:03.752941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6ad6d-e2d2-477c-aaf7-4c67ca2e5c49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:03.754559 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6ad6d-e2d2-477c-aaf7-4c67ca2e5c49 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:03.759526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-0a0bbe2e-407c-4466-b4f3-bfe310b0a20f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:03.759526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:03.759526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:03.759526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:03.759526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:03.759526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:03.759526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:03.759526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:03.759526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:03.759526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:03.759526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:03.759526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:03.759526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:03.759526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:03.759526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:03.760513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:03.760513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:03.760513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:03.760513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:03.760513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:03.760513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:03.760513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:03.760513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:03.760513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:03.760513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:03.760513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:03.760513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:03.760513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:03.760513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:03.760513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:03.760513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:03.760513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:03.761498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:03.761498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:03.761498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:03.761498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:03.761736 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 301/597] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:03.774563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bbe2e-407c-4466-b4f3-bfe310b0a20f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:03.779118 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 297/598] 10.222.0.57 () {56 vars in 1139 bytes} [Tue Jul 12 18:15:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:03.784638 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6ad6d-e2d2-477c-aaf7-4c67ca2e5c49 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:03.821924 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:03.907107 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6ad6d-e2d2-477c-aaf7-4c67ca2e5c49 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:03.921639 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bbe2e-407c-4466-b4f3-bfe310b0a20f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:03.944165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:03.945419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f2142-3277-4b69-a05f-294f01f233ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:03.946446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f2142-3277-4b69-a05f-294f01f233ff None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:03.946954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f2142-3277-4b69-a05f-294f01f233ff None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:03.947429 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f2142-3277-4b69-a05f-294f01f233ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:03.959273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f2142-3277-4b69-a05f-294f01f233ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:03.961169 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f2142-3277-4b69-a05f-294f01f233ff None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:03.979668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-372f2142-3277-4b69-a05f-294f01f233ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:03.979668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:03.979668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:03.979668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:03.979668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:03.979668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:03.979668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:03.979668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:03.979668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:03.979668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:03.979668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:03.979668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:03.979668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:03.979668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:03.979668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:03.980555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:03.980555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:03.980555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:03.980555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:03.980555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:03.980555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:03.980555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:03.980555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:03.980555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:03.980555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:03.980555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:03.980555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:03.980555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:03.980555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:03.980555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:03.980555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:03.980555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:03.981460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:03.981460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:03.981460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:03.981460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:03.981691 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c6151-78ad-4cd1-8384-eb3a71ec7095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:03.981691 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c6151-78ad-4cd1-8384-eb3a71ec7095 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:03.982347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c6151-78ad-4cd1-8384-eb3a71ec7095 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:03.982347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c6151-78ad-4cd1-8384-eb3a71ec7095 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:03.982876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c6151-78ad-4cd1-8384-eb3a71ec7095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:03.983183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c6151-78ad-4cd1-8384-eb3a71ec7095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:03.984573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c6151-78ad-4cd1-8384-eb3a71ec7095 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:03.984783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 298/599] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:03.990878 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f2142-3277-4b69-a05f-294f01f233ff None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:04.004165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 302/600] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:04.007629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c6151-78ad-4cd1-8384-eb3a71ec7095 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:04.082063 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:04.106986 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f2142-3277-4b69-a05f-294f01f233ff None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:04.144213 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f21a67-5c6f-4321-8bc6-300fe7138549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:04.145728 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f21a67-5c6f-4321-8bc6-300fe7138549 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:04.146276 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f21a67-5c6f-4321-8bc6-300fe7138549 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:04.146752 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f21a67-5c6f-4321-8bc6-300fe7138549 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:04.146924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c6151-78ad-4cd1-8384-eb3a71ec7095 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:04.147856 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f21a67-5c6f-4321-8bc6-300fe7138549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:04.148460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f21a67-5c6f-4321-8bc6-300fe7138549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:04.150193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f21a67-5c6f-4321-8bc6-300fe7138549 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:04.163701 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 299/601] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:04.169725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f21a67-5c6f-4321-8bc6-300fe7138549 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:04.183636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e45d9-a0c2-4200-8fd5-74714d811274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:04.184481 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e45d9-a0c2-4200-8fd5-74714d811274 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:04.184768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e45d9-a0c2-4200-8fd5-74714d811274 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:04.185089 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e45d9-a0c2-4200-8fd5-74714d811274 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:04.192738 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e45d9-a0c2-4200-8fd5-74714d811274 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:04.194487 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e45d9-a0c2-4200-8fd5-74714d811274 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:04.210083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-907e45d9-a0c2-4200-8fd5-74714d811274 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:04.210083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:04.210083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:04.210083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:04.210083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:04.210083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:04.210083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:04.210083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:04.210083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:04.210083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:04.210083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:04.210083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:04.210083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:04.210083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:04.210083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:04.210959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:04.210959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:04.210959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:04.210959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:04.210959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:04.210959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:04.210959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:04.210959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:04.210959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:04.210959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:04.210959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:04.210959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:04.210959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:04.210959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:04.210959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:04.210959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:04.210959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:04.211845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:04.211845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:04.211845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:04.211845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:04.211845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:04.211845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:04.211845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:04.211845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:04.216223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 303/602] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:04.217545 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e45d9-a0c2-4200-8fd5-74714d811274 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:04.255340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:04.282359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f21a67-5c6f-4321-8bc6-300fe7138549 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:04.319855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59b3a0-f8aa-46ee-b182-40503b99abd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:04.321051 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59b3a0-f8aa-46ee-b182-40503b99abd1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:04.321630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59b3a0-f8aa-46ee-b182-40503b99abd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:04.322109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59b3a0-f8aa-46ee-b182-40503b99abd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:04.329621 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59b3a0-f8aa-46ee-b182-40503b99abd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:04.331357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59b3a0-f8aa-46ee-b182-40503b99abd1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:04.346757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-6e59b3a0-f8aa-46ee-b182-40503b99abd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:04.346757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:04.346757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:04.346757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:04.346757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:04.346757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:04.346757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:04.346757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:04.346757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:04.346757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:04.346757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:04.346757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:04.346757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:04.346757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:04.346757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:04.347630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:04.347630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:04.347630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:04.347630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:04.347630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:04.347630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:04.347630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:04.347630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:04.347630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:04.347630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:04.347630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:04.347630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:04.347630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:04.347630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:04.347630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:04.347630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:04.347630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:04.348508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:04.348508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:04.348508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:04.348508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:04.348508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:04.348508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:04.348508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:04.348508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:04.351060 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 300/603] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:04.356795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59b3a0-f8aa-46ee-b182-40503b99abd1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:04.359284 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e45d9-a0c2-4200-8fd5-74714d811274 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:04.373915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:04.456680 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afc0ea-9ce9-4dfe-b8bf-9dec13b10c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:04.457427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afc0ea-9ce9-4dfe-b8bf-9dec13b10c82 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:04.457670 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afc0ea-9ce9-4dfe-b8bf-9dec13b10c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:04.457962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afc0ea-9ce9-4dfe-b8bf-9dec13b10c82 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:04.459284 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afc0ea-9ce9-4dfe-b8bf-9dec13b10c82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:04.459630 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afc0ea-9ce9-4dfe-b8bf-9dec13b10c82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:04.461156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afc0ea-9ce9-4dfe-b8bf-9dec13b10c82 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:04.464123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59b3a0-f8aa-46ee-b182-40503b99abd1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:04.492104 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 304/604] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:04.497737 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afc0ea-9ce9-4dfe-b8bf-9dec13b10c82 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:04.531040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87182b-6521-401a-85bc-f3609db7e1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:04.532137 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87182b-6521-401a-85bc-f3609db7e1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:04.532621 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87182b-6521-401a-85bc-f3609db7e1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:04.533102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87182b-6521-401a-85bc-f3609db7e1f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:04.535462 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87182b-6521-401a-85bc-f3609db7e1f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:04.536821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87182b-6521-401a-85bc-f3609db7e1f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:04.539349 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87182b-6521-401a-85bc-f3609db7e1f2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:04.573731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 301/605] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:04.573731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87182b-6521-401a-85bc-f3609db7e1f2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:04.665145 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:04.669395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afc0ea-9ce9-4dfe-b8bf-9dec13b10c82 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:04.672316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:04.706740 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67409a4-5e48-49a2-88d1-ef3c4550c701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:04.707634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67409a4-5e48-49a2-88d1-ef3c4550c701 None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:04.707917 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67409a4-5e48-49a2-88d1-ef3c4550c701 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:04.708196 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67409a4-5e48-49a2-88d1-ef3c4550c701 None admin] PATH_INFO: `/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/5602d0a51329412ab6e908e7787531a7/roles/82fa784b33dd4fe19c62367f39ac45b2` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:04.723405 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67409a4-5e48-49a2-88d1-ef3c4550c701 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fee99b2e9234f88ac79ff70429b6f20, user_id=5602d0a51329412ab6e908e7787531a7, role_id=82fa784b33dd4fe19c62367f39ac45b2)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:04.725446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67409a4-5e48-49a2-88d1-ef3c4550c701 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:04.743047 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 305/606] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:15:04 2022] PUT /identity/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/5602d0a51329412ab6e908e7787531a7/roles/82fa784b33dd4fe19c62367f39ac45b2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:15:04.744109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87182b-6521-401a-85bc-f3609db7e1f2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:04.817095 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c5051-d5ab-4110-acce-cec17af526fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:04.817979 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c5051-d5ab-4110-acce-cec17af526fe None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:04.818266 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c5051-d5ab-4110-acce-cec17af526fe None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:04.818543 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c5051-d5ab-4110-acce-cec17af526fe None admin] PATH_INFO: `/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/b6dc63ae259842209831040cbf45d316/roles/82fa784b33dd4fe19c62367f39ac45b2` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:04.846905 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c5051-d5ab-4110-acce-cec17af526fe None admin] RBAC: Authorizing `identity:create_grant(project_id=5fee99b2e9234f88ac79ff70429b6f20, user_id=b6dc63ae259842209831040cbf45d316, role_id=82fa784b33dd4fe19c62367f39ac45b2)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:04.848388 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c5051-d5ab-4110-acce-cec17af526fe None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:04.871633 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 302/607] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:15:04 2022] PUT /identity/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/b6dc63ae259842209831040cbf45d316/roles/82fa784b33dd4fe19c62367f39ac45b2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:15:04.995075 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0d04f-229b-4d9b-a5a7-4e7ffa4a40fa None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:04.995450 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0d04f-229b-4d9b-a5a7-4e7ffa4a40fa None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:04.995661 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0d04f-229b-4d9b-a5a7-4e7ffa4a40fa None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:04.997320 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 306/608] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:05.003247 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22fec7-49db-4cf1-8bf8-bd5c1c3f3673 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:05.003875 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22fec7-49db-4cf1-8bf8-bd5c1c3f3673 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:05.004358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22fec7-49db-4cf1-8bf8-bd5c1c3f3673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:05.023688 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-3e22fec7-49db-4cf1-8bf8-bd5c1c3f3673 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:05.025326 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3e22fec7-49db-4cf1-8bf8-bd5c1c3f3673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:05.116942 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 303/609] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:15:05.119907 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69661e1d-388f-43a6-bca9-7186e3cfc603 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:05.120175 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69661e1d-388f-43a6-bca9-7186e3cfc603 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:05.120450 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69661e1d-388f-43a6-bca9-7186e3cfc603 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:05.123479 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 307/610] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:05.128185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124ef58-aeba-4057-8385-c992816c3aab None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:05.128483 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124ef58-aeba-4057-8385-c992816c3aab None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:05.128753 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124ef58-aeba-4057-8385-c992816c3aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:05.141985 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69661e1d-388f-43a6-bca9-7186e3cfc603 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:05.159378 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d124ef58-aeba-4057-8385-c992816c3aab None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:05.161195 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d124ef58-aeba-4057-8385-c992816c3aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:05.233285 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:05.261966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 304/611] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:15:05.296686 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69661e1d-388f-43a6-bca9-7186e3cfc603 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:05.302352 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124ef58-aeba-4057-8385-c992816c3aab None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:05.335571 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976baa5-8b52-4234-8709-44cf478af427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:05.336737 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976baa5-8b52-4234-8709-44cf478af427 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:05.337230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976baa5-8b52-4234-8709-44cf478af427 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:05.337762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976baa5-8b52-4234-8709-44cf478af427 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:05.348871 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976baa5-8b52-4234-8709-44cf478af427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:05.358676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-1976baa5-8b52-4234-8709-44cf478af427 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:05.358676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:05.358676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:05.358676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:05.358676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:05.358676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:05.358676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:05.358676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:05.358676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:05.358676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:05.358676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:05.358676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:05.358676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:05.358676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:05.358676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:05.358676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:05.360029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:05.360029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:05.360029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:05.360029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:05.360029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:05.360029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:05.360029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:05.360029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:05.360029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:05.360029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:05.360029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:05.360029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:05.360029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:05.360029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:05.360029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:05.360029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:05.360878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:05.360878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:05.360878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:05.360878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:05.360878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:05.360878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:05.360878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:05.360878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:05.360878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:05.360878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:05.360878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:05.360878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:05.363600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 308/612] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:15:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:05.373453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976baa5-8b52-4234-8709-44cf478af427 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:05.383406 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:05.481360 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124ef58-aeba-4057-8385-c992816c3aab None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:05.526319 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976baa5-8b52-4234-8709-44cf478af427 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:05.538986 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4ba3b-42c1-4c4b-b496-167d2fa342f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:05.539787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4ba3b-42c1-4c4b-b496-167d2fa342f1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:05.540135 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4ba3b-42c1-4c4b-b496-167d2fa342f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:05.540339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4ba3b-42c1-4c4b-b496-167d2fa342f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:05.575139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4ba3b-42c1-4c4b-b496-167d2fa342f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:05.580094 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbeabc-6701-4af6-b6ea-857d00fdfd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:05.581050 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbeabc-6701-4af6-b6ea-857d00fdfd0f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:05.581576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbeabc-6701-4af6-b6ea-857d00fdfd0f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:05.582089 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbeabc-6701-4af6-b6ea-857d00fdfd0f None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:05.583053 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbeabc-6701-4af6-b6ea-857d00fdfd0f None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:05.583587 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbeabc-6701-4af6-b6ea-857d00fdfd0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:05.585158 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbeabc-6701-4af6-b6ea-857d00fdfd0f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:05.592533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-e6a4ba3b-42c1-4c4b-b496-167d2fa342f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:05.592533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:05.592533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:05.592533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:05.592533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:05.592533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:05.592533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:05.592533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:05.592533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:05.592533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:05.592533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:05.592533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:05.592533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:05.592533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:05.592533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:05.592533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:05.593520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:05.593520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:05.593520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:05.593520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:05.593520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:05.593520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:05.593520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:05.593520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:05.593520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:05.593520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:05.593520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:05.593520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:05.593520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:05.593520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:05.593520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:05.593520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:05.594356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:05.594356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:05.594356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:05.594356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:05.594356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:05.594356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:05.594356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:05.594356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:05.594356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:05.594356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:05.594356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:05.594356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:05.602289 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 305/613] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:15:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:05.604883 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 309/614] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:15:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:05.610191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4ba3b-42c1-4c4b-b496-167d2fa342f1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:05.611623 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbeabc-6701-4af6-b6ea-857d00fdfd0f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:05.682485 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:05.726404 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:05.763004 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbeabc-6701-4af6-b6ea-857d00fdfd0f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:05.801407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95271270-9003-4373-805e-e77997fed5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:05.802925 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95271270-9003-4373-805e-e77997fed5ce None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:05.803492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95271270-9003-4373-805e-e77997fed5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:05.804161 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95271270-9003-4373-805e-e77997fed5ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:05.819842 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4ba3b-42c1-4c4b-b496-167d2fa342f1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:05.825591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95271270-9003-4373-805e-e77997fed5ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:05.827675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95271270-9003-4373-805e-e77997fed5ce None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:05.856904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-95271270-9003-4373-805e-e77997fed5ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:05.856904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:05.856904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:05.856904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:05.856904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:05.856904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:05.856904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:05.856904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:05.856904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:05.856904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:05.856904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:05.856904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:05.856904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:05.856904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:05.856904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:05.857887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:05.857887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:05.857887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:05.857887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:05.857887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:05.857887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:05.857887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:05.857887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:05.857887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:05.857887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:05.857887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:05.857887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:05.857887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:05.857887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:05.857887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:05.857887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:05.857887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:05.858762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:05.858762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:05.858762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:05.858762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:05.862163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 310/615] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:05.868210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95271270-9003-4373-805e-e77997fed5ce None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:05.898335 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dfc78-ae33-4c16-b946-2d94447d4ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:05.899435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dfc78-ae33-4c16-b946-2d94447d4ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:05.899925 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dfc78-ae33-4c16-b946-2d94447d4ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:05.900420 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dfc78-ae33-4c16-b946-2d94447d4ab0 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:05.901399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dfc78-ae33-4c16-b946-2d94447d4ab0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:05.901930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dfc78-ae33-4c16-b946-2d94447d4ab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:05.903592 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dfc78-ae33-4c16-b946-2d94447d4ab0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:05.913380 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 306/616] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:15:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:05.918719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dfc78-ae33-4c16-b946-2d94447d4ab0 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:06.022497 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:06.026840 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dfc78-ae33-4c16-b946-2d94447d4ab0 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:06.040056 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95271270-9003-4373-805e-e77997fed5ce None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:06.060770 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:06.085375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6b00e-d98d-4674-8d6b-e0aaec235cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:06.085375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6b00e-d98d-4674-8d6b-e0aaec235cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:06.085375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6b00e-d98d-4674-8d6b-e0aaec235cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:06.085375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6b00e-d98d-4674-8d6b-e0aaec235cf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:06.085764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6b00e-d98d-4674-8d6b-e0aaec235cf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:06.085764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6b00e-d98d-4674-8d6b-e0aaec235cf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:06.085764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6b00e-d98d-4674-8d6b-e0aaec235cf9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:06.093923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624146b0-71b1-4a38-ab63-076d29bfb8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:06.095001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624146b0-71b1-4a38-ab63-076d29bfb8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:06.095510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624146b0-71b1-4a38-ab63-076d29bfb8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:06.096056 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624146b0-71b1-4a38-ab63-076d29bfb8e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:06.100344 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 311/617] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:06.101589 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6b00e-d98d-4674-8d6b-e0aaec235cf9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:06.114492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624146b0-71b1-4a38-ab63-076d29bfb8e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:06.116352 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624146b0-71b1-4a38-ab63-076d29bfb8e9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:06.144939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-624146b0-71b1-4a38-ab63-076d29bfb8e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:06.144939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:06.144939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:06.144939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:06.144939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:06.144939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:06.144939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:06.144939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:06.144939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:06.144939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:06.144939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:06.144939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:06.144939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:06.144939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:06.144939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:06.145884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:06.145884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:06.145884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:06.145884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:06.145884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:06.145884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:06.145884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:06.145884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:06.145884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:06.145884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:06.145884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:06.145884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:06.145884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:06.145884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:06.145884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:06.145884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:06.145884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:06.146927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:06.146927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:06.146927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:06.146927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:06.149144 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 307/618] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:06.158825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624146b0-71b1-4a38-ab63-076d29bfb8e9 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:06.216917 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6b00e-d98d-4674-8d6b-e0aaec235cf9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:06.253869 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb46d4-43a9-4a33-9f4e-dc7b8b492c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:06.254659 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb46d4-43a9-4a33-9f4e-dc7b8b492c1f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:06.254938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb46d4-43a9-4a33-9f4e-dc7b8b492c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:06.255278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb46d4-43a9-4a33-9f4e-dc7b8b492c1f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:06.263441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb46d4-43a9-4a33-9f4e-dc7b8b492c1f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:06.264993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb46d4-43a9-4a33-9f4e-dc7b8b492c1f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:06.280188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-cadb46d4-43a9-4a33-9f4e-dc7b8b492c1f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:15:06.280188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:06.280188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:06.280188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:06.280188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:06.280188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:06.280188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:06.280188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:06.280188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:06.280188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:06.280188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:06.280188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:06.280188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:06.280188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:06.280188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:06.280188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:06.281117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:06.281117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:06.281117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:06.281117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:06.281117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:06.281117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:06.281117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:06.281117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:06.281117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:06.281117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:06.281117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:06.281117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:06.281117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:06.281117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:06.281117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:06.281117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:06.281117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:06.281117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:06.282213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:06.282213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:06.282213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:06.282213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:06.282213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:06.282213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:06.282213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:06.282213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:06.282213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:15:06.282213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:06.285846 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 312/619] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Jul 12 18:15:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:06.287672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc871d5-0f37-488d-b633-4189b485b5a2 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:06.288089 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc871d5-0f37-488d-b633-4189b485b5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:06.288367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc871d5-0f37-488d-b633-4189b485b5a2 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:06.293311 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 313/620] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:06.293311 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc871d5-0f37-488d-b633-4189b485b5a2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:06.309187 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624146b0-71b1-4a38-ab63-076d29bfb8e9 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:06.339375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:06.350929 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3e9f1-981c-42a7-bb96-b54a6fd665e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:06.351934 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3e9f1-981c-42a7-bb96-b54a6fd665e9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:06.352424 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3e9f1-981c-42a7-bb96-b54a6fd665e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:06.352970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3e9f1-981c-42a7-bb96-b54a6fd665e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:06.353986 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3e9f1-981c-42a7-bb96-b54a6fd665e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:06.354516 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3e9f1-981c-42a7-bb96-b54a6fd665e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:06.356196 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3e9f1-981c-42a7-bb96-b54a6fd665e9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:06.370249 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 308/621] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:06.371991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9649514-4e50-4175-b8e2-9f6ca7c00e2c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:06.372497 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9649514-4e50-4175-b8e2-9f6ca7c00e2c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:06.372979 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9649514-4e50-4175-b8e2-9f6ca7c00e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:06.389821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f9649514-4e50-4175-b8e2-9f6ca7c00e2c None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:06.391402 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f9649514-4e50-4175-b8e2-9f6ca7c00e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:06.394700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:06.406250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc871d5-0f37-488d-b633-4189b485b5a2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:06.448008 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82108eec-1134-426c-bed6-6e504b92c1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:06.449205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82108eec-1134-426c-bed6-6e504b92c1ff None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:06.449736 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82108eec-1134-426c-bed6-6e504b92c1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:06.450211 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82108eec-1134-426c-bed6-6e504b92c1ff None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:06.451173 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82108eec-1134-426c-bed6-6e504b92c1ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:06.451617 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82108eec-1134-426c-bed6-6e504b92c1ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:06.453446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82108eec-1134-426c-bed6-6e504b92c1ff None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:06.477150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 309/623] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:15:06.477150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9649514-4e50-4175-b8e2-9f6ca7c00e2c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:06.480437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 314/623] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Jul 12 18:15:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:06.482478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82108eec-1134-426c-bed6-6e504b92c1ff None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:06.592130 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:06.597626 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82108eec-1134-426c-bed6-6e504b92c1ff None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:06.608225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9649514-4e50-4175-b8e2-9f6ca7c00e2c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:06.634925 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db526d36-f697-4502-aecb-f55306cace71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:06.635990 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db526d36-f697-4502-aecb-f55306cace71 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:06.636567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db526d36-f697-4502-aecb-f55306cace71 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:06.637038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db526d36-f697-4502-aecb-f55306cace71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:06.644487 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee4100-e0dc-4712-a943-01f184af1343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:06.645307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee4100-e0dc-4712-a943-01f184af1343 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:06.645598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee4100-e0dc-4712-a943-01f184af1343 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:06.645877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee4100-e0dc-4712-a943-01f184af1343 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:06.654277 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee4100-e0dc-4712-a943-01f184af1343 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:06.655791 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee4100-e0dc-4712-a943-01f184af1343 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:06.658568 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:06.672604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-e2ee4100-e0dc-4712-a943-01f184af1343 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:15:06.672604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:06.672604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:06.672604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:06.672604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:06.672604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:06.672604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:06.672604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:06.672604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:06.672604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:06.672604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:06.672604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:06.672604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:06.672604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:06.672604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:06.672604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:06.673659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:06.673659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:06.673659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:06.673659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:06.673659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:06.673659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:06.673659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:06.673659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:06.673659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:06.673659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:06.673659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:06.673659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:06.673659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:06.673659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:06.673659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:06.673659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:06.673659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:06.673659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:06.674800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:06.674800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:06.674800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:06.674800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:06.674800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:06.674800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:06.674800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:06.674800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:06.674800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:15:06.674800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:06.674800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 310/624] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:15:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:06.675571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee4100-e0dc-4712-a943-01f184af1343 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:06.718178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db526d36-f697-4502-aecb-f55306cace71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:06.720090 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db526d36-f697-4502-aecb-f55306cace71 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:06.781758 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee4100-e0dc-4712-a943-01f184af1343 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:06.821685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bacbe-f6f1-483b-baf3-9ddae5f83b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:06.822519 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bacbe-f6f1-483b-baf3-9ddae5f83b39 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:06.822783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bacbe-f6f1-483b-baf3-9ddae5f83b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:06.823063 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bacbe-f6f1-483b-baf3-9ddae5f83b39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:06.825589 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:06.836202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 315/625] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:15:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:15:06.836410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bacbe-f6f1-483b-baf3-9ddae5f83b39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:06.837647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db526d36-f697-4502-aecb-f55306cace71 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:06.844611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-c54bacbe-f6f1-483b-baf3-9ddae5f83b39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:06.844611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:06.844611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:06.844611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:06.844611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:06.844611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:06.844611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:06.844611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:06.844611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:06.844611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:06.844611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:06.844611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:06.844611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:06.844611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:06.844611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:06.844611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:06.845574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:06.845574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:06.845574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:06.845574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:06.845574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:06.845574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:06.845574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:06.845574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:06.845574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:06.845574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:06.845574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:06.845574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:06.845574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:06.845574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:06.845574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:06.845574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:06.846541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:06.846541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:06.846541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:06.846541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:06.846541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:06.846541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:06.846541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:06.846541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:06.846541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:06.846541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:06.846541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:06.846541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:06.846541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 311/626] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:15:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:06.847429 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bacbe-f6f1-483b-baf3-9ddae5f83b39 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:06.911112 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:06.951509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db526d36-f697-4502-aecb-f55306cace71 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:06.954812 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bacbe-f6f1-483b-baf3-9ddae5f83b39 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:06.989820 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd83878-ac19-4191-aa3d-ed17fdd26f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:06.990733 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd83878-ac19-4191-aa3d-ed17fdd26f17 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:06.991185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd83878-ac19-4191-aa3d-ed17fdd26f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:06.991372 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d33a0d-c253-4ad7-b1c9-447110f0d95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:06.991759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd83878-ac19-4191-aa3d-ed17fdd26f17 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:06.992165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d33a0d-c253-4ad7-b1c9-447110f0d95d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:06.992447 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d33a0d-c253-4ad7-b1c9-447110f0d95d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:06.992721 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d33a0d-c253-4ad7-b1c9-447110f0d95d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:06.993218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd83878-ac19-4191-aa3d-ed17fdd26f17 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:06.993720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd83878-ac19-4191-aa3d-ed17fdd26f17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:06.995510 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd83878-ac19-4191-aa3d-ed17fdd26f17 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:07.004033 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d33a0d-c253-4ad7-b1c9-447110f0d95d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:07.006138 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d33a0d-c253-4ad7-b1c9-447110f0d95d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:07.015253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 316/627] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Jul 12 18:15:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:07.016359 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd83878-ac19-4191-aa3d-ed17fdd26f17 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:07.024470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-42d33a0d-c253-4ad7-b1c9-447110f0d95d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:07.024470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:07.024470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:07.024470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:07.024470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:07.024470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:07.024470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:07.024470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:07.024470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:07.024470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:07.024470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:07.024470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:07.024470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:07.024470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:07.024470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:07.025486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:07.025486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:07.025486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:07.025486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:07.025486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:07.025486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:07.025486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:07.025486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:07.025486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:07.025486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:07.025486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:07.025486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:07.025486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:07.025486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:07.025486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:07.025486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:07.025486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:07.026556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:07.026556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:07.026556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:07.026556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:07.030486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 312/628] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:07.031121 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d33a0d-c253-4ad7-b1c9-447110f0d95d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:07.080938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:07.128377 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd83878-ac19-4191-aa3d-ed17fdd26f17 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:07.138769 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d33a0d-c253-4ad7-b1c9-447110f0d95d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:07.151868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:07.168006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b65d12-07de-4111-9331-4ac3cfdd62de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:07.168768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b65d12-07de-4111-9331-4ac3cfdd62de None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:07.169054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b65d12-07de-4111-9331-4ac3cfdd62de None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:07.169353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b65d12-07de-4111-9331-4ac3cfdd62de None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:07.170087 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b65d12-07de-4111-9331-4ac3cfdd62de None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:07.170393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b65d12-07de-4111-9331-4ac3cfdd62de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:07.171751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b65d12-07de-4111-9331-4ac3cfdd62de None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:07.173475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a39100-b9d0-4bcf-8cae-9918894dd5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:07.174261 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a39100-b9d0-4bcf-8cae-9918894dd5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:07.174542 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a39100-b9d0-4bcf-8cae-9918894dd5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:07.174811 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a39100-b9d0-4bcf-8cae-9918894dd5f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:07.180737 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 317/629] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:15:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:07.181814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b65d12-07de-4111-9331-4ac3cfdd62de None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:07.186734 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a39100-b9d0-4bcf-8cae-9918894dd5f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:07.188675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a39100-b9d0-4bcf-8cae-9918894dd5f9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:07.206256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-34a39100-b9d0-4bcf-8cae-9918894dd5f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:07.206256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:07.206256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:07.206256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:07.206256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:07.206256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:07.206256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:07.206256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:07.206256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:07.206256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:07.206256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:07.206256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:07.206256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:07.206256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:07.206256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:07.207174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:07.207174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:07.207174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:07.207174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:07.207174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:07.207174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:07.207174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:07.207174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:07.207174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:07.207174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:07.207174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:07.207174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:07.207174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:07.207174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:07.207174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:07.207174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:07.207174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:07.208915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:07.208915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:07.208915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:07.208915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:07.208915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 313/630] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:07.209197 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73119f9e-575d-4e45-a6d5-9b2a1d35b259 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:07.209410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73119f9e-575d-4e45-a6d5-9b2a1d35b259 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:07.209584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73119f9e-575d-4e45-a6d5-9b2a1d35b259 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:07.211011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 314/631] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:07.211525 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73119f9e-575d-4e45-a6d5-9b2a1d35b259 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:07.299937 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b65d12-07de-4111-9331-4ac3cfdd62de None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:07.317167 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:07.321684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73119f9e-575d-4e45-a6d5-9b2a1d35b259 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:07.334881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1323da-fa04-46ed-93a4-eb4d432b4f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:07.335488 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1323da-fa04-46ed-93a4-eb4d432b4f18 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:07.335773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1323da-fa04-46ed-93a4-eb4d432b4f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:07.336048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1323da-fa04-46ed-93a4-eb4d432b4f18 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:07.336762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1323da-fa04-46ed-93a4-eb4d432b4f18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:07.337068 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1323da-fa04-46ed-93a4-eb4d432b4f18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:07.338473 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1323da-fa04-46ed-93a4-eb4d432b4f18 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:07.350251 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 318/632] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:07.351032 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1323da-fa04-46ed-93a4-eb4d432b4f18 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:07.355534 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f98373-8bd7-4cf1-90ee-da4cd3d9531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:07.356419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f98373-8bd7-4cf1-90ee-da4cd3d9531b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:07.356699 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f98373-8bd7-4cf1-90ee-da4cd3d9531b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:07.356972 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f98373-8bd7-4cf1-90ee-da4cd3d9531b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:07.368148 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f98373-8bd7-4cf1-90ee-da4cd3d9531b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:07.369682 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f98373-8bd7-4cf1-90ee-da4cd3d9531b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:07.386895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-e4f98373-8bd7-4cf1-90ee-da4cd3d9531b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:07.386895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:07.386895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:07.386895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:07.386895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:07.386895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:07.386895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:07.386895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:07.386895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:07.386895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:07.386895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:07.386895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:07.386895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:07.386895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:07.386895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:07.387767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:07.387767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:07.387767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:07.387767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:07.387767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:07.387767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:07.387767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:07.387767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:07.387767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:07.387767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:07.387767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:07.387767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:07.387767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:07.387767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:07.387767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:07.387767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:07.387767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:07.388646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:07.388646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:07.388646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:07.388646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:07.388646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 315/633] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:07.389344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6155e0d-9a00-4265-b768-d0868ff09b60 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:07.389550 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6155e0d-9a00-4265-b768-d0868ff09b60 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:07.389828 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6155e0d-9a00-4265-b768-d0868ff09b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:07.405444 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a6155e0d-9a00-4265-b768-d0868ff09b60 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:07.406666 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a6155e0d-9a00-4265-b768-d0868ff09b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:07.417074 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:07.458950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1323da-fa04-46ed-93a4-eb4d432b4f18 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:07.476345 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 316/634] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:15:07.477740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df3527-f9df-42a4-bda1-b1eb6354dd2c None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:07.478034 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df3527-f9df-42a4-bda1-b1eb6354dd2c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:07.478307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df3527-f9df-42a4-bda1-b1eb6354dd2c None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:07.479687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 317/635] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:07.480271 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df3527-f9df-42a4-bda1-b1eb6354dd2c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:07.494283 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56bb1a-e17d-495d-86eb-6951f05981f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:07.494940 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56bb1a-e17d-495d-86eb-6951f05981f5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:07.495231 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56bb1a-e17d-495d-86eb-6951f05981f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:07.495528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56bb1a-e17d-495d-86eb-6951f05981f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:07.496248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56bb1a-e17d-495d-86eb-6951f05981f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:07.496555 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56bb1a-e17d-495d-86eb-6951f05981f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:07.497958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56bb1a-e17d-495d-86eb-6951f05981f5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:07.509307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 319/636] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:07.510107 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56bb1a-e17d-495d-86eb-6951f05981f5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:07.550081 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:07.598048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df3527-f9df-42a4-bda1-b1eb6354dd2c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:07.611011 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56bb1a-e17d-495d-86eb-6951f05981f5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:07.631038 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5077e-64e4-4d71-9fbc-e81acc8484a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:07.631834 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5077e-64e4-4d71-9fbc-e81acc8484a7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:07.632117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5077e-64e4-4d71-9fbc-e81acc8484a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:07.632393 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5077e-64e4-4d71-9fbc-e81acc8484a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:07.638937 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5077e-64e4-4d71-9fbc-e81acc8484a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:07.640572 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5077e-64e4-4d71-9fbc-e81acc8484a7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:07.643703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ef65c-577d-4555-b5d0-219407387ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:07.644353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ef65c-577d-4555-b5d0-219407387ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:07.644631 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ef65c-577d-4555-b5d0-219407387ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:07.644903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ef65c-577d-4555-b5d0-219407387ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:07.645644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ef65c-577d-4555-b5d0-219407387ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:07.645947 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ef65c-577d-4555-b5d0-219407387ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:07.647934 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ef65c-577d-4555-b5d0-219407387ad1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:07.654646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-3fc5077e-64e4-4d71-9fbc-e81acc8484a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:07.654646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:07.654646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:07.654646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:07.654646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:07.654646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:07.654646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:07.654646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:07.654646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:07.654646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:07.654646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:07.654646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:07.654646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:07.654646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:07.654646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:07.655616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:07.655616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:07.655616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:07.655616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:07.655616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:07.655616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:07.655616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:07.655616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:07.655616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:07.655616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:07.655616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:07.655616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:07.655616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:07.655616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:07.655616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:07.655616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:07.655616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:07.656609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:07.656609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:07.656609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:07.656609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:07.656609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:07.656609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:07.656609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:07.656609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:07.656609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 318/637] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:07.657128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b3801-e3cd-4c7f-88b1-b1c8821525ec None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:07.657366 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b3801-e3cd-4c7f-88b1-b1c8821525ec None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:07.657550 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b3801-e3cd-4c7f-88b1-b1c8821525ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:07.663329 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 320/638] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:07.664122 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ef65c-577d-4555-b5d0-219407387ad1 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:07.672601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:07.678825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-614b3801-e3cd-4c7f-88b1-b1c8821525ec None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:07.680024 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-614b3801-e3cd-4c7f-88b1-b1c8821525ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:07.745502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 319/639] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:15:07.746132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b3801-e3cd-4c7f-88b1-b1c8821525ec None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:07.758122 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:07.762187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ef65c-577d-4555-b5d0-219407387ad1 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:07.795804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fd103-ebbf-44f7-8a1c-b5f746f092d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:07.796597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fd103-ebbf-44f7-8a1c-b5f746f092d7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:07.796881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fd103-ebbf-44f7-8a1c-b5f746f092d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:07.797153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fd103-ebbf-44f7-8a1c-b5f746f092d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:07.807187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fd103-ebbf-44f7-8a1c-b5f746f092d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:07.815027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-ef3fd103-ebbf-44f7-8a1c-b5f746f092d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:07.815027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:07.815027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:07.815027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:07.815027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:07.815027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:07.815027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:07.815027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:07.815027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:07.815027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:07.815027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:07.815027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:07.815027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:07.815027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:07.815027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:07.815027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:07.816266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:07.816266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:07.816266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:07.816266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:07.816266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:07.816266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:07.816266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:07.816266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:07.816266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:07.816266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:07.816266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:07.816266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:07.816266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:07.816266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:07.816266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:07.816266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:07.817339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:07.817339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:07.817339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:07.817339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:07.817339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:07.817339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:07.817339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:07.817339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:07.817339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:07.817339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:07.817339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:07.817339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:07.817339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 321/640] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:15:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:07.817339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fd103-ebbf-44f7-8a1c-b5f746f092d7 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:07.862246 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b3801-e3cd-4c7f-88b1-b1c8821525ec None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:07.894990 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88254bb6-3173-4071-b93b-1768b3337bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:07.895777 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88254bb6-3173-4071-b93b-1768b3337bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:07.896156 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88254bb6-3173-4071-b93b-1768b3337bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:07.896632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88254bb6-3173-4071-b93b-1768b3337bf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:07.899642 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:07.904200 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88254bb6-3173-4071-b93b-1768b3337bf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:07.905887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88254bb6-3173-4071-b93b-1768b3337bf8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:07.919511 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fd103-ebbf-44f7-8a1c-b5f746f092d7 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:07.920410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-88254bb6-3173-4071-b93b-1768b3337bf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:07.920410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:07.920410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:07.920410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:07.920410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:07.920410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:07.920410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:07.920410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:07.920410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:07.920410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:07.920410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:07.920410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:07.920410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:07.920410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:07.920410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:07.921521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:07.921521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:07.921521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:07.921521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:07.921521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:07.921521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:07.921521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:07.921521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:07.921521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:07.921521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:07.921521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:07.921521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:07.921521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:07.921521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:07.921521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:07.921521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:07.921521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:07.922649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:07.922649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:07.922649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:07.922649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:07.922649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:07.922649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:07.922649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:07.922649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:07.922649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 320/641] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:07.922649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88254bb6-3173-4071-b93b-1768b3337bf8 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:07.955309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34850762-c1d9-4c82-b1b4-540fa6bb291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:07.955955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34850762-c1d9-4c82-b1b4-540fa6bb291b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:07.956235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34850762-c1d9-4c82-b1b4-540fa6bb291b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:07.956503 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34850762-c1d9-4c82-b1b4-540fa6bb291b None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:07.957292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34850762-c1d9-4c82-b1b4-540fa6bb291b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:07.957599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34850762-c1d9-4c82-b1b4-540fa6bb291b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:07.959548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34850762-c1d9-4c82-b1b4-540fa6bb291b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:07.971241 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 322/642] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:07.972005 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34850762-c1d9-4c82-b1b4-540fa6bb291b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:07.993752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:08.023003 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88254bb6-3173-4071-b93b-1768b3337bf8 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:08.056392 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d65b3e-e561-4b21-a796-f1966d6d2e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:08.057179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d65b3e-e561-4b21-a796-f1966d6d2e23 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:08.057564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d65b3e-e561-4b21-a796-f1966d6d2e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:08.057841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d65b3e-e561-4b21-a796-f1966d6d2e23 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:08.065131 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d65b3e-e561-4b21-a796-f1966d6d2e23 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:08.066610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d65b3e-e561-4b21-a796-f1966d6d2e23 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:08.071522 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34850762-c1d9-4c82-b1b4-540fa6bb291b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:08.080839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-31d65b3e-e561-4b21-a796-f1966d6d2e23 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:15:08.080839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:08.080839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:08.080839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:08.080839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:08.080839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:08.080839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:08.080839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:08.080839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:08.080839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:08.080839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:08.080839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:08.080839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:08.080839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:08.080839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:08.080839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:08.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:08.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:08.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:08.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:08.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:08.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:08.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:08.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:08.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:08.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:08.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:08.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:08.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:08.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:08.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:08.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:08.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:08.081930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:08.082993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:08.082993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:08.082993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:08.082993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:08.082993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:08.082993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:08.082993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:08.082993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:08.082993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:15:08.082993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:08.082993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 321/643] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:15:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:08.082993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d65b3e-e561-4b21-a796-f1966d6d2e23 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:08.108038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e1eeb-6a49-4391-a6cf-666bbbec9d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:08.108835 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e1eeb-6a49-4391-a6cf-666bbbec9d4e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:08.109122 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e1eeb-6a49-4391-a6cf-666bbbec9d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:08.109429 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e1eeb-6a49-4391-a6cf-666bbbec9d4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:08.119656 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e1eeb-6a49-4391-a6cf-666bbbec9d4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:08.127446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-7e8e1eeb-6a49-4391-a6cf-666bbbec9d4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:08.127446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:08.127446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:08.127446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:08.127446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:08.127446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:08.127446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:08.127446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:08.127446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:08.127446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:08.127446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:08.127446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:08.127446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:08.127446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:08.127446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:08.127446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:08.128347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:08.128347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:08.128347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:08.128347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:08.128347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:08.128347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:08.128347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:08.128347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:08.128347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:08.128347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:08.128347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:08.128347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:08.128347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:08.128347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:08.128347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:08.128347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:08.129171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:08.129171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:08.129171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:08.129171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:08.129171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:08.129171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:08.129171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:08.129171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:08.129171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:08.129171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:08.129171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:08.129171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:08.129171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 323/644] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:15:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:08.129918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e1eeb-6a49-4391-a6cf-666bbbec9d4e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:08.145463 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:08.190702 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d65b3e-e561-4b21-a796-f1966d6d2e23 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:08.209784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:08.224235 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca49ed-bc63-4c88-a08d-7e35e3ac8ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:08.225440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca49ed-bc63-4c88-a08d-7e35e3ac8ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:08.225723 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca49ed-bc63-4c88-a08d-7e35e3ac8ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:08.226001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca49ed-bc63-4c88-a08d-7e35e3ac8ad5 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:08.226740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca49ed-bc63-4c88-a08d-7e35e3ac8ad5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:08.227046 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca49ed-bc63-4c88-a08d-7e35e3ac8ad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:08.228418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca49ed-bc63-4c88-a08d-7e35e3ac8ad5 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:08.231320 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e1eeb-6a49-4391-a6cf-666bbbec9d4e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:08.237735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 322/645] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:15:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:08.238513 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca49ed-bc63-4c88-a08d-7e35e3ac8ad5 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:08.267060 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb69ec-3c57-48d3-ba8f-f846d899c57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:08.267712 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb69ec-3c57-48d3-ba8f-f846d899c57b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:08.267991 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb69ec-3c57-48d3-ba8f-f846d899c57b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:08.268265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb69ec-3c57-48d3-ba8f-f846d899c57b None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:08.269034 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb69ec-3c57-48d3-ba8f-f846d899c57b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:08.269365 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb69ec-3c57-48d3-ba8f-f846d899c57b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:08.270789 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb69ec-3c57-48d3-ba8f-f846d899c57b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:08.283022 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 324/646] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:08.283617 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb69ec-3c57-48d3-ba8f-f846d899c57b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:08.338595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca49ed-bc63-4c88-a08d-7e35e3ac8ad5 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:08.356187 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:08.374420 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141f977-93ef-493f-b5a3-2b44a085404c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:08.375076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141f977-93ef-493f-b5a3-2b44a085404c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:08.375362 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141f977-93ef-493f-b5a3-2b44a085404c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:08.375640 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141f977-93ef-493f-b5a3-2b44a085404c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:08.376468 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141f977-93ef-493f-b5a3-2b44a085404c None admin] RBAC: Adding query filter params (role.id=82fa784b33dd4fe19c62367f39ac45b2, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=a7c1bb51c2b642ffa4708122d826fc67) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:08.376786 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141f977-93ef-493f-b5a3-2b44a085404c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:08.378254 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141f977-93ef-493f-b5a3-2b44a085404c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:08.384022 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 323/647] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:15:08 2022] GET /identity/v3/role_assignments?user.id=a7c1bb51c2b642ffa4708122d826fc67&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=82fa784b33dd4fe19c62367f39ac45b2 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:08.384799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141f977-93ef-493f-b5a3-2b44a085404c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:08.385170 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb69ec-3c57-48d3-ba8f-f846d899c57b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:08.432671 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff449ab-4e4c-4eb4-899f-79d0a645ce93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:08.433511 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff449ab-4e4c-4eb4-899f-79d0a645ce93 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:08.433800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff449ab-4e4c-4eb4-899f-79d0a645ce93 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:08.434080 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff449ab-4e4c-4eb4-899f-79d0a645ce93 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:08.434942 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff449ab-4e4c-4eb4-899f-79d0a645ce93 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:08.435255 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff449ab-4e4c-4eb4-899f-79d0a645ce93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:08.436757 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff449ab-4e4c-4eb4-899f-79d0a645ce93 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:08.445842 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:08.462677 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 325/648] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Jul 12 18:15:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:08.462677 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff449ab-4e4c-4eb4-899f-79d0a645ce93 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:08.507032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141f977-93ef-493f-b5a3-2b44a085404c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:08.543366 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f4ec7-2caa-4733-9978-9edf1dcd592b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:08.544032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f4ec7-2caa-4733-9978-9edf1dcd592b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:08.544308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f4ec7-2caa-4733-9978-9edf1dcd592b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:08.544578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f4ec7-2caa-4733-9978-9edf1dcd592b None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:08.545341 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f4ec7-2caa-4733-9978-9edf1dcd592b None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:08.545645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f4ec7-2caa-4733-9978-9edf1dcd592b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:08.547010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f4ec7-2caa-4733-9978-9edf1dcd592b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:08.558385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 324/649] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:15:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:08.559851 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f4ec7-2caa-4733-9978-9edf1dcd592b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:08.586187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff449ab-4e4c-4eb4-899f-79d0a645ce93 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:08.613659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:08.629677 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957adebe-7a85-463c-b79c-4e1873d8fb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:08.630735 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957adebe-7a85-463c-b79c-4e1873d8fb51 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:08.631190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957adebe-7a85-463c-b79c-4e1873d8fb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:08.631468 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957adebe-7a85-463c-b79c-4e1873d8fb51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:08.644178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957adebe-7a85-463c-b79c-4e1873d8fb51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:08.645687 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957adebe-7a85-463c-b79c-4e1873d8fb51 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:08.667803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-957adebe-7a85-463c-b79c-4e1873d8fb51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:08.667803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:08.667803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:08.667803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:08.667803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:08.667803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:08.667803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:08.667803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:08.667803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:08.667803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:08.667803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:08.667803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:08.667803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:08.667803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:08.667803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:08.668935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:08.668935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:08.668935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:08.668935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:08.668935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:08.668935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:08.668935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:08.668935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:08.668935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:08.668935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:08.668935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:08.668935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:08.668935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:08.668935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:08.668935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:08.668935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:08.668935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:08.670048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:08.670048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:08.670048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:08.670048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:08.670048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 326/650] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:08.670358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957adebe-7a85-463c-b79c-4e1873d8fb51 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:08.679076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f4ec7-2caa-4733-9978-9edf1dcd592b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:08.715336 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509edd3-64da-4b3f-88cf-a7d27e014fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:08.716641 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509edd3-64da-4b3f-88cf-a7d27e014fbc None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:08.716928 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509edd3-64da-4b3f-88cf-a7d27e014fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:08.717206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509edd3-64da-4b3f-88cf-a7d27e014fbc None admin] PATH_INFO: `/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/ade969d7aa3d49c08782a68ec5997382/roles/82fa784b33dd4fe19c62367f39ac45b2` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:08.731173 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:08.733024 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509edd3-64da-4b3f-88cf-a7d27e014fbc None admin] RBAC: Authorizing `identity:create_grant(project_id=5fee99b2e9234f88ac79ff70429b6f20, user_id=ade969d7aa3d49c08782a68ec5997382, role_id=82fa784b33dd4fe19c62367f39ac45b2)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:08.734923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509edd3-64da-4b3f-88cf-a7d27e014fbc None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:08.755047 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 325/651] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:15:08 2022] PUT /identity/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/ade969d7aa3d49c08782a68ec5997382/roles/82fa784b33dd4fe19c62367f39ac45b2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:15:08.755047 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509edd3-64da-4b3f-88cf-a7d27e014fbc None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:08.818321 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957adebe-7a85-463c-b79c-4e1873d8fb51 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:08.863528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508bd63-3eaf-45a1-a58b-8e60b259fc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:08.864469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508bd63-3eaf-45a1-a58b-8e60b259fc1b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:08.864797 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508bd63-3eaf-45a1-a58b-8e60b259fc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:08.865081 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508bd63-3eaf-45a1-a58b-8e60b259fc1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:08.875788 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:08.887932 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509edd3-64da-4b3f-88cf-a7d27e014fbc None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:08.931082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a9a91-88ae-4431-96ec-ee5ec42228d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:08.932168 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a9a91-88ae-4431-96ec-ee5ec42228d5 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:08.932639 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a9a91-88ae-4431-96ec-ee5ec42228d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:08.933067 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a9a91-88ae-4431-96ec-ee5ec42228d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:08.947233 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a9a91-88ae-4431-96ec-ee5ec42228d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:08.948955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a9a91-88ae-4431-96ec-ee5ec42228d5 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:08.959634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508bd63-3eaf-45a1-a58b-8e60b259fc1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:08.961085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508bd63-3eaf-45a1-a58b-8e60b259fc1b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:08.968512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-e80a9a91-88ae-4431-96ec-ee5ec42228d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:08.968512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:08.968512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:08.968512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:08.968512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:08.968512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:08.968512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:08.968512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:08.968512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:08.968512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:08.968512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:08.968512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:08.968512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:08.968512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:08.968512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:08.969465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:08.969465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:08.969465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:08.969465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:08.969465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:08.969465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:08.969465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:08.969465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:08.969465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:08.969465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:08.969465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:08.969465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:08.969465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:08.969465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:08.969465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:08.969465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:08.969465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:08.970434 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:08.970434 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:08.970434 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:08.970434 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:08.974953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 326/652] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:08.975987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a9a91-88ae-4431-96ec-ee5ec42228d5 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:09.025038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:09.091494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 327/653] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:15:09.093406 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508bd63-3eaf-45a1-a58b-8e60b259fc1b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:09.094881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a9a91-88ae-4431-96ec-ee5ec42228d5 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:09.132844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d152c8-bd49-4ba8-99d7-4ef9b27ec0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:09.133522 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d152c8-bd49-4ba8-99d7-4ef9b27ec0fd None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:09.133805 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d152c8-bd49-4ba8-99d7-4ef9b27ec0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:09.134082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d152c8-bd49-4ba8-99d7-4ef9b27ec0fd None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:09.134807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d152c8-bd49-4ba8-99d7-4ef9b27ec0fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:09.135117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d152c8-bd49-4ba8-99d7-4ef9b27ec0fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:09.136507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d152c8-bd49-4ba8-99d7-4ef9b27ec0fd None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:09.149173 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 327/654] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:09.150087 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d152c8-bd49-4ba8-99d7-4ef9b27ec0fd None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:09.160307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:09.226872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508bd63-3eaf-45a1-a58b-8e60b259fc1b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:09.263019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5d3b0-d85a-4b24-8e2b-829dd894ac1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:09.263691 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5d3b0-d85a-4b24-8e2b-829dd894ac1a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:09.263972 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5d3b0-d85a-4b24-8e2b-829dd894ac1a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:09.264246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5d3b0-d85a-4b24-8e2b-829dd894ac1a None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:09.264968 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5d3b0-d85a-4b24-8e2b-829dd894ac1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:09.265283 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5d3b0-d85a-4b24-8e2b-829dd894ac1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:09.266964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5d3b0-d85a-4b24-8e2b-829dd894ac1a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:09.279394 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 328/655] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:09.281582 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d152c8-bd49-4ba8-99d7-4ef9b27ec0fd None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:09.284806 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5d3b0-d85a-4b24-8e2b-829dd894ac1a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:09.296983 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:09.326794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134a17e-acdc-4ac1-995e-44feba8a27da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:09.327614 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134a17e-acdc-4ac1-995e-44feba8a27da None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:09.327895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134a17e-acdc-4ac1-995e-44feba8a27da None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:09.328169 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134a17e-acdc-4ac1-995e-44feba8a27da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:09.339985 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134a17e-acdc-4ac1-995e-44feba8a27da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:09.341485 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134a17e-acdc-4ac1-995e-44feba8a27da None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:09.360076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-d134a17e-acdc-4ac1-995e-44feba8a27da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:09.360076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:09.360076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:09.360076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:09.360076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:09.360076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:09.360076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:09.360076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:09.360076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:09.360076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:09.360076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:09.360076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:09.360076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:09.360076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:09.360076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:09.360977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:09.360977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:09.360977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:09.360977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:09.360977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:09.360977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:09.360977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:09.360977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:09.360977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:09.360977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:09.360977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:09.360977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:09.360977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:09.360977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:09.360977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:09.360977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:09.360977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:09.361883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:09.361883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:09.361883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:09.361883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:09.361883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 328/656] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:09.362585 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134a17e-acdc-4ac1-995e-44feba8a27da None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:09.419814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5d3b0-d85a-4b24-8e2b-829dd894ac1a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:09.424496 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:09.460613 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4891fa-5d3e-4bff-ab0a-eeaf953211c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:09.461220 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4891fa-5d3e-4bff-ab0a-eeaf953211c4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:09.461551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4891fa-5d3e-4bff-ab0a-eeaf953211c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:09.461824 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4891fa-5d3e-4bff-ab0a-eeaf953211c4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:09.470059 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4891fa-5d3e-4bff-ab0a-eeaf953211c4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:09.471584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4891fa-5d3e-4bff-ab0a-eeaf953211c4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:09.483873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134a17e-acdc-4ac1-995e-44feba8a27da None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:09.487800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-5c4891fa-5d3e-4bff-ab0a-eeaf953211c4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 18:15:09.487800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:09.487800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:09.487800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:09.487800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:09.487800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:09.487800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:09.487800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:09.487800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:09.487800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:09.487800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:09.487800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:09.487800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:09.487800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:09.487800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:09.487800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:09.488725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:09.488725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:09.488725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:09.488725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:09.488725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:09.488725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:09.488725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:09.488725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:09.488725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:09.488725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:09.488725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:09.488725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:09.488725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:09.488725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:09.488725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:09.488725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:09.488725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:09.488725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:09.489743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:09.489743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:09.489743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:09.489743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:09.489743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:09.489743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:09.489743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:09.489743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:09.489743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 18:15:09.489743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:09.489743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 329/657] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:15:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:09.490873 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4891fa-5d3e-4bff-ab0a-eeaf953211c4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:09.535202 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08579a1-2ebd-438e-817e-2ca7d2202dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:09.536008 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08579a1-2ebd-438e-817e-2ca7d2202dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:09.536291 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08579a1-2ebd-438e-817e-2ca7d2202dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:09.537592 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08579a1-2ebd-438e-817e-2ca7d2202dc7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:09.547792 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08579a1-2ebd-438e-817e-2ca7d2202dc7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:09.549810 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08579a1-2ebd-438e-817e-2ca7d2202dc7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:09.567141 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:09.574238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-b08579a1-2ebd-438e-817e-2ca7d2202dc7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 18:15:09.574238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:09.574238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:09.574238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:09.574238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:09.574238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:09.574238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:09.574238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:09.574238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:09.574238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:09.574238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:09.574238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:09.574238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:09.574238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:09.574238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:09.574238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:09.575399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:09.575399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:09.575399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:09.575399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:09.575399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:09.575399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:09.575399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:09.575399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:09.575399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:09.575399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:09.575399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:09.575399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:09.575399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:09.575399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:09.575399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:09.575399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:09.575399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:09.575399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:09.576325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:09.576325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:09.576325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:09.576325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:09.576325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:09.576325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:09.576325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:09.576325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:09.576325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 18:15:09.576325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:09.578639 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 329/658] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:15:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:09.579691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08579a1-2ebd-438e-817e-2ca7d2202dc7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:09.612224 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4891fa-5d3e-4bff-ab0a-eeaf953211c4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:09.647348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b763665-abb1-462b-9dec-c80a468cbd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:09.648248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b763665-abb1-462b-9dec-c80a468cbd8a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:09.648662 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b763665-abb1-462b-9dec-c80a468cbd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:09.649081 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b763665-abb1-462b-9dec-c80a468cbd8a None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:09.649988 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b763665-abb1-462b-9dec-c80a468cbd8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:09.650436 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b763665-abb1-462b-9dec-c80a468cbd8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:09.652062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b763665-abb1-462b-9dec-c80a468cbd8a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:09.664874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 330/659] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:09.666066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b763665-abb1-462b-9dec-c80a468cbd8a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:09.726891 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08579a1-2ebd-438e-817e-2ca7d2202dc7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:09.753159 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:09.770890 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b763665-abb1-462b-9dec-c80a468cbd8a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:09.774424 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f481b-2f60-422c-8cdb-30ad9f813438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:09.774868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f481b-2f60-422c-8cdb-30ad9f813438 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:09.775252 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f481b-2f60-422c-8cdb-30ad9f813438 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:09.775629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f481b-2f60-422c-8cdb-30ad9f813438 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:09.776566 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f481b-2f60-422c-8cdb-30ad9f813438 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:09.776996 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f481b-2f60-422c-8cdb-30ad9f813438 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:09.778578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f481b-2f60-422c-8cdb-30ad9f813438 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:09.798550 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 330/660] 10.222.0.57 () {56 vars in 1139 bytes} [Tue Jul 12 18:15:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:09.799604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f481b-2f60-422c-8cdb-30ad9f813438 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:09.800563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:09.808905 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b789003-5e82-4075-bec4-8862352bb234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:09.809614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789003-5e82-4075-bec4-8862352bb234 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:09.809945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789003-5e82-4075-bec4-8862352bb234 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:09.810221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789003-5e82-4075-bec4-8862352bb234 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:09.811093 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b789003-5e82-4075-bec4-8862352bb234 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:09.811781 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b789003-5e82-4075-bec4-8862352bb234 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:09.812991 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b789003-5e82-4075-bec4-8862352bb234 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:09.832660 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 331/661] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Jul 12 18:15:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:09.833379 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b789003-5e82-4075-bec4-8862352bb234 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:09.928743 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f481b-2f60-422c-8cdb-30ad9f813438 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:09.954153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b789003-5e82-4075-bec4-8862352bb234 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:09.973802 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461343a-879e-4b63-8a1c-7ea6a2e50e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:09.975115 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461343a-879e-4b63-8a1c-7ea6a2e50e0e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:09.975410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461343a-879e-4b63-8a1c-7ea6a2e50e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:09.975658 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461343a-879e-4b63-8a1c-7ea6a2e50e0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:09.985156 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461343a-879e-4b63-8a1c-7ea6a2e50e0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:09.987163 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461343a-879e-4b63-8a1c-7ea6a2e50e0e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:09.991293 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e0bef-26b1-453e-b095-65f1845c6d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:09.991943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e0bef-26b1-453e-b095-65f1845c6d69 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:09.992225 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e0bef-26b1-453e-b095-65f1845c6d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:09.992497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e0bef-26b1-453e-b095-65f1845c6d69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:10.002952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-a461343a-879e-4b63-8a1c-7ea6a2e50e0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:10.002952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:10.002952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:10.002952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:10.002952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:10.002952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:10.002952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:10.002952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:10.002952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:10.002952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:10.002952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:10.002952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:10.002952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:10.002952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:10.002952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:10.003866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:10.003866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:10.003866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:10.003866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:10.003866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:10.003866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:10.003866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:10.003866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:10.003866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:10.003866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:10.003866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:10.003866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:10.003866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:10.003866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:10.003866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:10.003866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:10.003866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:10.004750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:10.004750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:10.004750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:10.004750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:10.004750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:10.004750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:10.004750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:10.004750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:10.005170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 331/662] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:10.009284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461343a-879e-4b63-8a1c-7ea6a2e50e0e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:10.051469 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:10.056751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:10.072808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e0bef-26b1-453e-b095-65f1845c6d69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:10.074895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e0bef-26b1-453e-b095-65f1845c6d69 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:10.135897 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461343a-879e-4b63-8a1c-7ea6a2e50e0e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:10.183892 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662ab0f-af0d-4dd9-8afa-05fea9572b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:10.184552 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662ab0f-af0d-4dd9-8afa-05fea9572b4f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:10.184831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662ab0f-af0d-4dd9-8afa-05fea9572b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:10.185102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662ab0f-af0d-4dd9-8afa-05fea9572b4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:10.188144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 332/663] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:15:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:15:10.189180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e0bef-26b1-453e-b095-65f1845c6d69 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:10.277569 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662ab0f-af0d-4dd9-8afa-05fea9572b4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:10.279231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662ab0f-af0d-4dd9-8afa-05fea9572b4f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:10.280916 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:10.298854 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e0bef-26b1-453e-b095-65f1845c6d69 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:10.325723 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:10.337055 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49fc07-9e98-4758-b7e7-07875f8f2db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:10.337826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49fc07-9e98-4758-b7e7-07875f8f2db4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:10.338204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49fc07-9e98-4758-b7e7-07875f8f2db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:10.338556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49fc07-9e98-4758-b7e7-07875f8f2db4 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:10.339409 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49fc07-9e98-4758-b7e7-07875f8f2db4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:10.339790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49fc07-9e98-4758-b7e7-07875f8f2db4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:10.341355 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49fc07-9e98-4758-b7e7-07875f8f2db4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:10.354507 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 333/664] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:10.355413 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49fc07-9e98-4758-b7e7-07875f8f2db4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:10.403081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 332/665] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:15:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:15:10.404034 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662ab0f-af0d-4dd9-8afa-05fea9572b4f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:10.492298 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49fc07-9e98-4758-b7e7-07875f8f2db4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:10.508609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662ab0f-af0d-4dd9-8afa-05fea9572b4f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:10.538351 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109db86-e99f-4052-bbf3-441a63920b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:10.539079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109db86-e99f-4052-bbf3-441a63920b63 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:10.539485 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109db86-e99f-4052-bbf3-441a63920b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:10.539764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109db86-e99f-4052-bbf3-441a63920b63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:10.544853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9cb0e-0a17-4c9b-be9e-a27dddfb88ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:10.545537 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9cb0e-0a17-4c9b-be9e-a27dddfb88ba None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:10.545825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9cb0e-0a17-4c9b-be9e-a27dddfb88ba None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:10.546103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9cb0e-0a17-4c9b-be9e-a27dddfb88ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:10.546967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9cb0e-0a17-4c9b-be9e-a27dddfb88ba None admin] RBAC: Adding query filter params (role.id=82fa784b33dd4fe19c62367f39ac45b2, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=faf61fd1e2ab426bbbbcc8dc7d552942) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:10.547318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9cb0e-0a17-4c9b-be9e-a27dddfb88ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:10.548792 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9cb0e-0a17-4c9b-be9e-a27dddfb88ba None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:10.550846 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109db86-e99f-4052-bbf3-441a63920b63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:10.552216 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:10.552324 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109db86-e99f-4052-bbf3-441a63920b63 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:10.556550 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 333/666] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:15:10 2022] GET /identity/v3/role_assignments?user.id=faf61fd1e2ab426bbbbcc8dc7d552942&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=82fa784b33dd4fe19c62367f39ac45b2 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:10.557403 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9cb0e-0a17-4c9b-be9e-a27dddfb88ba None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:10.566303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:10.575877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-5109db86-e99f-4052-bbf3-441a63920b63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:10.575877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:10.575877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:10.575877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:10.575877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:10.575877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:10.575877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:10.575877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:10.575877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:10.575877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:10.575877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:10.575877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:10.575877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:10.575877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:10.575877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:10.577459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:10.577459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:10.577459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:10.577459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:10.577459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:10.577459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:10.577459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:10.577459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:10.577459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:10.577459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:10.577459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:10.577459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:10.577459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:10.577459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:10.577459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:10.577459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:10.577459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:10.578699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:10.578699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:10.578699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:10.578699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:10.581862 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 334/667] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:10.584638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36596166-6bec-450b-bb82-4e22711e6201 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:10.584929 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36596166-6bec-450b-bb82-4e22711e6201 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:10.585212 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36596166-6bec-450b-bb82-4e22711e6201 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:10.590676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 335/668] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:10.590676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36596166-6bec-450b-bb82-4e22711e6201 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:10.717159 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9cb0e-0a17-4c9b-be9e-a27dddfb88ba None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:10.731214 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36596166-6bec-450b-bb82-4e22711e6201 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:10.758125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7fce3-fbf6-4b6a-a6c4-362553d078fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:10.759045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7fce3-fbf6-4b6a-a6c4-362553d078fc None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:10.759485 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7fce3-fbf6-4b6a-a6c4-362553d078fc None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:10.759762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7fce3-fbf6-4b6a-a6c4-362553d078fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:10.772563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a635c64-0793-47cd-879c-aa9329c471ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:10.773234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a635c64-0793-47cd-879c-aa9329c471ed None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:10.773558 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a635c64-0793-47cd-879c-aa9329c471ed None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:10.773836 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a635c64-0793-47cd-879c-aa9329c471ed None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:10.773947 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7fce3-fbf6-4b6a-a6c4-362553d078fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:10.774564 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a635c64-0793-47cd-879c-aa9329c471ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:10.774871 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a635c64-0793-47cd-879c-aa9329c471ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:10.775406 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7fce3-fbf6-4b6a-a6c4-362553d078fc None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:10.776229 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a635c64-0793-47cd-879c-aa9329c471ed None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:10.789242 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 336/669] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:10.790825 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e4099-1018-4a3a-99a6-9b3bc57830c3 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:10.791315 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e4099-1018-4a3a-99a6-9b3bc57830c3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:10.791790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e4099-1018-4a3a-99a6-9b3bc57830c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:10.796866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-9ff7fce3-fbf6-4b6a-a6c4-362553d078fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:10.796866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:10.796866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:10.796866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:10.796866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:10.796866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:10.796866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:10.796866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:10.796866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:10.796866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:10.796866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:10.796866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:10.796866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:10.796866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:10.796866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:10.797794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:10.797794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:10.797794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:10.797794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:10.797794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:10.797794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:10.797794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:10.797794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:10.797794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:10.797794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:10.797794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:10.797794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:10.797794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:10.797794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:10.797794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:10.797794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:10.797794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:10.798655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:10.798655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:10.798655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:10.798655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:10.798882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 334/670] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:10.799530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7fce3-fbf6-4b6a-a6c4-362553d078fc None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:10.812361 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-583e4099-1018-4a3a-99a6-9b3bc57830c3 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:10.813910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-583e4099-1018-4a3a-99a6-9b3bc57830c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:10.870941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:10.883256 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:10.905403 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 337/671] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:15:10.906320 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e4099-1018-4a3a-99a6-9b3bc57830c3 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:10.921108 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7fce3-fbf6-4b6a-a6c4-362553d078fc None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:10.958205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77489dc4-4b69-488d-9884-89b8830d26f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:10.960126 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77489dc4-4b69-488d-9884-89b8830d26f0 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:10.960412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77489dc4-4b69-488d-9884-89b8830d26f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:10.960685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77489dc4-4b69-488d-9884-89b8830d26f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:10.970376 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77489dc4-4b69-488d-9884-89b8830d26f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:10.971847 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77489dc4-4b69-488d-9884-89b8830d26f0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:10.992687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-77489dc4-4b69-488d-9884-89b8830d26f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:10.992687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:10.992687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:10.992687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:10.992687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:10.992687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:10.992687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:10.992687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:10.992687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:10.992687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:10.992687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:10.992687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:10.992687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:10.992687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:10.992687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:10.993877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:10.993877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:10.993877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:10.993877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:10.993877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:10.993877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:10.993877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:10.993877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:10.993877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:10.993877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:10.993877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:10.993877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:10.993877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:10.993877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:10.993877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:10.993877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:10.993877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:10.999857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:10.999857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:10.999857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:10.999857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:10.999857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:10.999857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:10.999857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:10.999857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:10.999857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 335/672] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:10.999857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8af3e-c0ad-4f8a-be17-b4b1175a879a None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:10.999857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8af3e-c0ad-4f8a-be17-b4b1175a879a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:11.000482 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8af3e-c0ad-4f8a-be17-b4b1175a879a None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:11.000482 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 336/673] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:11.000482 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8af3e-c0ad-4f8a-be17-b4b1175a879a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:11.027887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e4099-1018-4a3a-99a6-9b3bc57830c3 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:11.066410 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a4c44-4673-47d3-b2f1-834afaaf9547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:11.066410 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a4c44-4673-47d3-b2f1-834afaaf9547 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:11.067386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a4c44-4673-47d3-b2f1-834afaaf9547 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:11.067619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a4c44-4673-47d3-b2f1-834afaaf9547 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:11.068377 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a4c44-4673-47d3-b2f1-834afaaf9547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:11.068687 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a4c44-4673-47d3-b2f1-834afaaf9547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:11.070097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a4c44-4673-47d3-b2f1-834afaaf9547 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:11.088994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 338/674] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:11.088994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a4c44-4673-47d3-b2f1-834afaaf9547 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:11.112054 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8af3e-c0ad-4f8a-be17-b4b1175a879a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:11.127599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:11.140308 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:11.152952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ad061-1d71-4eab-bdb0-97fe367258cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:11.154012 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ad061-1d71-4eab-bdb0-97fe367258cd None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:11.154394 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ad061-1d71-4eab-bdb0-97fe367258cd None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:11.154811 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ad061-1d71-4eab-bdb0-97fe367258cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:11.167755 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ad061-1d71-4eab-bdb0-97fe367258cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:11.176538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-4b1ad061-1d71-4eab-bdb0-97fe367258cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:15:11.176538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:11.176538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:11.176538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:11.176538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:11.176538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:11.176538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:11.176538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:11.176538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:11.176538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:11.176538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:11.176538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:11.176538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:11.176538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:11.176538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:11.176538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:11.177669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:11.177669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:11.177669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:11.177669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:11.177669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:11.177669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:11.177669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:11.177669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:11.177669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:11.177669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:11.177669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:11.177669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:11.177669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:11.177669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:11.177669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:11.177669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:11.183800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:11.183800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:11.183800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:11.183800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:11.183800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:11.183800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:11.183800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:11.183800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:11.183800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:11.183800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:11.183800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:15:11.183800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:11.183800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 337/675] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:15:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:11.183800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ccf34-2271-4087-bc09-6b8407be5719 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:11.184575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ccf34-2271-4087-bc09-6b8407be5719 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:11.184575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ccf34-2271-4087-bc09-6b8407be5719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:11.198058 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-200ccf34-2271-4087-bc09-6b8407be5719 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:11.198197 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a4c44-4673-47d3-b2f1-834afaaf9547 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:11.199500 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-200ccf34-2271-4087-bc09-6b8407be5719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:11.233874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a580990-4bfa-45d0-97a1-17a3540950c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:11.234572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a580990-4bfa-45d0-97a1-17a3540950c4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:11.234894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a580990-4bfa-45d0-97a1-17a3540950c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:11.235175 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a580990-4bfa-45d0-97a1-17a3540950c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:11.235954 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a580990-4bfa-45d0-97a1-17a3540950c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:11.236264 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a580990-4bfa-45d0-97a1-17a3540950c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:11.237739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a580990-4bfa-45d0-97a1-17a3540950c4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:11.250487 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 339/676] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:11.255849 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a580990-4bfa-45d0-97a1-17a3540950c4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:11.269617 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 338/677] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:15:11.283033 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ccf34-2271-4087-bc09-6b8407be5719 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:11.362997 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a580990-4bfa-45d0-97a1-17a3540950c4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:11.374440 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:11.396145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ccf34-2271-4087-bc09-6b8407be5719 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:11.397841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:11.401171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bb129-5f6c-4e72-bd53-f9e311c055e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:11.401986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bb129-5f6c-4e72-bd53-f9e311c055e8 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:11.402273 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bb129-5f6c-4e72-bd53-f9e311c055e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:11.402551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bb129-5f6c-4e72-bd53-f9e311c055e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:11.409547 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bb129-5f6c-4e72-bd53-f9e311c055e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:11.411011 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bb129-5f6c-4e72-bd53-f9e311c055e8 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:11.426953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-393bb129-5f6c-4e72-bd53-f9e311c055e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:11.426953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:11.426953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:11.426953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:11.426953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:11.426953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:11.426953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:11.426953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:11.426953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:11.426953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:11.426953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:11.426953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:11.426953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:11.426953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:11.426953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:11.428416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:11.428416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:11.428416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:11.428416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:11.428416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:11.428416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:11.428416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:11.428416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:11.428416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:11.428416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:11.428416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:11.428416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:11.428416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:11.428416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:11.428416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:11.428416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:11.428416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:11.429861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:11.429861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:11.429861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:11.429861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:11.429861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:11.429861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:11.429861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:11.429861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:11.429861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 340/678] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:11.429861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bb129-5f6c-4e72-bd53-f9e311c055e8 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:11.439576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9921fe-82dc-475b-bc17-2e62545c80a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:11.440250 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9921fe-82dc-475b-bc17-2e62545c80a8 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:11.440533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9921fe-82dc-475b-bc17-2e62545c80a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:11.440809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9921fe-82dc-475b-bc17-2e62545c80a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:11.441578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9921fe-82dc-475b-bc17-2e62545c80a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:11.441880 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9921fe-82dc-475b-bc17-2e62545c80a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:11.443305 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9921fe-82dc-475b-bc17-2e62545c80a8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:11.452345 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 339/679] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:15:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:11.454136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9921fe-82dc-475b-bc17-2e62545c80a8 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:11.535187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bb129-5f6c-4e72-bd53-f9e311c055e8 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:11.569902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9921fe-82dc-475b-bc17-2e62545c80a8 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:11.576858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad88142-e331-4108-ad42-08003a9f0b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:11.577682 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad88142-e331-4108-ad42-08003a9f0b31 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:11.577968 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad88142-e331-4108-ad42-08003a9f0b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:11.578249 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad88142-e331-4108-ad42-08003a9f0b31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:11.579370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad88142-e331-4108-ad42-08003a9f0b31 None admin] RBAC: Adding query filter params (role.id=82fa784b33dd4fe19c62367f39ac45b2, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=b6dc63ae259842209831040cbf45d316) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:11.579370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad88142-e331-4108-ad42-08003a9f0b31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:11.581062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad88142-e331-4108-ad42-08003a9f0b31 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:11.597285 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 341/680] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:15:11 2022] GET /identity/v3/role_assignments?user.id=b6dc63ae259842209831040cbf45d316&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=82fa784b33dd4fe19c62367f39ac45b2 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:11.597285 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad88142-e331-4108-ad42-08003a9f0b31 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:11.624450 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:11.626066 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cc2af-c324-4088-a052-d359665bcaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:11.626909 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cc2af-c324-4088-a052-d359665bcaab None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:11.627195 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cc2af-c324-4088-a052-d359665bcaab None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:11.627527 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cc2af-c324-4088-a052-d359665bcaab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:11.644251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cc2af-c324-4088-a052-d359665bcaab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:11.655608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-b91cc2af-c324-4088-a052-d359665bcaab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:11.655608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:11.655608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:11.655608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:11.655608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:11.655608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:11.655608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:11.655608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:11.655608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:11.655608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:11.655608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:11.655608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:11.655608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:11.655608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:11.655608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:11.655608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:11.656644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:11.656644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:11.656644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:11.656644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:11.656644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:11.656644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:11.656644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:11.656644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:11.656644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:11.656644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:11.656644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:11.656644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:11.656644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:11.656644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:11.656644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:11.656644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:11.657495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:11.657495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:11.657495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:11.657495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:11.657495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:11.657495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:11.657495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:11.657495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:11.657495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:11.657495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:11.657495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:11.657495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:11.661414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 340/681] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:15:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:11.663839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cc2af-c324-4088-a052-d359665bcaab None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:11.706589 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:11.712355 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad88142-e331-4108-ad42-08003a9f0b31 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:11.760778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac803a42-d825-4bb8-a6db-e98ef2b7651d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:11.760778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac803a42-d825-4bb8-a6db-e98ef2b7651d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:11.761182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac803a42-d825-4bb8-a6db-e98ef2b7651d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:11.761182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac803a42-d825-4bb8-a6db-e98ef2b7651d None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:11.761946 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac803a42-d825-4bb8-a6db-e98ef2b7651d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:11.762260 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac803a42-d825-4bb8-a6db-e98ef2b7651d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:11.763752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac803a42-d825-4bb8-a6db-e98ef2b7651d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:11.779700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 342/682] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:11.780912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac803a42-d825-4bb8-a6db-e98ef2b7651d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:11.815860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cc2af-c324-4088-a052-d359665bcaab None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:11.859950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57085791-e134-44c8-bf77-6a0f4f970669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:11.860719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57085791-e134-44c8-bf77-6a0f4f970669 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:11.861093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57085791-e134-44c8-bf77-6a0f4f970669 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:11.861302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57085791-e134-44c8-bf77-6a0f4f970669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:11.872844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57085791-e134-44c8-bf77-6a0f4f970669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:11.874361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57085791-e134-44c8-bf77-6a0f4f970669 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:11.892425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-57085791-e134-44c8-bf77-6a0f4f970669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:11.892425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:11.892425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:11.892425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:11.892425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:11.892425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:11.892425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:11.892425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:11.892425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:11.892425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:11.892425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:11.892425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:11.892425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:11.892425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:11.892425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:11.893344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:11.893344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:11.893344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:11.893344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:11.893344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:11.893344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:11.893344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:11.893344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:11.893344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:11.893344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:11.893344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:11.893344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:11.893344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:11.893344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:11.893344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:11.893344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:11.893344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:11.894231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:11.894231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:11.894231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:11.894231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:11.894231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 341/683] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:11.894930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57085791-e134-44c8-bf77-6a0f4f970669 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:11.897921 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:11.904434 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac803a42-d825-4bb8-a6db-e98ef2b7651d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:11.942222 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a468d8e-c865-455d-9fe2-6ff3aef8e1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:11.943821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a468d8e-c865-455d-9fe2-6ff3aef8e1db None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:11.944333 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a468d8e-c865-455d-9fe2-6ff3aef8e1db None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:11.944838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a468d8e-c865-455d-9fe2-6ff3aef8e1db None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:11.945829 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a468d8e-c865-455d-9fe2-6ff3aef8e1db None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:11.946359 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a468d8e-c865-455d-9fe2-6ff3aef8e1db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:11.947958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a468d8e-c865-455d-9fe2-6ff3aef8e1db None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:11.957090 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 343/684] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:15:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:11.958142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a468d8e-c865-455d-9fe2-6ff3aef8e1db None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:11.993742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:12.024035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57085791-e134-44c8-bf77-6a0f4f970669 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:12.066879 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d17c8-fcc7-4b0a-a438-3fdda99b4822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:12.068843 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d17c8-fcc7-4b0a-a438-3fdda99b4822 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:12.069377 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d17c8-fcc7-4b0a-a438-3fdda99b4822 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:12.070199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d17c8-fcc7-4b0a-a438-3fdda99b4822 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:12.071436 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d17c8-fcc7-4b0a-a438-3fdda99b4822 None admin] RBAC: Adding query filter params (role.id=82fa784b33dd4fe19c62367f39ac45b2, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=5602d0a51329412ab6e908e7787531a7) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:12.072283 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d17c8-fcc7-4b0a-a438-3fdda99b4822 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:12.074647 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d17c8-fcc7-4b0a-a438-3fdda99b4822 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:12.081513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a468d8e-c865-455d-9fe2-6ff3aef8e1db None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:12.089000 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 342/685] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:15:11 2022] GET /identity/v3/role_assignments?user.id=5602d0a51329412ab6e908e7787531a7&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=82fa784b33dd4fe19c62367f39ac45b2 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:12.089000 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d17c8-fcc7-4b0a-a438-3fdda99b4822 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:12.156062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872705e-cdf2-4aea-9177-1629371eaa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:12.157217 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872705e-cdf2-4aea-9177-1629371eaa92 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:12.157782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872705e-cdf2-4aea-9177-1629371eaa92 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:12.158263 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872705e-cdf2-4aea-9177-1629371eaa92 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:12.159333 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872705e-cdf2-4aea-9177-1629371eaa92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:12.159845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872705e-cdf2-4aea-9177-1629371eaa92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:12.162047 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872705e-cdf2-4aea-9177-1629371eaa92 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:12.176130 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 344/686] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:12.198600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872705e-cdf2-4aea-9177-1629371eaa92 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:12.227801 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d17c8-fcc7-4b0a-a438-3fdda99b4822 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:12.237657 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:12.266438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c0065-d6bd-4619-ba23-371225e680fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:12.267249 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c0065-d6bd-4619-ba23-371225e680fe None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:12.267535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c0065-d6bd-4619-ba23-371225e680fe None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:12.267814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c0065-d6bd-4619-ba23-371225e680fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:12.277955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:12.282198 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c0065-d6bd-4619-ba23-371225e680fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:12.282852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c0065-d6bd-4619-ba23-371225e680fe None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:12.303599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-961c0065-d6bd-4619-ba23-371225e680fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:12.303599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:12.303599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:12.303599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:12.303599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:12.303599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:12.303599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:12.303599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:12.303599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:12.303599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:12.303599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:12.303599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:12.303599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:12.303599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:12.303599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:12.304544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:12.304544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:12.304544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:12.304544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:12.304544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:12.304544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:12.304544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:12.304544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:12.304544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:12.304544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:12.304544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:12.304544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:12.304544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:12.304544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:12.304544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:12.304544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:12.304544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:12.305523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:12.305523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:12.305523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:12.305523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:12.305523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 343/687] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:12.310330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c0065-d6bd-4619-ba23-371225e680fe None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:12.375708 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872705e-cdf2-4aea-9177-1629371eaa92 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:12.411096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a96782-79a6-4f5c-a605-86e5e3b98e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:12.411808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a96782-79a6-4f5c-a605-86e5e3b98e98 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:12.412090 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a96782-79a6-4f5c-a605-86e5e3b98e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:12.412368 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a96782-79a6-4f5c-a605-86e5e3b98e98 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:12.420407 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c0065-d6bd-4619-ba23-371225e680fe None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:12.423311 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a96782-79a6-4f5c-a605-86e5e3b98e98 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:12.424776 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a96782-79a6-4f5c-a605-86e5e3b98e98 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:12.440690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-87a96782-79a6-4f5c-a605-86e5e3b98e98 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:15:12.440690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:12.440690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:12.440690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:12.440690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:12.440690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:12.440690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:12.440690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:12.440690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:12.440690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:12.440690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:12.440690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:12.440690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:12.440690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:12.440690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:12.440690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:12.441742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:12.441742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:12.441742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:12.441742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:12.441742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:12.441742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:12.441742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:12.441742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:12.441742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:12.441742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:12.441742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:12.441742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:12.441742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:12.441742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:12.441742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:12.441742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:12.441742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:12.441742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:12.442752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:12.442752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:12.442752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:12.442752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:12.442752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:12.442752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:12.442752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:12.442752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:12.442752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:15:12.442752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:12.442752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 345/688] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Jul 12 18:15:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:12.448029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a96782-79a6-4f5c-a605-86e5e3b98e98 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:12.458873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b32c3d-2d44-49cd-87c1-c27d6559a44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:12.459542 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b32c3d-2d44-49cd-87c1-c27d6559a44f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:12.459898 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b32c3d-2d44-49cd-87c1-c27d6559a44f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:12.460211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b32c3d-2d44-49cd-87c1-c27d6559a44f None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:12.460945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b32c3d-2d44-49cd-87c1-c27d6559a44f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:12.461300 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b32c3d-2d44-49cd-87c1-c27d6559a44f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:12.462694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b32c3d-2d44-49cd-87c1-c27d6559a44f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:12.481680 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 344/689] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:12.482842 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b32c3d-2d44-49cd-87c1-c27d6559a44f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:12.542039 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:12.551778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:12.592366 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a96782-79a6-4f5c-a605-86e5e3b98e98 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:12.599778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b32c3d-2d44-49cd-87c1-c27d6559a44f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:12.630072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970353cd-3f03-47f5-a140-96f94c76623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:12.631069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970353cd-3f03-47f5-a140-96f94c76623a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:12.631390 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970353cd-3f03-47f5-a140-96f94c76623a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:12.631766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970353cd-3f03-47f5-a140-96f94c76623a None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:12.633280 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970353cd-3f03-47f5-a140-96f94c76623a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:12.633280 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970353cd-3f03-47f5-a140-96f94c76623a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:12.634785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970353cd-3f03-47f5-a140-96f94c76623a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:12.638020 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5f98c-ac9f-4bc8-b551-f020341d0e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:12.639025 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5f98c-ac9f-4bc8-b551-f020341d0e96 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:12.639488 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5f98c-ac9f-4bc8-b551-f020341d0e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:12.639965 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5f98c-ac9f-4bc8-b551-f020341d0e96 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:12.647784 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5f98c-ac9f-4bc8-b551-f020341d0e96 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:12.649521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5f98c-ac9f-4bc8-b551-f020341d0e96 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:12.654063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 346/690] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Jul 12 18:15:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:12.659881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970353cd-3f03-47f5-a140-96f94c76623a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:12.666456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-c7b5f98c-ac9f-4bc8-b551-f020341d0e96 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:15:12.666456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:12.666456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:12.666456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:12.666456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:12.666456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:12.666456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:12.666456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:12.666456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:12.666456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:12.666456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:12.666456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:12.666456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:12.666456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:12.666456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:12.666456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:12.667442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:12.667442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:12.667442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:12.667442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:12.667442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:12.667442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:12.667442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:12.667442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:12.667442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:12.667442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:12.667442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:12.667442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:12.667442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:12.667442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:12.667442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:12.667442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:12.667442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:12.667442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:12.668410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:12.668410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:12.668410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:12.668410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:12.668410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:12.668410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:12.668410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:12.668410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:12.668410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:15:12.668410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:12.670665 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 345/691] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:15:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:12.678412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5f98c-ac9f-4bc8-b551-f020341d0e96 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:12.780581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970353cd-3f03-47f5-a140-96f94c76623a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:12.811696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5f98c-ac9f-4bc8-b551-f020341d0e96 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:12.817305 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:12.824486 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32805db5-7d38-4909-b69f-499d75ea28c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:12.825516 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32805db5-7d38-4909-b69f-499d75ea28c6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:12.826057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32805db5-7d38-4909-b69f-499d75ea28c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:12.826585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32805db5-7d38-4909-b69f-499d75ea28c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:12.835808 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:12.862843 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae214eb0-740c-40c6-a26f-43d3379afbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:12.863691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae214eb0-740c-40c6-a26f-43d3379afbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:12.863984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae214eb0-740c-40c6-a26f-43d3379afbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:12.864266 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae214eb0-740c-40c6-a26f-43d3379afbe0 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:12.865517 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae214eb0-740c-40c6-a26f-43d3379afbe0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:12.865833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae214eb0-740c-40c6-a26f-43d3379afbe0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:12.867771 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae214eb0-740c-40c6-a26f-43d3379afbe0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:12.894914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 346/692] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Jul 12 18:15:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:12.897891 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1c7be-c278-4b85-b9e2-f143765a523a None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:12.898417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1c7be-c278-4b85-b9e2-f143765a523a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:12.898903 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1c7be-c278-4b85-b9e2-f143765a523a None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:12.901001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 347/693] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:12.902007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1c7be-c278-4b85-b9e2-f143765a523a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:12.918652 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32805db5-7d38-4909-b69f-499d75ea28c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:12.921045 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32805db5-7d38-4909-b69f-499d75ea28c6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:13.015585 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1c7be-c278-4b85-b9e2-f143765a523a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:13.047389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 347/694] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:15:13.047389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b20bd-3e69-41b3-9c52-f6dadb5e6591 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:13.047389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b20bd-3e69-41b3-9c52-f6dadb5e6591 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:13.047389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b20bd-3e69-41b3-9c52-f6dadb5e6591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:13.060551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c713a4-20c1-4369-81d1-42cdc8023662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:13.061479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c713a4-20c1-4369-81d1-42cdc8023662 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:13.061956 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c713a4-20c1-4369-81d1-42cdc8023662 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:13.062444 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c713a4-20c1-4369-81d1-42cdc8023662 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:13.064932 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-821b20bd-3e69-41b3-9c52-f6dadb5e6591 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:13.066270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-821b20bd-3e69-41b3-9c52-f6dadb5e6591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:13.094893 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:13.111769 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:13.137780 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 348/695] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:15:13.138774 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b20bd-3e69-41b3-9c52-f6dadb5e6591 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:13.145798 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c713a4-20c1-4369-81d1-42cdc8023662 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:13.148219 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c713a4-20c1-4369-81d1-42cdc8023662 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:13.240622 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b20bd-3e69-41b3-9c52-f6dadb5e6591 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:13.263064 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 348/696] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:15:13.264362 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c713a4-20c1-4369-81d1-42cdc8023662 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:13.282253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ea7f8-de61-4500-bb60-e10f8083e9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:13.283197 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ea7f8-de61-4500-bb60-e10f8083e9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:13.283588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ea7f8-de61-4500-bb60-e10f8083e9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:13.283969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ea7f8-de61-4500-bb60-e10f8083e9d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:13.295411 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ea7f8-de61-4500-bb60-e10f8083e9d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:13.297019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ea7f8-de61-4500-bb60-e10f8083e9d9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:13.315799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-3c2ea7f8-de61-4500-bb60-e10f8083e9d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:13.315799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:13.315799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:13.315799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:13.315799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:13.315799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:13.315799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:13.315799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:13.315799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:13.315799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:13.315799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:13.315799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:13.315799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:13.315799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:13.315799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:13.316790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:13.316790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:13.316790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:13.316790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:13.316790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:13.316790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:13.316790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:13.316790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:13.316790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:13.316790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:13.316790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:13.316790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:13.316790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:13.316790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:13.316790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:13.316790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:13.316790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:13.318271 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:13.318271 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:13.318271 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:13.318271 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:13.322673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 349/697] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:13.323782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ea7f8-de61-4500-bb60-e10f8083e9d9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:13.340864 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:13.352463 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:13.395197 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c713a4-20c1-4369-81d1-42cdc8023662 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:13.443519 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3f4f7-2249-4785-8bea-3dff4078f5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:13.444079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ea7f8-de61-4500-bb60-e10f8083e9d9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:13.444868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3f4f7-2249-4785-8bea-3dff4078f5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:13.445356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3f4f7-2249-4785-8bea-3dff4078f5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:13.446051 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3f4f7-2249-4785-8bea-3dff4078f5c3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:13.447770 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3f4f7-2249-4785-8bea-3dff4078f5c3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:13.449626 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3f4f7-2249-4785-8bea-3dff4078f5c3 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:13.468010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-cec3f4f7-2249-4785-8bea-3dff4078f5c3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:15:13.468010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:13.468010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:13.468010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:13.468010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:13.468010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:13.468010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:13.468010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:13.468010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:15:13.468010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:13.468010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:13.468010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:13.468010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:13.468010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:13.468010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:13.468010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:13.469653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:13.469653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:13.469653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:13.469653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:13.469653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:13.469653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:13.469653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:13.469653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:13.469653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:13.469653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:13.469653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:13.469653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:13.469653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:13.469653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:13.469653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:13.469653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:13.470672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:13.470672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:13.470672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:13.470672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:13.470672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:13.470672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:13.470672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:13.470672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:13.470672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:13.470672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:13.470672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:13.470672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:13.470672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:13.470672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:15:13.470672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:13.474526 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 349/698] 10.222.0.57 () {56 vars in 1129 bytes} [Tue Jul 12 18:15:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:13.475821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3f4f7-2249-4785-8bea-3dff4078f5c3 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:13.484927 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d3b34-39d6-4076-bd68-0a184f2e567d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:13.485929 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d3b34-39d6-4076-bd68-0a184f2e567d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:13.486313 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d3b34-39d6-4076-bd68-0a184f2e567d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:13.486689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d3b34-39d6-4076-bd68-0a184f2e567d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:13.499552 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d3b34-39d6-4076-bd68-0a184f2e567d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:13.501114 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d3b34-39d6-4076-bd68-0a184f2e567d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:13.519218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-838d3b34-39d6-4076-bd68-0a184f2e567d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:13.519218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:13.519218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:13.519218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:13.519218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:13.519218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:13.519218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:13.519218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:13.519218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:13.519218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:13.519218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:13.519218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:13.519218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:13.519218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:13.519218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:13.520297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:13.520297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:13.520297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:13.520297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:13.520297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:13.520297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:13.520297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:13.520297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:13.520297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:13.520297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:13.520297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:13.520297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:13.520297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:13.520297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:13.520297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:13.520297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:13.520297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:13.521469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:13.521469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:13.521469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:13.521469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:13.527436 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 350/699] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:13.528408 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d3b34-39d6-4076-bd68-0a184f2e567d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:13.604687 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:13.614354 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3f4f7-2249-4785-8bea-3dff4078f5c3 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:13.651668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2e6cf-3e1a-496f-875b-14e1d5f9f860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:13.652515 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2e6cf-3e1a-496f-875b-14e1d5f9f860 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:13.652776 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d3b34-39d6-4076-bd68-0a184f2e567d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:13.652986 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2e6cf-3e1a-496f-875b-14e1d5f9f860 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:13.653406 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2e6cf-3e1a-496f-875b-14e1d5f9f860 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:13.654240 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2e6cf-3e1a-496f-875b-14e1d5f9f860 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:13.654652 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2e6cf-3e1a-496f-875b-14e1d5f9f860 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:13.656561 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2e6cf-3e1a-496f-875b-14e1d5f9f860 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:13.658051 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:13.675501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 350/700] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:13.676571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2e6cf-3e1a-496f-875b-14e1d5f9f860 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:13.698953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b938fdc-79e7-4969-8471-5539cce0c9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:13.700364 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b938fdc-79e7-4969-8471-5539cce0c9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:13.700844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b938fdc-79e7-4969-8471-5539cce0c9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:13.701547 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b938fdc-79e7-4969-8471-5539cce0c9b5 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:13.702311 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b938fdc-79e7-4969-8471-5539cce0c9b5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:13.702630 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b938fdc-79e7-4969-8471-5539cce0c9b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:13.704021 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b938fdc-79e7-4969-8471-5539cce0c9b5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:13.712509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 351/701] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Jul 12 18:15:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:13.713812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b938fdc-79e7-4969-8471-5539cce0c9b5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:13.796865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2e6cf-3e1a-496f-875b-14e1d5f9f860 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:13.840798 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda495e-a739-4396-88bc-4e5499a7128c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:13.841904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda495e-a739-4396-88bc-4e5499a7128c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:13.842298 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda495e-a739-4396-88bc-4e5499a7128c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:13.842685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda495e-a739-4396-88bc-4e5499a7128c None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:13.843777 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda495e-a739-4396-88bc-4e5499a7128c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:13.844199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda495e-a739-4396-88bc-4e5499a7128c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:13.846526 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda495e-a739-4396-88bc-4e5499a7128c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:13.851349 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b938fdc-79e7-4969-8471-5539cce0c9b5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:13.868954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 351/702] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:13.870952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda495e-a739-4396-88bc-4e5499a7128c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:13.886950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:13.895065 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75dad42-a27c-4c30-ba49-bdc1f11602f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:13.896505 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dad42-a27c-4c30-ba49-bdc1f11602f4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:13.896867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dad42-a27c-4c30-ba49-bdc1f11602f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:13.897287 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dad42-a27c-4c30-ba49-bdc1f11602f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:13.904404 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75dad42-a27c-4c30-ba49-bdc1f11602f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:13.905893 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75dad42-a27c-4c30-ba49-bdc1f11602f4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:13.921033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-a75dad42-a27c-4c30-ba49-bdc1f11602f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:13.921033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:13.921033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:13.921033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:13.921033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:13.921033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:13.921033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:13.921033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:13.921033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:13.921033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:13.921033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:13.921033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:13.921033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:13.921033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:13.921033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:13.922052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:13.922052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:13.922052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:13.922052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:13.922052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:13.922052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:13.922052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:13.922052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:13.922052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:13.922052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:13.922052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:13.922052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:13.922052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:13.922052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:13.922052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:13.922052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:13.922052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:13.922950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:13.922950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:13.922950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:13.922950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:13.922950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:13.922950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:13.922950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:13.922950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:13.922950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 352/703] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:13.923433 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75dad42-a27c-4c30-ba49-bdc1f11602f4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:13.942128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:13.989146 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda495e-a739-4396-88bc-4e5499a7128c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:14.024309 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4ac74-a066-4816-b4ae-e2e2e60666ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:14.024971 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4ac74-a066-4816-b4ae-e2e2e60666ab None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:14.025292 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4ac74-a066-4816-b4ae-e2e2e60666ab None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:14.025561 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4ac74-a066-4816-b4ae-e2e2e60666ab None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:14.026287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4ac74-a066-4816-b4ae-e2e2e60666ab None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:14.026595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4ac74-a066-4816-b4ae-e2e2e60666ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:14.027973 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4ac74-a066-4816-b4ae-e2e2e60666ab None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:14.033922 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 352/704] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Jul 12 18:15:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:14.040991 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75dad42-a27c-4c30-ba49-bdc1f11602f4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:14.046953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4a0a8-c10b-4d58-a4a0-7ece6a66fad4 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:14.047240 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4a0a8-c10b-4d58-a4a0-7ece6a66fad4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:14.053295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4a0a8-c10b-4d58-a4a0-7ece6a66fad4 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:14.053295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 353/705] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:14 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:14.053295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4a0a8-c10b-4d58-a4a0-7ece6a66fad4 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:14.097775 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727f2c3-9ad1-4fb0-95dc-116a961d7a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:14.098688 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727f2c3-9ad1-4fb0-95dc-116a961d7a93 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:14.099015 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727f2c3-9ad1-4fb0-95dc-116a961d7a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:14.099293 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727f2c3-9ad1-4fb0-95dc-116a961d7a93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:14.108507 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727f2c3-9ad1-4fb0-95dc-116a961d7a93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:14.110089 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727f2c3-9ad1-4fb0-95dc-116a961d7a93 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:14.125100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-4727f2c3-9ad1-4fb0-95dc-116a961d7a93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:14.125100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:14.125100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:14.125100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:14.125100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:14.125100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:14.125100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:14.125100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:14.125100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:14.125100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:14.125100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:14.125100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:14.125100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:14.125100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:14.125100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:14.126102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:14.126102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:14.126102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:14.126102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:14.126102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:14.126102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:14.126102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:14.126102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:14.126102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:14.126102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:14.126102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:14.126102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:14.126102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:14.126102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:14.126102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:14.126102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:14.126102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:14.126974 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:14.126974 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:14.126974 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:14.126974 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:14.126974 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:14.126974 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:14.126974 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:14.126974 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:14.131785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 353/706] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:14.133324 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853d760-ea96-4f77-bd40-d5fa9b89079b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:14.133621 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853d760-ea96-4f77-bd40-d5fa9b89079b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:14.133897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853d760-ea96-4f77-bd40-d5fa9b89079b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:14.152535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2853d760-ea96-4f77-bd40-d5fa9b89079b None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:14.153764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2853d760-ea96-4f77-bd40-d5fa9b89079b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:14.171908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4a0a8-c10b-4d58-a4a0-7ece6a66fad4 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:14.192365 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:14.205758 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:14.215788 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788600a6-c04c-4913-8a23-de3f9a59f572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:14.216684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788600a6-c04c-4913-8a23-de3f9a59f572 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:14.217116 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788600a6-c04c-4913-8a23-de3f9a59f572 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:14.217582 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788600a6-c04c-4913-8a23-de3f9a59f572 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:14.218595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788600a6-c04c-4913-8a23-de3f9a59f572 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:14.218915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788600a6-c04c-4913-8a23-de3f9a59f572 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:14.220509 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788600a6-c04c-4913-8a23-de3f9a59f572 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:14.232319 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 354/707] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:15:14.233188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853d760-ea96-4f77-bd40-d5fa9b89079b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:14.235060 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 354/708] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:14.240786 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788600a6-c04c-4913-8a23-de3f9a59f572 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:14.366169 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853d760-ea96-4f77-bd40-d5fa9b89079b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:14.374961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788600a6-c04c-4913-8a23-de3f9a59f572 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:14.402989 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487b2bc-eb74-43f5-80f6-db77f1c5bfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:14.403651 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487b2bc-eb74-43f5-80f6-db77f1c5bfcf None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:14.403929 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487b2bc-eb74-43f5-80f6-db77f1c5bfcf None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:14.404198 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487b2bc-eb74-43f5-80f6-db77f1c5bfcf None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:14.404981 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487b2bc-eb74-43f5-80f6-db77f1c5bfcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:14.405295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487b2bc-eb74-43f5-80f6-db77f1c5bfcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:14.406741 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487b2bc-eb74-43f5-80f6-db77f1c5bfcf None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:14.419627 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a11d7-c302-441f-bd42-6ee22fc4afc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:14.420477 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a11d7-c302-441f-bd42-6ee22fc4afc4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:14.421040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a11d7-c302-441f-bd42-6ee22fc4afc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:14.421676 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a11d7-c302-441f-bd42-6ee22fc4afc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:14.423308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a11d7-c302-441f-bd42-6ee22fc4afc4 None admin] RBAC: Adding query filter params (role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=a7c1bb51c2b642ffa4708122d826fc67) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:14.423955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a11d7-c302-441f-bd42-6ee22fc4afc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:14.424339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 355/709] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:14.425231 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487b2bc-eb74-43f5-80f6-db77f1c5bfcf None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:14.426090 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a11d7-c302-441f-bd42-6ee22fc4afc4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:14.437359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 355/710] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:15:14 2022] GET /identity/v3/role_assignments?user.id=a7c1bb51c2b642ffa4708122d826fc67&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:14.438235 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a11d7-c302-441f-bd42-6ee22fc4afc4 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:14.504181 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:14.558385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:14.636040 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487b2bc-eb74-43f5-80f6-db77f1c5bfcf None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:14.638370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a11d7-c302-441f-bd42-6ee22fc4afc4 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:14.685353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7489dad-4f17-462f-ae28-1b3dcecd0c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:14.686495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7489dad-4f17-462f-ae28-1b3dcecd0c6a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:14.687021 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7489dad-4f17-462f-ae28-1b3dcecd0c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:14.687492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7489dad-4f17-462f-ae28-1b3dcecd0c6a None admin] PATH_INFO: `/v3/services/network` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:14.688358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7489dad-4f17-462f-ae28-1b3dcecd0c6a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:14.689989 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7489dad-4f17-462f-ae28-1b3dcecd0c6a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:14.691421 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68fbd0-d33a-42bb-89ec-4b5157e9d51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:14.692087 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68fbd0-d33a-42bb-89ec-4b5157e9d51a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:14.692370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68fbd0-d33a-42bb-89ec-4b5157e9d51a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:14.692675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68fbd0-d33a-42bb-89ec-4b5157e9d51a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:14.694179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68fbd0-d33a-42bb-89ec-4b5157e9d51a None admin] RBAC: Adding query filter params (role.id=82fa784b33dd4fe19c62367f39ac45b2, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=ade969d7aa3d49c08782a68ec5997382) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:14.694496 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68fbd0-d33a-42bb-89ec-4b5157e9d51a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:14.696158 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68fbd0-d33a-42bb-89ec-4b5157e9d51a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:14.706964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-b7489dad-4f17-462f-ae28-1b3dcecd0c6a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:15:14.706964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:14.706964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:14.706964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:14.706964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:14.706964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:14.706964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:14.706964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:14.706964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:15:14.706964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:14.706964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:14.706964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:14.706964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:14.706964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:14.706964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:14.706964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:14.706964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:14.708006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:14.708006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:14.708006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:14.708006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:14.708006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:14.708006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:14.708006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:14.708006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:14.708006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:14.708006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:14.708006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:14.708006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:14.708006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:14.708006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:14.708006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:14.708006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:14.708970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:14.708970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:14.708970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:14.708970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:14.708970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:14.708970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:14.708970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:14.708970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:14.708970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:14.708970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:14.708970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:14.708970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:14.708970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:15:14.708970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:14.709799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 356/711] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:15:14 2022] GET /identity/v3/role_assignments?user.id=ade969d7aa3d49c08782a68ec5997382&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=82fa784b33dd4fe19c62367f39ac45b2 => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:14.711589 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 356/712] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:14 2022] GET /identity/v3/services/network => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:14.718263 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68fbd0-d33a-42bb-89ec-4b5157e9d51a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:14.805888 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a6521-0626-4f6f-bd7b-e9f288d68d17 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:14.806541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a6521-0626-4f6f-bd7b-e9f288d68d17 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:14.807023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a6521-0626-4f6f-bd7b-e9f288d68d17 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:14.808936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 357/713] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:14.822777 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc53baa-561c-403d-842a-d8d8c6218291 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:14.823662 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc53baa-561c-403d-842a-d8d8c6218291 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:14.824141 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc53baa-561c-403d-842a-d8d8c6218291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:14.857215 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4fc53baa-561c-403d-842a-d8d8c6218291 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:14.860387 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4fc53baa-561c-403d-842a-d8d8c6218291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:14.889235 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68fbd0-d33a-42bb-89ec-4b5157e9d51a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:14.898805 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:14.933974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51625ee6-5f3c-403e-b5ab-08bbf540ab98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:14.934789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51625ee6-5f3c-403e-b5ab-08bbf540ab98 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:14.935167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51625ee6-5f3c-403e-b5ab-08bbf540ab98 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:14.935539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51625ee6-5f3c-403e-b5ab-08bbf540ab98 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:14.936341 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51625ee6-5f3c-403e-b5ab-08bbf540ab98 None admin] RBAC: Adding query filter params (name=network) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:14.936761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51625ee6-5f3c-403e-b5ab-08bbf540ab98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:14.939149 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51625ee6-5f3c-403e-b5ab-08bbf540ab98 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:14.944473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 357/714] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Jul 12 18:15:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:14.950420 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51625ee6-5f3c-403e-b5ab-08bbf540ab98 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:14.953290 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 358/715] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:15:14.978451 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc53baa-561c-403d-842a-d8d8c6218291 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:15.017707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:15.073920 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51625ee6-5f3c-403e-b5ab-08bbf540ab98 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:15.113394 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc53baa-561c-403d-842a-d8d8c6218291 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:15.113630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeedcc7-fee2-4127-947e-c671c77f7ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:15.114437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeedcc7-fee2-4127-947e-c671c77f7ebf None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:15.114899 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeedcc7-fee2-4127-947e-c671c77f7ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:15.115322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeedcc7-fee2-4127-947e-c671c77f7ebf None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:15.116167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeedcc7-fee2-4127-947e-c671c77f7ebf None admin] RBAC: Adding query filter params (type=network) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:15.116624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeedcc7-fee2-4127-947e-c671c77f7ebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:15.118172 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeedcc7-fee2-4127-947e-c671c77f7ebf None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:15.123484 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 358/716] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Jul 12 18:15:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:15.153048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f34a25-b526-46b8-aa49-22e920c94a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:15.153829 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f34a25-b526-46b8-aa49-22e920c94a95 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:15.154114 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f34a25-b526-46b8-aa49-22e920c94a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:15.154394 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f34a25-b526-46b8-aa49-22e920c94a95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:15.167191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f34a25-b526-46b8-aa49-22e920c94a95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:15.168694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f34a25-b526-46b8-aa49-22e920c94a95 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:15.189027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-56f34a25-b526-46b8-aa49-22e920c94a95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:15.189027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:15.189027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:15.189027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:15.189027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:15.189027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:15.189027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:15.189027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:15.189027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:15.189027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:15.189027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:15.189027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:15.189027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:15.189027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:15.189027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:15.190033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:15.190033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:15.190033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:15.190033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:15.190033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:15.190033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:15.190033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:15.190033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:15.190033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:15.190033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:15.190033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:15.190033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:15.190033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:15.190033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:15.190033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:15.190033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:15.190033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:15.190952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:15.190952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:15.190952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:15.190952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:15.190952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 359/717] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:15.196797 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeedcc7-fee2-4127-947e-c671c77f7ebf None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:15.243075 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:15.326221 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeedcc7-fee2-4127-947e-c671c77f7ebf None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:15.362656 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba762c-bd0b-4443-a1ac-8e4d509c16c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:15.363243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba762c-bd0b-4443-a1ac-8e4d509c16c4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:15.363529 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba762c-bd0b-4443-a1ac-8e4d509c16c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:15.363832 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba762c-bd0b-4443-a1ac-8e4d509c16c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:15.365245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba762c-bd0b-4443-a1ac-8e4d509c16c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:15.365606 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba762c-bd0b-4443-a1ac-8e4d509c16c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:15.367225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba762c-bd0b-4443-a1ac-8e4d509c16c4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:15.381960 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 359/718] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:15.387643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f34a25-b526-46b8-aa49-22e920c94a95 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:15.478712 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:15.494543 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f34a25-b526-46b8-aa49-22e920c94a95 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:15.529151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acbd3b-9b76-4b17-9482-c8fd3bba7c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:15.529875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acbd3b-9b76-4b17-9482-c8fd3bba7c31 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:15.530161 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acbd3b-9b76-4b17-9482-c8fd3bba7c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:15.530437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acbd3b-9b76-4b17-9482-c8fd3bba7c31 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:15.531149 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acbd3b-9b76-4b17-9482-c8fd3bba7c31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:15.532585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acbd3b-9b76-4b17-9482-c8fd3bba7c31 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:15.555872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 360/719] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Jul 12 18:15:15 2022] POST /identity/v3/users => generated 254 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:15:16.348336 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15646296-7389-4dbe-9bea-bbfac30d6755 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:16.349908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15646296-7389-4dbe-9bea-bbfac30d6755 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:16.350407 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15646296-7389-4dbe-9bea-bbfac30d6755 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:16.352213 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 360/720] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:16.358036 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11ad4c-5b28-4507-8cad-54faa25489c4 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:16.358876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11ad4c-5b28-4507-8cad-54faa25489c4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:16.359368 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11ad4c-5b28-4507-8cad-54faa25489c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:16.386256 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5e11ad4c-5b28-4507-8cad-54faa25489c4 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:16.387763 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5e11ad4c-5b28-4507-8cad-54faa25489c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:16.479729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 361/721] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:15:16.506383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15646296-7389-4dbe-9bea-bbfac30d6755 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:16.668576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:16.676852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15646296-7389-4dbe-9bea-bbfac30d6755 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:16.723877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d9661-1a4e-4d57-8c5e-8c62ce7af50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:16.725074 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d9661-1a4e-4d57-8c5e-8c62ce7af50d None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:16.725384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d9661-1a4e-4d57-8c5e-8c62ce7af50d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:16.725664 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d9661-1a4e-4d57-8c5e-8c62ce7af50d None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:16.726397 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d9661-1a4e-4d57-8c5e-8c62ce7af50d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:16.727788 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d9661-1a4e-4d57-8c5e-8c62ce7af50d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:16.747561 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 361/722] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Jul 12 18:15:16 2022] POST /identity/v3/services => generated 251 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:15:16.920499 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2756ae-b31d-4dcf-b887-9b6e5a98d557 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:16.920712 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2756ae-b31d-4dcf-b887-9b6e5a98d557 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:16.920997 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2756ae-b31d-4dcf-b887-9b6e5a98d557 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:16.922702 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 362/723] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:16.928600 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e28da1-9ae7-4729-9681-12114a7579d4 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:16.928893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e28da1-9ae7-4729-9681-12114a7579d4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:16.929181 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e28da1-9ae7-4729-9681-12114a7579d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:16.954420 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e6e28da1-9ae7-4729-9681-12114a7579d4 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:16.955678 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e6e28da1-9ae7-4729-9681-12114a7579d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:17.043829 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 362/724] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:15:17.066215 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2756ae-b31d-4dcf-b887-9b6e5a98d557 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:17.142739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:17.174847 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2756ae-b31d-4dcf-b887-9b6e5a98d557 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:17.218908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e57025-98e6-4acb-9040-e4b1f8569b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:17.219707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e57025-98e6-4acb-9040-e4b1f8569b58 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:17.219991 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e57025-98e6-4acb-9040-e4b1f8569b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:17.220267 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e57025-98e6-4acb-9040-e4b1f8569b58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:17.237161 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e57025-98e6-4acb-9040-e4b1f8569b58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:17.245600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-b2e57025-98e6-4acb-9040-e4b1f8569b58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:15:17.245600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:17.245600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:17.245600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:17.245600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:17.245600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:17.245600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:17.245600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:17.245600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:17.245600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:17.245600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:17.245600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:17.245600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:17.245600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:17.245600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:17.245600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:17.246525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:17.246525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:17.246525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:17.246525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:17.246525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:17.246525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:17.246525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:17.246525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:17.246525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:17.246525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:17.246525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:17.246525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:17.246525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:17.246525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:17.246525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:17.246525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:17.247768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:17.247768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:17.247768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:17.247768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:17.247768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:17.247768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:17.247768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:17.247768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:17.247768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:17.247768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:17.247768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:15:17.247768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:17.251401 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 363/725] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:15:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:17.252674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e28da1-9ae7-4729-9681-12114a7579d4 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:17.361588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbd4ab-461e-4ef8-9ef2-89f2b6263d6b None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:17.362571 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbd4ab-461e-4ef8-9ef2-89f2b6263d6b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:17.363045 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbd4ab-461e-4ef8-9ef2-89f2b6263d6b None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:17.364885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 364/726] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:15:17.370835 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8e1f5-c0e3-4eb6-ad2b-8f72b782abd7 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:17.371354 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8e1f5-c0e3-4eb6-ad2b-8f72b782abd7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:17.371843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8e1f5-c0e3-4eb6-ad2b-8f72b782abd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:17.379431 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:17.393543 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-72f8e1f5-c0e3-4eb6-ad2b-8f72b782abd7 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:17.395450 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-72f8e1f5-c0e3-4eb6-ad2b-8f72b782abd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:17.423438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e28da1-9ae7-4729-9681-12114a7579d4 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:17.483429 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 365/727] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:15:17.492244 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b57db-532d-463a-811f-cc3c056bc1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:17.492931 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b57db-532d-463a-811f-cc3c056bc1ce None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:17.493217 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b57db-532d-463a-811f-cc3c056bc1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:17.493520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b57db-532d-463a-811f-cc3c056bc1ce None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:17.494280 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b57db-532d-463a-811f-cc3c056bc1ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:17.494589 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b57db-532d-463a-811f-cc3c056bc1ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:17.495977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b57db-532d-463a-811f-cc3c056bc1ce None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:17.510796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8e1f5-c0e3-4eb6-ad2b-8f72b782abd7 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:17.513167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 363/728] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:15:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:17.519673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b57db-532d-463a-811f-cc3c056bc1ce None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:17.607248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:17.651954 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8e1f5-c0e3-4eb6-ad2b-8f72b782abd7 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:17.691609 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41737a-d910-461a-965d-7a7909348e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:17.693280 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41737a-d910-461a-965d-7a7909348e9b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:17.693762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41737a-d910-461a-965d-7a7909348e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:17.695087 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41737a-d910-461a-965d-7a7909348e9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:17.706689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41737a-d910-461a-965d-7a7909348e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:17.716689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-9c41737a-d910-461a-965d-7a7909348e9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:15:17.716689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:17.716689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:17.716689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:17.716689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:17.716689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:17.716689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:17.716689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:17.716689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:17.716689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:17.716689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:17.716689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:17.716689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:17.716689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:17.716689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:17.716689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:17.717611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:17.717611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:17.717611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:17.717611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:17.717611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:17.717611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:17.717611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:17.717611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:17.717611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:17.717611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:17.717611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:17.717611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:17.717611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:17.717611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:17.717611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:17.717611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:17.718441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:17.718441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:17.718441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:17.718441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:17.718441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:17.718441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:17.718441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:17.718441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:17.718441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:17.718441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:17.718441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:15:17.718441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:17.725623 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 366/729] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:15:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:17.727676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41737a-d910-461a-965d-7a7909348e9b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:17.775482 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b57db-532d-463a-811f-cc3c056bc1ce None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:17.842705 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41737a-d910-461a-965d-7a7909348e9b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:17.869403 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:17.870283 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8dafe-4d16-4d4d-8242-40984791c775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:17.870873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8dafe-4d16-4d4d-8242-40984791c775 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:17.871163 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8dafe-4d16-4d4d-8242-40984791c775 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:17.871627 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8dafe-4d16-4d4d-8242-40984791c775 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:17.884784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd04b3b-11f0-4973-81b1-3a2047649bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:17.885771 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd04b3b-11f0-4973-81b1-3a2047649bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:17.886251 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd04b3b-11f0-4973-81b1-3a2047649bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:17.886718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd04b3b-11f0-4973-81b1-3a2047649bb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:17.887679 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd04b3b-11f0-4973-81b1-3a2047649bb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:17.888221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd04b3b-11f0-4973-81b1-3a2047649bb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:17.890229 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd04b3b-11f0-4973-81b1-3a2047649bb3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:17.893090 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8dafe-4d16-4d4d-8242-40984791c775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:17.894470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8dafe-4d16-4d4d-8242-40984791c775 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:17.900676 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:17.905648 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 367/730] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:15:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:17.905648 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49efa8-c405-4d8b-994f-381c3d59f167 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:17.905648 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49efa8-c405-4d8b-994f-381c3d59f167 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:17.905648 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49efa8-c405-4d8b-994f-381c3d59f167 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:17.905648 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 368/731] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:17.909651 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49efa8-c405-4d8b-994f-381c3d59f167 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:17.929578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-31c8dafe-4d16-4d4d-8242-40984791c775 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:17.929578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:17.929578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:17.929578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:17.929578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:17.929578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:17.929578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:17.929578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:17.929578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:17.929578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:17.929578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:17.929578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:17.929578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:17.929578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:17.929578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:17.930538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:17.930538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:17.930538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:17.930538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:17.930538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:17.930538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:17.930538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:17.930538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:17.930538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:17.930538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:17.930538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:17.930538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:17.930538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:17.930538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:17.930538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:17.930538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:17.930538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:17.931420 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:17.931420 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:17.931420 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:17.931420 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:17.933580 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 364/732] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:17.935000 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6216fd0-0ab5-4769-bde1-933834fe4c5a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:17.935413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6216fd0-0ab5-4769-bde1-933834fe4c5a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:17.935808 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6216fd0-0ab5-4769-bde1-933834fe4c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:17.959422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c6216fd0-0ab5-4769-bde1-933834fe4c5a None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:17.960842 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c6216fd0-0ab5-4769-bde1-933834fe4c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:18.039125 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49efa8-c405-4d8b-994f-381c3d59f167 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:18.051499 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 365/733] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:15:18.052607 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6216fd0-0ab5-4769-bde1-933834fe4c5a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:18.095072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183eb7b-b584-4e84-8452-1011ff507790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:18.096066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183eb7b-b584-4e84-8452-1011ff507790 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:18.096498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183eb7b-b584-4e84-8452-1011ff507790 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:18.096908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183eb7b-b584-4e84-8452-1011ff507790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:18.110185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183eb7b-b584-4e84-8452-1011ff507790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:18.111843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183eb7b-b584-4e84-8452-1011ff507790 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:18.135426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-e183eb7b-b584-4e84-8452-1011ff507790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:18.135426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:18.135426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:18.135426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:18.135426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:18.135426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:18.135426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:18.135426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:18.135426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:18.135426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:18.135426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:18.135426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:18.135426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:18.135426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:18.135426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:18.136497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:18.136497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:18.136497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:18.136497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:18.136497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:18.136497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:18.136497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:18.136497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:18.136497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:18.136497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:18.136497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:18.136497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:18.136497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:18.136497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:18.136497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:18.136497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:18.136497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:18.137484 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:18.137484 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:18.137484 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:18.137484 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:18.144057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 369/734] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:18.144057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183eb7b-b584-4e84-8452-1011ff507790 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:18.175858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6216fd0-0ab5-4769-bde1-933834fe4c5a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:18.187389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:18.211361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:18.226490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919927e-6ec9-4dd4-8e7b-553c6165ef8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:18.228267 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919927e-6ec9-4dd4-8e7b-553c6165ef8c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:18.228733 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919927e-6ec9-4dd4-8e7b-553c6165ef8c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:18.229182 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919927e-6ec9-4dd4-8e7b-553c6165ef8c None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:18.230140 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919927e-6ec9-4dd4-8e7b-553c6165ef8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:18.230633 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919927e-6ec9-4dd4-8e7b-553c6165ef8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:18.232675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919927e-6ec9-4dd4-8e7b-553c6165ef8c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:18.248758 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 366/735] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:18.249828 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919927e-6ec9-4dd4-8e7b-553c6165ef8c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:18.265809 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183eb7b-b584-4e84-8452-1011ff507790 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:18.305701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f23cba-870d-4342-b98b-51db7e841a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:18.306501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f23cba-870d-4342-b98b-51db7e841a04 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:18.306856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f23cba-870d-4342-b98b-51db7e841a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:18.307208 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f23cba-870d-4342-b98b-51db7e841a04 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:18.308045 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f23cba-870d-4342-b98b-51db7e841a04 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:18.309796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f23cba-870d-4342-b98b-51db7e841a04 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:18.333732 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 370/736] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Jul 12 18:15:18 2022] POST /identity/v3/services => generated 240 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:15:18.334944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f23cba-870d-4342-b98b-51db7e841a04 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:18.368508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919927e-6ec9-4dd4-8e7b-553c6165ef8c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:18.425280 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239e08c-d29d-4952-b006-7fd835368d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:18.426117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239e08c-d29d-4952-b006-7fd835368d6c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:18.426314 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239e08c-d29d-4952-b006-7fd835368d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:18.426557 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239e08c-d29d-4952-b006-7fd835368d6c None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:18.428232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239e08c-d29d-4952-b006-7fd835368d6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:18.428547 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239e08c-d29d-4952-b006-7fd835368d6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:18.430289 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239e08c-d29d-4952-b006-7fd835368d6c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:18.451731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 367/737] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:18.451731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54b710-fe0d-4e8f-9883-73d611fe6cbe None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:18.451731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54b710-fe0d-4e8f-9883-73d611fe6cbe None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:18.451731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54b710-fe0d-4e8f-9883-73d611fe6cbe None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:18.455937 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 368/738] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:18.457197 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54b710-fe0d-4e8f-9883-73d611fe6cbe None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:18.503630 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:18.514714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:18.520893 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f23cba-870d-4342-b98b-51db7e841a04 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:18.576407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43646d-7e58-44b9-a509-5fd35e74a887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:18.577038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43646d-7e58-44b9-a509-5fd35e74a887 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:18.578695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43646d-7e58-44b9-a509-5fd35e74a887 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:18.578695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43646d-7e58-44b9-a509-5fd35e74a887 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:18.591284 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43646d-7e58-44b9-a509-5fd35e74a887 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:18.591459 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54b710-fe0d-4e8f-9883-73d611fe6cbe None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:18.593132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43646d-7e58-44b9-a509-5fd35e74a887 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:18.612391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-4c43646d-7e58-44b9-a509-5fd35e74a887 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:15:18.612391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:18.612391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:18.612391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:18.612391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:18.612391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:18.612391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:18.612391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:18.612391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:18.612391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:18.612391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:18.612391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:18.612391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:18.612391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:18.612391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:18.612391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:18.613399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:18.613399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:18.613399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:18.613399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:18.613399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:18.613399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:18.613399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:18.613399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:18.613399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:18.613399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:18.613399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:18.613399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:18.613399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:18.613399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:18.613399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:18.613399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:18.613399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:18.613399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:18.614336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:18.614336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:18.614336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:18.614336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:18.614336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:18.614336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:18.614336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:18.614336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:18.614336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:15:18.614336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:18.615483 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 371/739] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Jul 12 18:15:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:18.618169 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aa7b4-01b1-4d5a-a567-7d73db51d260 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:18.618169 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aa7b4-01b1-4d5a-a567-7d73db51d260 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:18.618169 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aa7b4-01b1-4d5a-a567-7d73db51d260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:18.629268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca570c-abc2-4f45-b645-6a99407f94af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:18.630128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca570c-abc2-4f45-b645-6a99407f94af None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:18.630418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca570c-abc2-4f45-b645-6a99407f94af None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:18.630697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca570c-abc2-4f45-b645-6a99407f94af None admin] PATH_INFO: `/v3/users/swift` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:18.637318 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8d5aa7b4-01b1-4d5a-a567-7d73db51d260 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:18.638494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca570c-abc2-4f45-b645-6a99407f94af None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:18.638828 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8d5aa7b4-01b1-4d5a-a567-7d73db51d260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:18.640084 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca570c-abc2-4f45-b645-6a99407f94af None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:18.656318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-5eca570c-abc2-4f45-b645-6a99407f94af None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:15:18.656318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:18.656318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:18.656318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:18.656318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:18.656318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:18.656318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:18.656318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:18.656318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:18.656318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:18.656318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:18.656318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:18.656318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:18.656318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:18.656318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:18.656318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:18.657287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:18.657287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:18.657287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:18.657287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:18.657287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:18.657287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:18.657287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:18.657287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:18.657287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:18.657287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:18.657287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:18.657287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:18.657287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:18.657287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:18.657287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:18.657287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:18.657287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:18.657287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:18.659902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:18.659902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:18.659902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:18.659902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:18.659902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:18.659902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:18.659902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:18.659902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:18.659902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:15:18.659902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:18.659902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 369/740] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:15:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:18.659902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca570c-abc2-4f45-b645-6a99407f94af None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:18.727527 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 372/741] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:18.729728 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5aa7b4-01b1-4d5a-a567-7d73db51d260 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:18.788373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:18.792529 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca570c-abc2-4f45-b645-6a99407f94af None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:18.831741 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb23b9-8f8b-4eba-b896-c7b91a3beda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:18.832382 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb23b9-8f8b-4eba-b896-c7b91a3beda5 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:18.832673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb23b9-8f8b-4eba-b896-c7b91a3beda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:18.832954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb23b9-8f8b-4eba-b896-c7b91a3beda5 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:18.834198 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb23b9-8f8b-4eba-b896-c7b91a3beda5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:18.834659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb23b9-8f8b-4eba-b896-c7b91a3beda5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:18.836167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb23b9-8f8b-4eba-b896-c7b91a3beda5 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:18.855172 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:18.856091 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 370/742] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Jul 12 18:15:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:18.857418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb23b9-8f8b-4eba-b896-c7b91a3beda5 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:18.881631 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5aa7b4-01b1-4d5a-a567-7d73db51d260 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:18.929167 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef5edf-5bf6-4b2b-a993-ca142e45595c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:18.930131 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef5edf-5bf6-4b2b-a993-ca142e45595c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:18.930424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef5edf-5bf6-4b2b-a993-ca142e45595c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:18.930944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef5edf-5bf6-4b2b-a993-ca142e45595c None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:18.932214 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef5edf-5bf6-4b2b-a993-ca142e45595c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:18.932802 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef5edf-5bf6-4b2b-a993-ca142e45595c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:18.934282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef5edf-5bf6-4b2b-a993-ca142e45595c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:18.958522 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 373/743] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Jul 12 18:15:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:18.959920 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef5edf-5bf6-4b2b-a993-ca142e45595c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:18.977632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb23b9-8f8b-4eba-b896-c7b91a3beda5 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:19.016450 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d686c-c01a-4388-9848-c8d2969e5d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:19.017302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d686c-c01a-4388-9848-c8d2969e5d7d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:19.017602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d686c-c01a-4388-9848-c8d2969e5d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:19.017876 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d686c-c01a-4388-9848-c8d2969e5d7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:19.029238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d686c-c01a-4388-9848-c8d2969e5d7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:19.038551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-5b3d686c-c01a-4388-9848-c8d2969e5d7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:19.038551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:19.038551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:19.038551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:19.038551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:19.038551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:19.038551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:19.038551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:19.038551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:19.038551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:19.038551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:19.038551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:19.038551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:19.038551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:19.038551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:19.038551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:19.040601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:19.040601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:19.040601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:19.040601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:19.040601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:19.040601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:19.040601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:19.040601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:19.040601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:19.040601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:19.040601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:19.040601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:19.040601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:19.040601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:19.040601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:19.040601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:19.042005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:19.042005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:19.042005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:19.042005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:19.042005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:19.042005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:19.042005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:19.042005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:19.042005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:19.042005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:19.042005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:19.042005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:19.042005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 371/744] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:15:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:19.042005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d686c-c01a-4388-9848-c8d2969e5d7d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:19.070382 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:19.083964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef5edf-5bf6-4b2b-a993-ca142e45595c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:19.121855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f247a-acb2-4280-bc95-87f7369b1252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:19.122932 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f247a-acb2-4280-bc95-87f7369b1252 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:19.123287 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f247a-acb2-4280-bc95-87f7369b1252 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:19.123661 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f247a-acb2-4280-bc95-87f7369b1252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:19.135678 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f247a-acb2-4280-bc95-87f7369b1252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:19.137423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f247a-acb2-4280-bc95-87f7369b1252 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:19.140198 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:19.159105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-592f247a-acb2-4280-bc95-87f7369b1252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:19.159105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:19.159105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:19.159105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:19.159105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:19.159105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:19.159105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:19.159105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:19.159105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:19.159105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:19.159105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:19.159105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:19.159105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:19.159105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:19.159105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:19.160261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:19.160261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:19.160261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:19.160261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:19.160261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:19.160261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:19.160261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:19.160261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:19.160261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:19.160261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:19.160261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:19.160261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:19.160261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:19.160261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:19.160261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:19.160261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:19.160261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:19.161963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:19.161963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:19.161963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:19.161963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:19.163684 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 374/745] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:19.164712 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f247a-acb2-4280-bc95-87f7369b1252 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:19.178526 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d686c-c01a-4388-9848-c8d2969e5d7d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:19.221731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30933c79-a3cc-4966-b276-02d809f719f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:19.223105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30933c79-a3cc-4966-b276-02d809f719f6 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:19.223557 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30933c79-a3cc-4966-b276-02d809f719f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:19.224502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30933c79-a3cc-4966-b276-02d809f719f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:19.276231 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f247a-acb2-4280-bc95-87f7369b1252 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:19.307222 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30933c79-a3cc-4966-b276-02d809f719f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:19.309040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30933c79-a3cc-4966-b276-02d809f719f6 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:19.320041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a080d81-548a-48d5-a9d0-44a12b397910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:19.320913 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a080d81-548a-48d5-a9d0-44a12b397910 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:19.321659 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a080d81-548a-48d5-a9d0-44a12b397910 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:19.322364 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a080d81-548a-48d5-a9d0-44a12b397910 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:19.323262 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a080d81-548a-48d5-a9d0-44a12b397910 None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:19.324153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a080d81-548a-48d5-a9d0-44a12b397910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:19.326409 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a080d81-548a-48d5-a9d0-44a12b397910 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:19.328188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:19.336375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 375/746] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:15:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:19.337522 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a080d81-548a-48d5-a9d0-44a12b397910 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:19.394613 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:19.423470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 372/747] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:15:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:15:19.425045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389db8d4-333f-4cfb-9501-d99b16e88ba3 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:19.425538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389db8d4-333f-4cfb-9501-d99b16e88ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:19.426454 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389db8d4-333f-4cfb-9501-d99b16e88ba3 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:19.428410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 373/748] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:19.429488 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389db8d4-333f-4cfb-9501-d99b16e88ba3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:19.444343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a080d81-548a-48d5-a9d0-44a12b397910 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:19.481058 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501c4ef-a7f9-4893-8145-9b081d445cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:19.482093 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501c4ef-a7f9-4893-8145-9b081d445cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:19.482563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501c4ef-a7f9-4893-8145-9b081d445cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:19.483045 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501c4ef-a7f9-4893-8145-9b081d445cc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:19.483942 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501c4ef-a7f9-4893-8145-9b081d445cc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:19.484397 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501c4ef-a7f9-4893-8145-9b081d445cc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:19.485938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501c4ef-a7f9-4893-8145-9b081d445cc5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:19.498410 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 376/749] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:19.499358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501c4ef-a7f9-4893-8145-9b081d445cc5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:19.550299 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389db8d4-333f-4cfb-9501-d99b16e88ba3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:19.575814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:19.594873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d169e-5d31-49ba-8cf1-329a0d7a6a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:19.596302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d169e-5d31-49ba-8cf1-329a0d7a6a4f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:19.596593 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d169e-5d31-49ba-8cf1-329a0d7a6a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:19.597087 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d169e-5d31-49ba-8cf1-329a0d7a6a4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:19.608228 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501c4ef-a7f9-4893-8145-9b081d445cc5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:19.608695 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d169e-5d31-49ba-8cf1-329a0d7a6a4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:19.610220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d169e-5d31-49ba-8cf1-329a0d7a6a4f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:19.626489 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:19.628303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-117d169e-5d31-49ba-8cf1-329a0d7a6a4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:19.628303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:19.628303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:19.628303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:19.628303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:19.628303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:19.628303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:19.628303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:19.628303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:19.628303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:19.628303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:19.628303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:19.628303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:19.628303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:19.628303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:19.629428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:19.629428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:19.629428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:19.629428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:19.629428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:19.629428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:19.629428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:19.629428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:19.629428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:19.629428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:19.629428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:19.629428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:19.629428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:19.629428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:19.629428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:19.629428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:19.629428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:19.635564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:19.635564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:19.635564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:19.635564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:19.635564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 374/750] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:19.635564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c36bcb-d765-4fa9-8a10-0f964c57f934 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:19.635564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c36bcb-d765-4fa9-8a10-0f964c57f934 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:19.635564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c36bcb-d765-4fa9-8a10-0f964c57f934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:19.652734 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-50c36bcb-d765-4fa9-8a10-0f964c57f934 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:19.653381 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cbaeb-8ecc-4dc1-8a0c-8402d0f181fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:19.653963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-50c36bcb-d765-4fa9-8a10-0f964c57f934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:19.654339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cbaeb-8ecc-4dc1-8a0c-8402d0f181fe None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:19.654695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cbaeb-8ecc-4dc1-8a0c-8402d0f181fe None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:19.655122 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cbaeb-8ecc-4dc1-8a0c-8402d0f181fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:19.666041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cbaeb-8ecc-4dc1-8a0c-8402d0f181fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:19.667482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cbaeb-8ecc-4dc1-8a0c-8402d0f181fe None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:19.686456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-c03cbaeb-8ecc-4dc1-8a0c-8402d0f181fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:19.686456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:19.686456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:19.686456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:19.686456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:19.686456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:19.686456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:19.686456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:19.686456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:19.686456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:19.686456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:19.686456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:19.686456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:19.686456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:19.686456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:19.687501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:19.687501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:19.687501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:19.687501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:19.687501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:19.687501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:19.687501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:19.687501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:19.687501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:19.687501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:19.687501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:19.687501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:19.687501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:19.687501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:19.687501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:19.687501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:19.687501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:19.688620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:19.688620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:19.688620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:19.688620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:19.694595 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 377/751] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:19.694595 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cbaeb-8ecc-4dc1-8a0c-8402d0f181fe None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:19.729153 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 375/752] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:19.738083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c36bcb-d765-4fa9-8a10-0f964c57f934 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:19.802842 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cbaeb-8ecc-4dc1-8a0c-8402d0f181fe None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:19.839316 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0c580-3fdc-404c-8775-8a0335a2bd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:19.840328 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0c580-3fdc-404c-8775-8a0335a2bd55 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:19.840730 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0c580-3fdc-404c-8775-8a0335a2bd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:19.841194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0c580-3fdc-404c-8775-8a0335a2bd55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:19.847068 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:19.849963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0c580-3fdc-404c-8775-8a0335a2bd55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:19.851162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c36bcb-d765-4fa9-8a10-0f964c57f934 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:19.851403 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0c580-3fdc-404c-8775-8a0335a2bd55 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:19.865785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-3cb0c580-3fdc-404c-8775-8a0335a2bd55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:19.865785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:19.865785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:19.865785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:19.865785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:19.865785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:19.865785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:19.865785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:19.865785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:19.865785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:19.865785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:19.865785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:19.865785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:19.865785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:19.865785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:19.866827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:19.866827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:19.866827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:19.866827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:19.866827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:19.866827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:19.866827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:19.866827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:19.866827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:19.866827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:19.866827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:19.866827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:19.866827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:19.866827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:19.866827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:19.866827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:19.866827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:19.867724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:19.867724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:19.867724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:19.867724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:19.867724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:19.867724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:19.867724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:19.867724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:19.867724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 378/753] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:19.867724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0c580-3fdc-404c-8775-8a0335a2bd55 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:19.895073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955a906-9e72-4d19-af2b-c88af4df1d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:19.895888 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955a906-9e72-4d19-af2b-c88af4df1d18 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:19.896176 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955a906-9e72-4d19-af2b-c88af4df1d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:19.896454 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955a906-9e72-4d19-af2b-c88af4df1d18 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:19.897173 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955a906-9e72-4d19-af2b-c88af4df1d18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:19.897518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955a906-9e72-4d19-af2b-c88af4df1d18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:19.898909 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955a906-9e72-4d19-af2b-c88af4df1d18 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:19.900396 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:19.911757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 376/754] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:19.912483 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955a906-9e72-4d19-af2b-c88af4df1d18 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:19.980508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0c580-3fdc-404c-8775-8a0335a2bd55 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:20.018722 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ec470-6302-439c-abed-b3db364cdbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:20.019379 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ec470-6302-439c-abed-b3db364cdbbb None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:20.019659 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ec470-6302-439c-abed-b3db364cdbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:20.019936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ec470-6302-439c-abed-b3db364cdbbb None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:20.021164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ec470-6302-439c-abed-b3db364cdbbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:20.021649 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ec470-6302-439c-abed-b3db364cdbbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:20.023346 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ec470-6302-439c-abed-b3db364cdbbb None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:20.027865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955a906-9e72-4d19-af2b-c88af4df1d18 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:20.036255 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 379/755] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:20.037702 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ec470-6302-439c-abed-b3db364cdbbb None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:20.071695 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca97dd-67e2-404f-b4a4-2ceb769d03da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:20.072578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca97dd-67e2-404f-b4a4-2ceb769d03da None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:20.072866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca97dd-67e2-404f-b4a4-2ceb769d03da None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:20.073202 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca97dd-67e2-404f-b4a4-2ceb769d03da None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:20.074080 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca97dd-67e2-404f-b4a4-2ceb769d03da None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:20.075455 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca97dd-67e2-404f-b4a4-2ceb769d03da None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:20.088735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-25ca97dd-67e2-404f-b4a4-2ceb769d03da None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:15:20.088735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:20.088735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:20.088735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:20.088735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:20.088735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:20.088735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:20.088735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:20.088735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:15:20.088735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:20.088735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:20.088735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:20.088735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:20.088735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:20.088735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:20.088735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:20.089694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:20.089694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:20.089694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:20.089694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:20.089694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:20.089694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:20.089694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:20.089694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:20.089694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:20.089694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:20.089694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:20.089694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:20.089694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:20.089694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:20.089694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:20.089694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:20.090637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:20.090637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:20.090637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:20.090637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:20.090637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:20.090637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:20.090637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:20.090637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:20.090637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:20.090637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:20.090637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:20.090637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:20.090637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:20.090637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:15:20.090637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:20.090637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 377/756] 10.222.0.57 () {56 vars in 1129 bytes} [Tue Jul 12 18:15:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:20.091467 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca97dd-67e2-404f-b4a4-2ceb769d03da None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:20.120510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:20.142049 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:20.156870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ec470-6302-439c-abed-b3db364cdbbb None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:20.197362 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222249a-04c8-4d1f-9d1d-cadc5d5c8050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:20.198268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222249a-04c8-4d1f-9d1d-cadc5d5c8050 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:20.198818 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222249a-04c8-4d1f-9d1d-cadc5d5c8050 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:20.199094 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222249a-04c8-4d1f-9d1d-cadc5d5c8050 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:20.200291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222249a-04c8-4d1f-9d1d-cadc5d5c8050 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:20.200602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222249a-04c8-4d1f-9d1d-cadc5d5c8050 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:20.202057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222249a-04c8-4d1f-9d1d-cadc5d5c8050 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:20.202521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca97dd-67e2-404f-b4a4-2ceb769d03da None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:20.218631 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 380/757] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:20.218631 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222249a-04c8-4d1f-9d1d-cadc5d5c8050 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:20.244891 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7d6c9-12e9-4d1e-8a71-62d9e3012fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:20.245735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7d6c9-12e9-4d1e-8a71-62d9e3012fab None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:20.246032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7d6c9-12e9-4d1e-8a71-62d9e3012fab None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:20.246307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7d6c9-12e9-4d1e-8a71-62d9e3012fab None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:20.255105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7d6c9-12e9-4d1e-8a71-62d9e3012fab None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:20.256565 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7d6c9-12e9-4d1e-8a71-62d9e3012fab None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:20.272030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-41f7d6c9-12e9-4d1e-8a71-62d9e3012fab None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:15:20.272030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:20.272030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:20.272030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:20.272030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:20.272030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:20.272030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:20.272030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:20.272030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:20.272030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:20.272030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:20.272030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:20.272030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:20.272030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:20.272030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:20.272030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:20.272989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:20.272989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:20.272989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:20.272989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:20.272989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:20.272989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:20.272989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:20.272989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:20.272989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:20.272989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:20.272989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:20.272989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:20.272989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:20.272989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:20.272989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:20.272989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:20.272989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:20.272989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:20.273998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:20.273998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:20.273998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:20.273998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:20.273998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:20.273998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:20.273998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:20.273998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:20.273998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:15:20.273998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:20.273998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 378/758] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Jul 12 18:15:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:20.273998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7d6c9-12e9-4d1e-8a71-62d9e3012fab None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:20.329324 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222249a-04c8-4d1f-9d1d-cadc5d5c8050 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:20.364451 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:20.366282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4ba84-104d-4d2b-9d7f-2fef4f19057c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:20.367333 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4ba84-104d-4d2b-9d7f-2fef4f19057c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:20.367801 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4ba84-104d-4d2b-9d7f-2fef4f19057c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:20.368272 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4ba84-104d-4d2b-9d7f-2fef4f19057c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:20.375486 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4ba84-104d-4d2b-9d7f-2fef4f19057c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:20.376940 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4ba84-104d-4d2b-9d7f-2fef4f19057c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:20.382936 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7d6c9-12e9-4d1e-8a71-62d9e3012fab None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:20.392402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-bdb4ba84-104d-4d2b-9d7f-2fef4f19057c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:20.392402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:20.392402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:20.392402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:20.392402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:20.392402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:20.392402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:20.392402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:20.392402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:20.392402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:20.392402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:20.392402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:20.392402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:20.392402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:20.392402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:20.393343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:20.393343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:20.393343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:20.393343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:20.393343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:20.393343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:20.393343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:20.393343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:20.393343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:20.393343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:20.393343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:20.393343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:20.393343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:20.393343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:20.393343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:20.393343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:20.393343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:20.394261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:20.394261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:20.394261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:20.394261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:20.394261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:20.394261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:20.394261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:20.394261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:20.394261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 381/759] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:20.394759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4ba84-104d-4d2b-9d7f-2fef4f19057c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:20.409697 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:20.421449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372696e-c6fe-4868-bb1b-37e56596e38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:20.422116 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372696e-c6fe-4868-bb1b-37e56596e38d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:20.422398 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372696e-c6fe-4868-bb1b-37e56596e38d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:20.422676 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372696e-c6fe-4868-bb1b-37e56596e38d None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:20.423383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372696e-c6fe-4868-bb1b-37e56596e38d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:20.423689 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372696e-c6fe-4868-bb1b-37e56596e38d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:20.425079 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372696e-c6fe-4868-bb1b-37e56596e38d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:20.434424 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 379/760] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Jul 12 18:15:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:20.435023 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372696e-c6fe-4868-bb1b-37e56596e38d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:20.502901 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4ba84-104d-4d2b-9d7f-2fef4f19057c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:20.536072 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372696e-c6fe-4868-bb1b-37e56596e38d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:20.538381 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c58aa-a7e8-4f1c-ade9-7709c13c8b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:20.539264 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c58aa-a7e8-4f1c-ade9-7709c13c8b85 None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:20.539545 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c58aa-a7e8-4f1c-ade9-7709c13c8b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:20.539820 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c58aa-a7e8-4f1c-ade9-7709c13c8b85 None admin] PATH_INFO: `/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/a7c1bb51c2b642ffa4708122d826fc67/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:20.541804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c58aa-a7e8-4f1c-ade9-7709c13c8b85 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fee99b2e9234f88ac79ff70429b6f20, user_id=a7c1bb51c2b642ffa4708122d826fc67, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:20.543270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c58aa-a7e8-4f1c-ade9-7709c13c8b85 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:20.555762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 382/761] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:15:20 2022] PUT /identity/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/a7c1bb51c2b642ffa4708122d826fc67/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:15:20.556544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c58aa-a7e8-4f1c-ade9-7709c13c8b85 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:20.582396 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d84d4f-6c22-470e-9a25-9a68b83cc365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:20.582666 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d84d4f-6c22-470e-9a25-9a68b83cc365 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:20.582855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d84d4f-6c22-470e-9a25-9a68b83cc365 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:20.583162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d84d4f-6c22-470e-9a25-9a68b83cc365 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:20.584551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d84d4f-6c22-470e-9a25-9a68b83cc365 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:20.584870 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d84d4f-6c22-470e-9a25-9a68b83cc365 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:20.586400 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d84d4f-6c22-470e-9a25-9a68b83cc365 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:20.611181 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 380/762] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Jul 12 18:15:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:20.611181 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d84d4f-6c22-470e-9a25-9a68b83cc365 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:20.620900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:20.642370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:20.678468 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c58aa-a7e8-4f1c-ade9-7709c13c8b85 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:20.717071 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37876943-7ed9-437e-b8f8-8111aa8f6c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:20.717780 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37876943-7ed9-437e-b8f8-8111aa8f6c53 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:20.718118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37876943-7ed9-437e-b8f8-8111aa8f6c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:20.718395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37876943-7ed9-437e-b8f8-8111aa8f6c53 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:20.719179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37876943-7ed9-437e-b8f8-8111aa8f6c53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:20.719481 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37876943-7ed9-437e-b8f8-8111aa8f6c53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:20.720920 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37876943-7ed9-437e-b8f8-8111aa8f6c53 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:20.734203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d84d4f-6c22-470e-9a25-9a68b83cc365 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:20.735705 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 383/763] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:20.737024 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239094-8fb5-4c3b-bcc7-a8aace017e82 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:20.737349 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239094-8fb5-4c3b-bcc7-a8aace017e82 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:20.737629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239094-8fb5-4c3b-bcc7-a8aace017e82 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:20.739138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 384/764] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:20.740428 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f239094-8fb5-4c3b-bcc7-a8aace017e82 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:20.779654 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdd569-9179-4bd5-b8fd-948dfca0e31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:20.780686 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdd569-9179-4bd5-b8fd-948dfca0e31d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:20.781153 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdd569-9179-4bd5-b8fd-948dfca0e31d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:20.781656 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdd569-9179-4bd5-b8fd-948dfca0e31d None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:20.783067 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdd569-9179-4bd5-b8fd-948dfca0e31d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:20.783562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdd569-9179-4bd5-b8fd-948dfca0e31d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:20.786040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdd569-9179-4bd5-b8fd-948dfca0e31d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:20.794009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 381/765] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Jul 12 18:15:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:20.795021 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdd569-9179-4bd5-b8fd-948dfca0e31d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:20.847525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f239094-8fb5-4c3b-bcc7-a8aace017e82 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:20.875248 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:20.878036 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:20.884761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea32b7b-2e83-4b0d-94f0-8d98ee85039b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:20.885466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea32b7b-2e83-4b0d-94f0-8d98ee85039b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:20.885749 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea32b7b-2e83-4b0d-94f0-8d98ee85039b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:20.886017 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea32b7b-2e83-4b0d-94f0-8d98ee85039b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:20.910571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdd569-9179-4bd5-b8fd-948dfca0e31d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:20.948165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4c9de-bf1d-43d4-b01b-ceab3d9d9c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:20.949071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4c9de-bf1d-43d4-b01b-ceab3d9d9c88 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:20.949383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4c9de-bf1d-43d4-b01b-ceab3d9d9c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:20.949659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4c9de-bf1d-43d4-b01b-ceab3d9d9c88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:20.950486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4c9de-bf1d-43d4-b01b-ceab3d9d9c88 None admin] RBAC: Adding query filter params (role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=ade969d7aa3d49c08782a68ec5997382) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:20.950800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4c9de-bf1d-43d4-b01b-ceab3d9d9c88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:20.952232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4c9de-bf1d-43d4-b01b-ceab3d9d9c88 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:20.958101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 382/766] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:15:20 2022] GET /identity/v3/role_assignments?user.id=ade969d7aa3d49c08782a68ec5997382&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:20.959368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8b7c4-ee64-45b4-8f11-0f58b7022654 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:20.959691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8b7c4-ee64-45b4-8f11-0f58b7022654 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:20.959938 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8b7c4-ee64-45b4-8f11-0f58b7022654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:20.974511 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea32b7b-2e83-4b0d-94f0-8d98ee85039b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:20.976407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea32b7b-2e83-4b0d-94f0-8d98ee85039b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:20.978824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2ac8b7c4-ee64-45b4-8f11-0f58b7022654 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:20.980132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2ac8b7c4-ee64-45b4-8f11-0f58b7022654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:21.073175 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 383/767] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:21.075120 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8b7c4-ee64-45b4-8f11-0f58b7022654 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:21.106855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 385/768] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:15:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:15:21.108271 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea32b7b-2e83-4b0d-94f0-8d98ee85039b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:21.149457 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:21.159952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:21.210031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8b7c4-ee64-45b4-8f11-0f58b7022654 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:21.227287 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea32b7b-2e83-4b0d-94f0-8d98ee85039b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:21.245928 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa439ca-1834-4e1d-b3fa-8f5248639cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:21.246810 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa439ca-1834-4e1d-b3fa-8f5248639cda None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:21.247267 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa439ca-1834-4e1d-b3fa-8f5248639cda None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:21.247729 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa439ca-1834-4e1d-b3fa-8f5248639cda None admin] PATH_INFO: `/v3/endpoints` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:21.248761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa439ca-1834-4e1d-b3fa-8f5248639cda None admin] RBAC: Adding query filter params (interface=public, service_id=1847b838e0b942308ae8d70f5589bf03, region_id=RegionOne) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:21.249448 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa439ca-1834-4e1d-b3fa-8f5248639cda None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:21.251006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa439ca-1834-4e1d-b3fa-8f5248639cda None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:21.264153 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 384/769] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Jul 12 18:15:21 2022] GET /identity/v3/endpoints?service_id=1847b838e0b942308ae8d70f5589bf03&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:21.265378 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa439ca-1834-4e1d-b3fa-8f5248639cda None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:21.272354 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32af3f-5747-4172-8100-57e711fcf6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:21.273159 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32af3f-5747-4172-8100-57e711fcf6cf None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:21.273465 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32af3f-5747-4172-8100-57e711fcf6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:21.273741 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32af3f-5747-4172-8100-57e711fcf6cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:21.288252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32af3f-5747-4172-8100-57e711fcf6cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:21.289762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32af3f-5747-4172-8100-57e711fcf6cf None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:21.312821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-1e32af3f-5747-4172-8100-57e711fcf6cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:21.312821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:21.312821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:21.312821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:21.312821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:21.312821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:21.312821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:21.312821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:21.312821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:21.312821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:21.312821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:21.312821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:21.312821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:21.312821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:21.312821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:21.313821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:21.313821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:21.313821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:21.313821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:21.313821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:21.313821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:21.313821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:21.313821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:21.313821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:21.313821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:21.313821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:21.313821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:21.313821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:21.313821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:21.313821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:21.313821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:21.313821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:21.314699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:21.314699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:21.314699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:21.314699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:21.316970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 386/770] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:21.318940 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32af3f-5747-4172-8100-57e711fcf6cf None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:21.388408 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa439ca-1834-4e1d-b3fa-8f5248639cda None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:21.417682 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:21.422438 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:21.429522 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475e8a8-13d4-454a-b457-22a0317f0023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:21.430648 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475e8a8-13d4-454a-b457-22a0317f0023 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:21.431143 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475e8a8-13d4-454a-b457-22a0317f0023 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:21.431624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475e8a8-13d4-454a-b457-22a0317f0023 None admin] PATH_INFO: `/v3/services/network` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:21.432580 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475e8a8-13d4-454a-b457-22a0317f0023 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:21.434250 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475e8a8-13d4-454a-b457-22a0317f0023 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:21.445677 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32af3f-5747-4172-8100-57e711fcf6cf None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:21.448994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-3475e8a8-13d4-454a-b457-22a0317f0023 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:15:21.448994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:21.448994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:21.448994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:21.448994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:21.448994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:21.448994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:21.448994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:21.448994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:15:21.448994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:21.448994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:21.448994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:21.448994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:21.448994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:21.448994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:21.448994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:21.448994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:21.450315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:21.450315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:21.450315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:21.450315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:21.450315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:21.450315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:21.450315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:21.450315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:21.450315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:21.450315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:21.450315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:21.450315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:21.450315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:21.450315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:21.450315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:21.450315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:21.451145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:21.451145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:21.451145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:21.451145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:21.451145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:21.451145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:21.451145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:21.451145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:21.451145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:21.451145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:21.451145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:21.451145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:21.451145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:15:21.451145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:21.454974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 385/771] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:21 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:21.456156 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475e8a8-13d4-454a-b457-22a0317f0023 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:21.487461 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213da809-7518-4fa7-bc9d-77b9be3f5ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:21.488304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213da809-7518-4fa7-bc9d-77b9be3f5ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:21.488590 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213da809-7518-4fa7-bc9d-77b9be3f5ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:21.488869 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213da809-7518-4fa7-bc9d-77b9be3f5ad5 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:21.490130 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213da809-7518-4fa7-bc9d-77b9be3f5ad5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:21.492057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213da809-7518-4fa7-bc9d-77b9be3f5ad5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:21.505346 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 387/772] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Jul 12 18:15:21 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:21.505346 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213da809-7518-4fa7-bc9d-77b9be3f5ad5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:21.620621 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213da809-7518-4fa7-bc9d-77b9be3f5ad5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:21.662655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d3d37-d30e-4206-81df-a1fa88116a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:21.663427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d3d37-d30e-4206-81df-a1fa88116a1f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:21.663627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d3d37-d30e-4206-81df-a1fa88116a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:21.663908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d3d37-d30e-4206-81df-a1fa88116a1f None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:21.664632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d3d37-d30e-4206-81df-a1fa88116a1f None admin] RBAC: Adding query filter params (name=network) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:21.665625 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d3d37-d30e-4206-81df-a1fa88116a1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:21.667238 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d3d37-d30e-4206-81df-a1fa88116a1f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:21.673118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 388/773] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Jul 12 18:15:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:21.678467 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d3d37-d30e-4206-81df-a1fa88116a1f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:21.693517 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:21.706397 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475e8a8-13d4-454a-b457-22a0317f0023 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:21.755331 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91432d-2359-4441-b985-f87edd87e066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:21.756104 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91432d-2359-4441-b985-f87edd87e066 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:21.756397 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91432d-2359-4441-b985-f87edd87e066 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:21.756676 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91432d-2359-4441-b985-f87edd87e066 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:21.757480 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91432d-2359-4441-b985-f87edd87e066 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:21.757896 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91432d-2359-4441-b985-f87edd87e066 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:21.759423 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91432d-2359-4441-b985-f87edd87e066 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:21.774066 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 386/774] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:21.782284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91432d-2359-4441-b985-f87edd87e066 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:21.814345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d3d37-d30e-4206-81df-a1fa88116a1f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:21.849941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:21.869002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690f547-4582-42ab-9816-e4594c51cdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:21.869906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690f547-4582-42ab-9816-e4594c51cdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:21.870365 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690f547-4582-42ab-9816-e4594c51cdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:21.870903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690f547-4582-42ab-9816-e4594c51cdf7 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:21.871752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690f547-4582-42ab-9816-e4594c51cdf7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:21.872204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690f547-4582-42ab-9816-e4594c51cdf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:21.874689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690f547-4582-42ab-9816-e4594c51cdf7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:21.883544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 389/775] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Jul 12 18:15:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:21.889056 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690f547-4582-42ab-9816-e4594c51cdf7 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:21.924977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91432d-2359-4441-b985-f87edd87e066 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:21.969760 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43b801-9993-450f-af7a-9a9fea3fa83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:21.970831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43b801-9993-450f-af7a-9a9fea3fa83b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:21.971836 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43b801-9993-450f-af7a-9a9fea3fa83b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:21.972274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43b801-9993-450f-af7a-9a9fea3fa83b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:21.980392 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43b801-9993-450f-af7a-9a9fea3fa83b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:21.982605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43b801-9993-450f-af7a-9a9fea3fa83b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:21.998521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-ec43b801-9993-450f-af7a-9a9fea3fa83b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:21.998521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:21.998521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:21.998521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:21.998521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:21.998521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:21.998521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:21.998521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:21.998521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:21.998521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:21.998521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:21.998521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:21.998521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:21.998521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:21.998521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:21.999413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:21.999413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:21.999413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:21.999413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:21.999413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:21.999413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:21.999413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:21.999413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:21.999413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:21.999413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:21.999413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:21.999413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:21.999413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:21.999413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:21.999413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:21.999413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:21.999413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:22.000323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:22.000323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:22.000323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:22.000323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:22.000323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:22.000323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:22.000323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:22.000323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:22.008571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 387/776] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:22.010288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43b801-9993-450f-af7a-9a9fea3fa83b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:22.051173 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:22.101654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690f547-4582-42ab-9816-e4594c51cdf7 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:22.156275 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67139a-f539-433e-aaee-7b943347ed95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:22.156947 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67139a-f539-433e-aaee-7b943347ed95 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:22.157233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67139a-f539-433e-aaee-7b943347ed95 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:22.157543 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67139a-f539-433e-aaee-7b943347ed95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:22.158749 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67139a-f539-433e-aaee-7b943347ed95 None admin] RBAC: Adding query filter params (interface=public, service_id=23d420d155e44ae7a1c9394f2b2d2384, region_id=RegionOne) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:22.159069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67139a-f539-433e-aaee-7b943347ed95 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:22.160688 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67139a-f539-433e-aaee-7b943347ed95 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:22.170063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 390/777] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Jul 12 18:15:21 2022] GET /identity/v3/endpoints?service_id=23d420d155e44ae7a1c9394f2b2d2384&interface=public®ion_id=RegionOne => generated 194 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:22.176728 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67139a-f539-433e-aaee-7b943347ed95 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:22.219412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43b801-9993-450f-af7a-9a9fea3fa83b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:22.244113 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:22.287495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67139a-f539-433e-aaee-7b943347ed95 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:22.319518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c400a3-729d-4e3b-98b1-e4dc4fa92e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:22.320187 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c400a3-729d-4e3b-98b1-e4dc4fa92e6c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:22.320468 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c400a3-729d-4e3b-98b1-e4dc4fa92e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:22.320740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c400a3-729d-4e3b-98b1-e4dc4fa92e6c None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:22.321554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c400a3-729d-4e3b-98b1-e4dc4fa92e6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:22.321863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c400a3-729d-4e3b-98b1-e4dc4fa92e6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:22.323542 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c400a3-729d-4e3b-98b1-e4dc4fa92e6c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:22.325111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e9ee8-fb1f-495f-84c7-070b4130c621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:22.325807 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e9ee8-fb1f-495f-84c7-070b4130c621 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:22.326092 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e9ee8-fb1f-495f-84c7-070b4130c621 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:22.326366 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e9ee8-fb1f-495f-84c7-070b4130c621 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:22.327047 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e9ee8-fb1f-495f-84c7-070b4130c621 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:22.328409 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e9ee8-fb1f-495f-84c7-070b4130c621 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:22.334164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 391/778] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Jul 12 18:15:22 2022] GET /identity/v3/services => generated 772 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:22.355371 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 388/779] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:22.362034 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e9ee8-fb1f-495f-84c7-070b4130c621 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:22.365555 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:22.494756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e9ee8-fb1f-495f-84c7-070b4130c621 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:22.529548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ea29f-42e8-4eab-a77b-16c903842ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:22.530202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ea29f-42e8-4eab-a77b-16c903842ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:22.530486 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ea29f-42e8-4eab-a77b-16c903842ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:22.530763 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ea29f-42e8-4eab-a77b-16c903842ef8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:22.531590 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ea29f-42e8-4eab-a77b-16c903842ef8 None admin] RBAC: Adding query filter params (role.id=82fa784b33dd4fe19c62367f39ac45b2, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=54189575a60a4d9dbaabb78d44e9c31e) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:22.531905 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ea29f-42e8-4eab-a77b-16c903842ef8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:22.533368 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ea29f-42e8-4eab-a77b-16c903842ef8 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:22.539943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 392/780] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:15:22 2022] GET /identity/v3/role_assignments?user.id=54189575a60a4d9dbaabb78d44e9c31e&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=82fa784b33dd4fe19c62367f39ac45b2 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:22.818840 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81315ace-0288-40f9-af76-2eded4a64b58 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:22.819832 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81315ace-0288-40f9-af76-2eded4a64b58 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:22.820334 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81315ace-0288-40f9-af76-2eded4a64b58 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:22.822208 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 389/781] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:22.827324 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b502f4-d829-454d-8ac8-b41503b7c050 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:22.828120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b502f4-d829-454d-8ac8-b41503b7c050 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:22.828602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b502f4-d829-454d-8ac8-b41503b7c050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:22.854619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a1b502f4-d829-454d-8ac8-b41503b7c050 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:22.856311 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a1b502f4-d829-454d-8ac8-b41503b7c050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:22.939805 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:22.948623 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 393/782] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:22.984071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81315ace-0288-40f9-af76-2eded4a64b58 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:23.157970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81315ace-0288-40f9-af76-2eded4a64b58 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:23.203740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ead4c-d5b6-4119-8430-3b42d6104292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:23.204538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ead4c-d5b6-4119-8430-3b42d6104292 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:23.204821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ead4c-d5b6-4119-8430-3b42d6104292 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:23.205102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ead4c-d5b6-4119-8430-3b42d6104292 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:23.219640 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ead4c-d5b6-4119-8430-3b42d6104292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:23.227907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-219ead4c-d5b6-4119-8430-3b42d6104292 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:15:23.227907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:23.227907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:23.227907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:23.227907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:23.227907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:23.227907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:23.227907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:23.227907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:23.227907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:23.227907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:23.227907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:23.227907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:23.227907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:23.227907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:23.227907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:23.229418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:23.229418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:23.229418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:23.229418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:23.229418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:23.229418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:23.229418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:23.229418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:23.229418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:23.229418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:23.229418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:23.229418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:23.229418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:23.229418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:23.229418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:23.229418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:23.230253 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:23.230253 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:23.230253 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:23.230253 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:23.230253 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:23.230253 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:23.230253 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:23.230253 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:23.230253 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:23.230253 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:23.230253 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:15:23.230253 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:23.230253 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 390/783] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:15:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:23.242360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b502f4-d829-454d-8ac8-b41503b7c050 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:23.276410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a2073-096c-4c63-80cc-762284132e95 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:23.276795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a2073-096c-4c63-80cc-762284132e95 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:23.277015 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a2073-096c-4c63-80cc-762284132e95 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:23.278631 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 391/784] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:15:23.283824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389e78e-fa53-41d0-a9b3-bd4a97a1ff6e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:23.284263 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389e78e-fa53-41d0-a9b3-bd4a97a1ff6e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:23.284546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389e78e-fa53-41d0-a9b3-bd4a97a1ff6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:23.320655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2389e78e-fa53-41d0-a9b3-bd4a97a1ff6e None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:23.322409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2389e78e-fa53-41d0-a9b3-bd4a97a1ff6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:23.377614 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:23.430045 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b502f4-d829-454d-8ac8-b41503b7c050 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:23.455803 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 392/785] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:23.475481 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31bf98-7073-47e1-ab12-6e33adef8d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:23.476148 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31bf98-7073-47e1-ab12-6e33adef8d00 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:23.476433 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31bf98-7073-47e1-ab12-6e33adef8d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:23.476710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31bf98-7073-47e1-ab12-6e33adef8d00 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:23.477484 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31bf98-7073-47e1-ab12-6e33adef8d00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:23.477796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31bf98-7073-47e1-ab12-6e33adef8d00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:23.479170 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31bf98-7073-47e1-ab12-6e33adef8d00 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:23.488041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 394/786] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:15:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:23.494717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389e78e-fa53-41d0-a9b3-bd4a97a1ff6e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:23.503400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31bf98-7073-47e1-ab12-6e33adef8d00 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:23.613661 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:23.672489 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31bf98-7073-47e1-ab12-6e33adef8d00 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:23.694716 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389e78e-fa53-41d0-a9b3-bd4a97a1ff6e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:23.711140 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f58d3-0156-4ab5-9795-e57688542c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:23.713472 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f58d3-0156-4ab5-9795-e57688542c3d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:23.713970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f58d3-0156-4ab5-9795-e57688542c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:23.715154 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f58d3-0156-4ab5-9795-e57688542c3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:23.734207 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f58d3-0156-4ab5-9795-e57688542c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:23.748151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-919f58d3-0156-4ab5-9795-e57688542c3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:15:23.748151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:23.748151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:23.748151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:23.748151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:23.748151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:23.748151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:23.748151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:23.748151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:23.748151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:23.748151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:23.748151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:23.748151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:23.748151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:23.748151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:23.748151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:23.749205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:23.749205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:23.749205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:23.749205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:23.749205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:23.749205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:23.749205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:23.749205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:23.749205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:23.749205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:23.749205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:23.749205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:23.749205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:23.749205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:23.749205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:23.749205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:23.750088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:23.750088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:23.750088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:23.750088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:23.750088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:23.750088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:23.750088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:23.750088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:23.750088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:23.750088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:23.750088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:15:23.750088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:23.755548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 395/787] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:15:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:23.760578 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f58d3-0156-4ab5-9795-e57688542c3d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:23.769214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50522e-e51b-4d27-9246-6d6efdc5913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:23.770475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50522e-e51b-4d27-9246-6d6efdc5913e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:23.770862 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50522e-e51b-4d27-9246-6d6efdc5913e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:23.771237 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50522e-e51b-4d27-9246-6d6efdc5913e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:23.789446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50522e-e51b-4d27-9246-6d6efdc5913e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:23.790938 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50522e-e51b-4d27-9246-6d6efdc5913e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:23.826548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-cf50522e-e51b-4d27-9246-6d6efdc5913e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:23.826548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:23.826548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:23.826548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:23.826548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:23.826548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:23.826548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:23.826548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:23.826548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:23.826548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:23.826548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:23.826548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:23.826548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:23.826548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:23.826548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:23.827918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:23.827918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:23.827918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:23.827918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:23.827918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:23.827918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:23.827918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:23.827918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:23.827918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:23.827918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:23.827918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:23.827918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:23.827918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:23.827918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:23.827918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:23.827918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:23.827918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:23.829535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:23.829535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:23.829535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:23.829535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:23.829535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 393/788] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:23.833542 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50522e-e51b-4d27-9246-6d6efdc5913e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:23.858634 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:23.941946 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f58d3-0156-4ab5-9795-e57688542c3d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:23.986750 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:24.002894 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50522e-e51b-4d27-9246-6d6efdc5913e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:24.041388 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736243f-ad69-44bb-9b6c-9ee8c9e77ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:24.041930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71ea26-d081-4f03-9b35-96b5c553737b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:24.042055 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736243f-ad69-44bb-9b6c-9ee8c9e77ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:24.042330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736243f-ad69-44bb-9b6c-9ee8c9e77ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:24.042608 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71ea26-d081-4f03-9b35-96b5c553737b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:24.042712 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736243f-ad69-44bb-9b6c-9ee8c9e77ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:24.042892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71ea26-d081-4f03-9b35-96b5c553737b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:24.043170 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71ea26-d081-4f03-9b35-96b5c553737b None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:24.043350 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736243f-ad69-44bb-9b6c-9ee8c9e77ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:24.043642 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736243f-ad69-44bb-9b6c-9ee8c9e77ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:24.043912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71ea26-d081-4f03-9b35-96b5c553737b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:24.044221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71ea26-d081-4f03-9b35-96b5c553737b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:24.045028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736243f-ad69-44bb-9b6c-9ee8c9e77ad7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:24.045612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71ea26-d081-4f03-9b35-96b5c553737b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:24.059411 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 394/789] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:24.064900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736243f-ad69-44bb-9b6c-9ee8c9e77ad7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:24.065969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 396/790] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:15:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:24.072388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71ea26-d081-4f03-9b35-96b5c553737b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:24.156351 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:24.185439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736243f-ad69-44bb-9b6c-9ee8c9e77ad7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:24.215379 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71ea26-d081-4f03-9b35-96b5c553737b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:24.221302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d22b18-3ef8-42db-a7fd-21cd1dfe4f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:24.222426 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d22b18-3ef8-42db-a7fd-21cd1dfe4f2a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:24.222912 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d22b18-3ef8-42db-a7fd-21cd1dfe4f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:24.223388 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d22b18-3ef8-42db-a7fd-21cd1dfe4f2a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:24.232173 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d22b18-3ef8-42db-a7fd-21cd1dfe4f2a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:24.233899 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d22b18-3ef8-42db-a7fd-21cd1dfe4f2a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:24.248949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-98d22b18-3ef8-42db-a7fd-21cd1dfe4f2a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:15:24.248949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:24.248949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:24.248949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:24.248949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:24.248949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:24.248949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:24.248949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:24.248949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:24.248949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:24.248949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:24.248949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:24.248949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:24.248949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:24.248949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:24.248949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:24.249916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:24.249916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:24.249916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:24.249916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:24.249916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:24.249916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:24.249916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:24.249916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:24.249916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:24.249916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:24.249916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:24.249916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:24.249916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:24.249916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:24.249916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:24.249916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:24.249916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:24.249916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:24.250850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:24.250850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:24.250850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:24.250850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:24.250850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:24.250850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:24.250850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:24.250850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:24.250850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:15:24.250850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:24.253523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 395/791] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Jul 12 18:15:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:24.255064 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d0de9-c660-4c05-a78f-97eee2e3e6dc None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:24.255554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d0de9-c660-4c05-a78f-97eee2e3e6dc None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:24.256038 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d0de9-c660-4c05-a78f-97eee2e3e6dc None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:24.257883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 396/792] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:24.258887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d0de9-c660-4c05-a78f-97eee2e3e6dc None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:24.260779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac83e53-9be4-476e-80f3-4f3680ed236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:24.261847 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac83e53-9be4-476e-80f3-4f3680ed236f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:24.262125 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac83e53-9be4-476e-80f3-4f3680ed236f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:24.262434 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac83e53-9be4-476e-80f3-4f3680ed236f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:24.278321 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac83e53-9be4-476e-80f3-4f3680ed236f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:24.280061 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac83e53-9be4-476e-80f3-4f3680ed236f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:24.305323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-7ac83e53-9be4-476e-80f3-4f3680ed236f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:24.305323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:24.305323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:24.305323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:24.305323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:24.305323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:24.305323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:24.305323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:24.305323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:24.305323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:24.305323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:24.305323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:24.305323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:24.305323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:24.305323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:24.306306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:24.306306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:24.306306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:24.306306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:24.306306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:24.306306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:24.306306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:24.306306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:24.306306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:24.306306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:24.306306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:24.306306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:24.306306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:24.306306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:24.306306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:24.306306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:24.306306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:24.307219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:24.307219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:24.307219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:24.307219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:24.309333 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 397/793] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:24.310781 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e1e81-25af-489a-a23e-8d730eae31ba None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:24.311436 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e1e81-25af-489a-a23e-8d730eae31ba None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:24.311928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e1e81-25af-489a-a23e-8d730eae31ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:24.337182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-524e1e81-25af-489a-a23e-8d730eae31ba None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:24.338594 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-524e1e81-25af-489a-a23e-8d730eae31ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:24.376225 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:24.379243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d0de9-c660-4c05-a78f-97eee2e3e6dc None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:24.417799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb33f3-9216-4633-957a-1f9e16105717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:24.418847 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb33f3-9216-4633-957a-1f9e16105717 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:24.419317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb33f3-9216-4633-957a-1f9e16105717 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:24.419798 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb33f3-9216-4633-957a-1f9e16105717 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:24.420895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb33f3-9216-4633-957a-1f9e16105717 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:24.421484 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb33f3-9216-4633-957a-1f9e16105717 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:24.423397 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb33f3-9216-4633-957a-1f9e16105717 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:24.425786 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:24.434615 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 398/794] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:24.437329 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e1e81-25af-489a-a23e-8d730eae31ba None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:24.458299 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 397/795] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Jul 12 18:15:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:24.464565 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb33f3-9216-4633-957a-1f9e16105717 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:24.583548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb33f3-9216-4633-957a-1f9e16105717 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:24.583757 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e1e81-25af-489a-a23e-8d730eae31ba None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:24.627092 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc8bca-0e09-4c3a-923e-0f9e5d92618d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:24.627737 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc8bca-0e09-4c3a-923e-0f9e5d92618d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:24.628019 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc8bca-0e09-4c3a-923e-0f9e5d92618d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:24.628289 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc8bca-0e09-4c3a-923e-0f9e5d92618d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:24.632543 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb75286-7810-43a7-8759-161269eadd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:24.633290 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb75286-7810-43a7-8759-161269eadd2b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:24.634012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb75286-7810-43a7-8759-161269eadd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:24.634012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb75286-7810-43a7-8759-161269eadd2b None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:24.634507 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb75286-7810-43a7-8759-161269eadd2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:24.634812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb75286-7810-43a7-8759-161269eadd2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:24.636188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb75286-7810-43a7-8759-161269eadd2b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:24.653100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 399/796] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:24.653100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb75286-7810-43a7-8759-161269eadd2b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:24.680431 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:24.716665 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:24.730353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc8bca-0e09-4c3a-923e-0f9e5d92618d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:24.732807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc8bca-0e09-4c3a-923e-0f9e5d92618d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:24.766986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb75286-7810-43a7-8759-161269eadd2b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:24.809972 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ab22b-bd38-43c1-ac73-8ab6b8bb0c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:24.810927 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ab22b-bd38-43c1-ac73-8ab6b8bb0c84 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:24.811347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ab22b-bd38-43c1-ac73-8ab6b8bb0c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:24.811667 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ab22b-bd38-43c1-ac73-8ab6b8bb0c84 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:24.812420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ab22b-bd38-43c1-ac73-8ab6b8bb0c84 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:24.814001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ab22b-bd38-43c1-ac73-8ab6b8bb0c84 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:24.826930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-a94ab22b-bd38-43c1-ac73-8ab6b8bb0c84 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:15:24.826930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:24.826930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:24.826930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:24.826930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:24.826930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:24.826930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:24.826930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:24.826930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:15:24.826930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:24.826930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:24.826930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:24.826930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:24.826930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:24.826930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:24.826930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:24.828096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:24.828096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:24.828096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:24.828096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:24.828096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:24.828096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:24.828096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:24.828096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:24.828096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:24.828096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:24.828096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:24.828096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:24.828096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:24.828096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:24.828096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:24.828096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:24.829139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:24.829139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:24.829139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:24.829139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:24.829139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:24.829139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:24.829139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:24.829139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:24.829139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:24.829139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:24.829139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:24.829139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:24.829139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:24.829139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:15:24.829139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:24.836446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 400/797] 10.222.0.57 () {56 vars in 1129 bytes} [Tue Jul 12 18:15:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:24.836446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ab22b-bd38-43c1-ac73-8ab6b8bb0c84 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:24.864492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 398/798] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:15:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:15:24.865765 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3f239-495e-469b-8bf0-8fcc654fe06f None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:24.866113 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3f239-495e-469b-8bf0-8fcc654fe06f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:24.866449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3f239-495e-469b-8bf0-8fcc654fe06f None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:24.867826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 399/799] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:24.870430 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3f239-495e-469b-8bf0-8fcc654fe06f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:24.929126 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:24.944690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ab22b-bd38-43c1-ac73-8ab6b8bb0c84 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:24.966741 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:24.977140 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3f239-495e-469b-8bf0-8fcc654fe06f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:24.978936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76bc2d-022c-44c7-abef-255bc7c6a1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:24.979741 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76bc2d-022c-44c7-abef-255bc7c6a1fc None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:24.980025 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76bc2d-022c-44c7-abef-255bc7c6a1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:24.980300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76bc2d-022c-44c7-abef-255bc7c6a1fc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:24.988505 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76bc2d-022c-44c7-abef-255bc7c6a1fc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:24.990560 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76bc2d-022c-44c7-abef-255bc7c6a1fc None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:25.004876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-ec76bc2d-022c-44c7-abef-255bc7c6a1fc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:15:25.004876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:25.004876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:25.004876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:25.004876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:25.004876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:25.004876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:25.004876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:25.004876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:25.004876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:25.004876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:25.004876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:25.004876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:25.004876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:25.004876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:25.004876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:25.006082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:25.006082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:25.006082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:25.006082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:25.006082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:25.006082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:25.006082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:25.006082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:25.006082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:25.006082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:25.006082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:25.006082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:25.006082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:25.006082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:25.006082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:25.006082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:25.006082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:25.006082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:25.007216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:25.007216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:25.007216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:25.007216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:25.007216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:25.007216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:25.007216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:25.007216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:25.007216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:15:25.007216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:25.007216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 401/800] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:15:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:25.007216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76bc2d-022c-44c7-abef-255bc7c6a1fc None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:25.015461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb07e45-2caf-433e-9e33-fcff1f6aeef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:25.016124 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb07e45-2caf-433e-9e33-fcff1f6aeef7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:25.016404 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb07e45-2caf-433e-9e33-fcff1f6aeef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:25.016677 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb07e45-2caf-433e-9e33-fcff1f6aeef7 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:25.017425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb07e45-2caf-433e-9e33-fcff1f6aeef7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:25.017734 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb07e45-2caf-433e-9e33-fcff1f6aeef7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:25.019108 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb07e45-2caf-433e-9e33-fcff1f6aeef7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:25.023956 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 400/801] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Jul 12 18:15:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:25.025389 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957af73e-cd76-48d0-8024-130491fbc497 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:25.025679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957af73e-cd76-48d0-8024-130491fbc497 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:25.025956 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957af73e-cd76-48d0-8024-130491fbc497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:25.043877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-957af73e-cd76-48d0-8024-130491fbc497 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:25.045104 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-957af73e-cd76-48d0-8024-130491fbc497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:25.117278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 401/802] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:25.118619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cbfbb-a956-4747-905b-1c3bfc7f2330 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:25.118915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cbfbb-a956-4747-905b-1c3bfc7f2330 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:25.119191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cbfbb-a956-4747-905b-1c3bfc7f2330 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:25.124438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 402/803] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:25.124438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cbfbb-a956-4747-905b-1c3bfc7f2330 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:25.210058 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:25.220992 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76bc2d-022c-44c7-abef-255bc7c6a1fc None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:25.226679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cbfbb-a956-4747-905b-1c3bfc7f2330 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:25.254608 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9dda5-d546-4102-bf9e-441a1f2c87f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:25.255419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9dda5-d546-4102-bf9e-441a1f2c87f4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:25.255705 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9dda5-d546-4102-bf9e-441a1f2c87f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:25.255977 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9dda5-d546-4102-bf9e-441a1f2c87f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:25.260272 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60bee4-f2ee-4ba7-ad0d-00d8d6066c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:25.261047 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60bee4-f2ee-4ba7-ad0d-00d8d6066c1b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:25.261539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60bee4-f2ee-4ba7-ad0d-00d8d6066c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:25.262032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60bee4-f2ee-4ba7-ad0d-00d8d6066c1b None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:25.263185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60bee4-f2ee-4ba7-ad0d-00d8d6066c1b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:25.263522 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60bee4-f2ee-4ba7-ad0d-00d8d6066c1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:25.264983 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60bee4-f2ee-4ba7-ad0d-00d8d6066c1b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:25.266154 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9dda5-d546-4102-bf9e-441a1f2c87f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:25.267652 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9dda5-d546-4102-bf9e-441a1f2c87f4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:25.274879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:25.284266 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 403/804] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Jul 12 18:15:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:25.285079 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60bee4-f2ee-4ba7-ad0d-00d8d6066c1b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:25.287604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-60c9dda5-d546-4102-bf9e-441a1f2c87f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:25.287604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:25.287604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:25.287604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:25.287604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:25.287604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:25.287604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:25.287604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:25.287604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:25.287604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:25.287604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:25.287604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:25.287604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:25.287604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:25.287604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:25.288437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:25.288437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:25.288437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:25.288437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:25.288437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:25.288437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:25.288437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:25.288437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:25.288437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:25.288437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:25.288437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:25.288437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:25.288437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:25.288437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:25.288437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:25.288437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:25.288437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:25.289348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:25.289348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:25.289348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:25.289348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:25.293528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 402/805] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:25.294918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b750d0-ef6c-42f3-8dc5-25cc168900f8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:25.295258 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b750d0-ef6c-42f3-8dc5-25cc168900f8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:25.295593 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b750d0-ef6c-42f3-8dc5-25cc168900f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:25.312125 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-65b750d0-ef6c-42f3-8dc5-25cc168900f8 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:25.313356 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-65b750d0-ef6c-42f3-8dc5-25cc168900f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:25.378915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 403/806] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:25.379727 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b750d0-ef6c-42f3-8dc5-25cc168900f8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:25.383443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60bee4-f2ee-4ba7-ad0d-00d8d6066c1b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:25.418609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3eca8-d165-474c-96ed-c63e57b38a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:25.419265 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3eca8-d165-474c-96ed-c63e57b38a94 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:25.419548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3eca8-d165-474c-96ed-c63e57b38a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:25.419820 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3eca8-d165-474c-96ed-c63e57b38a94 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:25.420515 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3eca8-d165-474c-96ed-c63e57b38a94 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:25.420824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3eca8-d165-474c-96ed-c63e57b38a94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:25.422218 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3eca8-d165-474c-96ed-c63e57b38a94 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:25.427409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 404/807] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Jul 12 18:15:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:25.428177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3eca8-d165-474c-96ed-c63e57b38a94 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:25.438036 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:25.490818 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b750d0-ef6c-42f3-8dc5-25cc168900f8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:25.516953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:25.525011 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db554ff-203f-4ef8-bb2a-9833f43e5204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:25.525830 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db554ff-203f-4ef8-bb2a-9833f43e5204 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:25.526116 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db554ff-203f-4ef8-bb2a-9833f43e5204 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:25.526392 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db554ff-203f-4ef8-bb2a-9833f43e5204 None admin] PATH_INFO: `/v3/services/network` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:25.527043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db554ff-203f-4ef8-bb2a-9833f43e5204 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:25.528167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3eca8-d165-474c-96ed-c63e57b38a94 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:25.528419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db554ff-203f-4ef8-bb2a-9833f43e5204 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:25.540250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-2db554ff-203f-4ef8-bb2a-9833f43e5204 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:15:25.540250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:25.540250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:25.540250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:25.540250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:25.540250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:25.540250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:25.540250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:25.540250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:15:25.540250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:25.540250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:25.540250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:25.540250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:25.540250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:25.540250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:25.540250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:25.540250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:25.541200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:25.541200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:25.541200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:25.541200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:25.541200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:25.541200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:25.541200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:25.541200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:25.541200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:25.541200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:25.541200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:25.541200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:25.541200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:25.541200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:25.541200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:25.541200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:25.546956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:25.546956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:25.546956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:25.546956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:25.546956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:25.546956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:25.546956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:25.546956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:25.546956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:25.546956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:25.546956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:25.546956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:25.546956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:15:25.546956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:25.546956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 404/808] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:25 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:25.547749 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db554ff-203f-4ef8-bb2a-9833f43e5204 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:25.561681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe4980-db0c-4422-bb08-312150a7d1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:25.562482 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe4980-db0c-4422-bb08-312150a7d1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:25.562765 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe4980-db0c-4422-bb08-312150a7d1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:25.563039 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe4980-db0c-4422-bb08-312150a7d1f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:25.574314 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe4980-db0c-4422-bb08-312150a7d1f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:25.575778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe4980-db0c-4422-bb08-312150a7d1f6 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:25.593065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-2ebe4980-db0c-4422-bb08-312150a7d1f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:25.593065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:25.593065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:25.593065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:25.593065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:25.593065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:25.593065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:25.593065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:25.593065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:25.593065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:25.593065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:25.593065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:25.593065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:25.593065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:25.593065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:25.594141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:25.594141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:25.594141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:25.594141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:25.594141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:25.594141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:25.594141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:25.594141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:25.594141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:25.594141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:25.594141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:25.594141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:25.594141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:25.594141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:25.594141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:25.594141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:25.594141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:25.595050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:25.595050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:25.595050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:25.595050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:25.595050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 405/809] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:25.595050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe4980-db0c-4422-bb08-312150a7d1f6 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:25.653189 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db554ff-203f-4ef8-bb2a-9833f43e5204 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:25.653474 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:25.687762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb771e-4696-48b3-9113-34e7168445ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:25.688420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb771e-4696-48b3-9113-34e7168445ff None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:25.688982 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb771e-4696-48b3-9113-34e7168445ff None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:25.688982 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb771e-4696-48b3-9113-34e7168445ff None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:25.689731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb771e-4696-48b3-9113-34e7168445ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:25.690041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb771e-4696-48b3-9113-34e7168445ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:25.691402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb771e-4696-48b3-9113-34e7168445ff None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:25.694697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe4980-db0c-4422-bb08-312150a7d1f6 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:25.702679 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 405/810] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:25.703439 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb771e-4696-48b3-9113-34e7168445ff None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:25.729735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746e372-3d41-43f3-98ea-1a87db1cfe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:25.730530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746e372-3d41-43f3-98ea-1a87db1cfe77 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:25.730814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746e372-3d41-43f3-98ea-1a87db1cfe77 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:25.731097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746e372-3d41-43f3-98ea-1a87db1cfe77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:25.741644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746e372-3d41-43f3-98ea-1a87db1cfe77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:25.749539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-7746e372-3d41-43f3-98ea-1a87db1cfe77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:25.749539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:25.749539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:25.749539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:25.749539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:25.749539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:25.749539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:25.749539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:25.749539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:25.749539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:25.749539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:25.749539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:25.749539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:25.749539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:25.749539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:25.749539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:25.750439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:25.750439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:25.750439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:25.750439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:25.750439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:25.750439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:25.750439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:25.750439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:25.750439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:25.750439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:25.750439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:25.750439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:25.750439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:25.750439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:25.750439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:25.750439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:25.751264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:25.751264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:25.751264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:25.751264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:25.751264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:25.751264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:25.751264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:25.751264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:25.751264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:25.751264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:25.751264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:25.751264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:25.752164 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 406/811] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:15:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:25.753112 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746e372-3d41-43f3-98ea-1a87db1cfe77 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:25.754568 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:25.804384 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb771e-4696-48b3-9113-34e7168445ff None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:25.837033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20318929-0e20-46bc-94e6-427fa2f8b609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:25.837704 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20318929-0e20-46bc-94e6-427fa2f8b609 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:25.837986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20318929-0e20-46bc-94e6-427fa2f8b609 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:25.838266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20318929-0e20-46bc-94e6-427fa2f8b609 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:25.838990 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20318929-0e20-46bc-94e6-427fa2f8b609 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:25.840348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20318929-0e20-46bc-94e6-427fa2f8b609 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:25.850092 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746e372-3d41-43f3-98ea-1a87db1cfe77 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:25.860776 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 406/812] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Jul 12 18:15:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:15:25.861620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20318929-0e20-46bc-94e6-427fa2f8b609 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:25.882535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:25.907293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc5c13-52c0-4d0b-9b38-78543b09a91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:25.908562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc5c13-52c0-4d0b-9b38-78543b09a91b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:25.908852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc5c13-52c0-4d0b-9b38-78543b09a91b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:25.909130 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc5c13-52c0-4d0b-9b38-78543b09a91b None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:25.910316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc5c13-52c0-4d0b-9b38-78543b09a91b None admin] RBAC: Adding query filter params (name=network) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:25.910629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc5c13-52c0-4d0b-9b38-78543b09a91b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:25.913361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc5c13-52c0-4d0b-9b38-78543b09a91b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:25.921417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 407/813] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Jul 12 18:15:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:25.922679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc5c13-52c0-4d0b-9b38-78543b09a91b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:25.980416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20318929-0e20-46bc-94e6-427fa2f8b609 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:25.991606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:26.022479 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cd9c3-43da-4b40-9e9f-b6925d00f46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:26.023929 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cd9c3-43da-4b40-9e9f-b6925d00f46d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:26.023929 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cd9c3-43da-4b40-9e9f-b6925d00f46d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:26.023929 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cd9c3-43da-4b40-9e9f-b6925d00f46d None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:26.024395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42cd9c3-43da-4b40-9e9f-b6925d00f46d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:26.025230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42cd9c3-43da-4b40-9e9f-b6925d00f46d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:26.026138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42cd9c3-43da-4b40-9e9f-b6925d00f46d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:26.039202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 407/814] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:26.039370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc5c13-52c0-4d0b-9b38-78543b09a91b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:26.039820 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cd9c3-43da-4b40-9e9f-b6925d00f46d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:26.077377 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9642ac-dddf-4fcb-9e92-47c30434c35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:26.078560 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9642ac-dddf-4fcb-9e92-47c30434c35c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:26.079060 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9642ac-dddf-4fcb-9e92-47c30434c35c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:26.079408 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9642ac-dddf-4fcb-9e92-47c30434c35c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:26.086961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9642ac-dddf-4fcb-9e92-47c30434c35c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:26.088419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9642ac-dddf-4fcb-9e92-47c30434c35c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:26.104684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-af9642ac-dddf-4fcb-9e92-47c30434c35c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:26.104684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:26.104684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:26.104684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:26.104684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:26.104684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:26.104684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:26.104684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:26.104684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:26.104684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:26.104684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:26.104684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:26.104684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:26.104684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:26.104684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:26.105698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:26.105698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:26.105698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:26.105698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:26.105698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:26.105698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:26.105698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:26.105698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:26.105698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:26.105698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:26.105698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:26.105698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:26.105698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:26.105698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:26.105698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:26.105698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:26.105698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:26.106602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:26.106602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:26.106602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:26.106602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:26.106602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:26.106602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:26.106602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:26.106602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:26.106602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 408/815] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:26.107099 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9642ac-dddf-4fcb-9e92-47c30434c35c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:26.150597 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:26.171290 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cd9c3-43da-4b40-9e9f-b6925d00f46d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:26.207638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40868934-caee-41dd-b772-c70917780c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:26.208832 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40868934-caee-41dd-b772-c70917780c78 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:26.209129 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40868934-caee-41dd-b772-c70917780c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:26.209421 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40868934-caee-41dd-b772-c70917780c78 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:26.210166 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40868934-caee-41dd-b772-c70917780c78 None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:26.210522 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40868934-caee-41dd-b772-c70917780c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:26.211947 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40868934-caee-41dd-b772-c70917780c78 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:26.212754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9642ac-dddf-4fcb-9e92-47c30434c35c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:26.220993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 408/816] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:15:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:26.226257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40868934-caee-41dd-b772-c70917780c78 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:26.250575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b5574-fbfe-4926-a97e-cfba027b6713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:26.251239 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5574-fbfe-4926-a97e-cfba027b6713 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:26.251525 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5574-fbfe-4926-a97e-cfba027b6713 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:26.251797 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5574-fbfe-4926-a97e-cfba027b6713 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:26.252678 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b5574-fbfe-4926-a97e-cfba027b6713 None admin] RBAC: Adding query filter params (type=network) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:26.252796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b5574-fbfe-4926-a97e-cfba027b6713 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:26.254205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b5574-fbfe-4926-a97e-cfba027b6713 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:26.258288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:26.259232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 409/817] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Jul 12 18:15:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:26.260006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b5574-fbfe-4926-a97e-cfba027b6713 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:26.336958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40868934-caee-41dd-b772-c70917780c78 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:26.367631 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b5574-fbfe-4926-a97e-cfba027b6713 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:26.370868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:26.374041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea5b55-9896-48a8-a629-02ee42c00b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:26.374854 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea5b55-9896-48a8-a629-02ee42c00b2d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:26.375138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea5b55-9896-48a8-a629-02ee42c00b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:26.375413 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea5b55-9896-48a8-a629-02ee42c00b2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:26.383671 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea5b55-9896-48a8-a629-02ee42c00b2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:26.386734 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea5b55-9896-48a8-a629-02ee42c00b2d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:26.405190 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef034ff5-a8bd-4224-9b35-1d52736a5111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:26.405833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-c8ea5b55-9896-48a8-a629-02ee42c00b2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:26.405833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:26.405833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:26.405833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:26.405833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:26.405833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:26.405833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:26.405833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:26.405833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:26.405833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:26.405833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:26.405833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:26.405833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:26.405833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:26.405833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:26.406692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:26.406692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:26.406692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:26.406692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:26.406692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:26.406692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:26.406692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:26.406692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:26.406692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:26.406692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:26.406692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:26.406692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:26.406692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:26.406692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:26.406692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:26.406692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:26.406692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:26.407572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:26.407572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:26.407572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:26.407572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:26.407572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:26.407572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:26.407572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:26.407572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:26.408001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034ff5-a8bd-4224-9b35-1d52736a5111 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:26.408001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034ff5-a8bd-4224-9b35-1d52736a5111 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:26.408001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034ff5-a8bd-4224-9b35-1d52736a5111 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:26.408001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef034ff5-a8bd-4224-9b35-1d52736a5111 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:26.408001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef034ff5-a8bd-4224-9b35-1d52736a5111 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:26.408979 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef034ff5-a8bd-4224-9b35-1d52736a5111 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:26.409386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 409/818] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:26.410380 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea5b55-9896-48a8-a629-02ee42c00b2d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:26.422400 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 410/819] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:26.423246 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef034ff5-a8bd-4224-9b35-1d52736a5111 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:26.509310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:26.521226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea5b55-9896-48a8-a629-02ee42c00b2d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:26.534535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef034ff5-a8bd-4224-9b35-1d52736a5111 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:26.558592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576246e-158d-4918-891a-863b8b43c771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:26.562108 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576246e-158d-4918-891a-863b8b43c771 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:26.562108 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576246e-158d-4918-891a-863b8b43c771 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:26.562108 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576246e-158d-4918-891a-863b8b43c771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:26.574620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576246e-158d-4918-891a-863b8b43c771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:26.576161 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576246e-158d-4918-891a-863b8b43c771 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:26.579153 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab58bc-54af-4c3e-9768-73c5af426a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:26.579875 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab58bc-54af-4c3e-9768-73c5af426a3f None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:26.580164 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab58bc-54af-4c3e-9768-73c5af426a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:26.580442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab58bc-54af-4c3e-9768-73c5af426a3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:26.581189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab58bc-54af-4c3e-9768-73c5af426a3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:26.583679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab58bc-54af-4c3e-9768-73c5af426a3f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:26.594638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-b576246e-158d-4918-891a-863b8b43c771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:26.594638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:26.594638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:26.594638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:26.594638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:26.594638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:26.594638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:26.594638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:26.594638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:26.594638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:26.594638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:26.594638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:26.594638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:26.594638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:26.594638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:26.595713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:26.595713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:26.595713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:26.595713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:26.595713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:26.595713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:26.595713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:26.595713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:26.595713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:26.595713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:26.595713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:26.595713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:26.595713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:26.595713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:26.595713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:26.595713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:26.595713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:26.596817 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:26.596817 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:26.596817 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:26.596817 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:26.597576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 410/820] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:26.598343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576246e-158d-4918-891a-863b8b43c771 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:26.609403 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 411/821] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Jul 12 18:15:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:15:26.610242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab58bc-54af-4c3e-9768-73c5af426a3f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:26.647990 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:26.726481 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576246e-158d-4918-891a-863b8b43c771 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:26.772266 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab58bc-54af-4c3e-9768-73c5af426a3f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:26.784764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a8aa1-ce06-453a-9b34-08a164912cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:26.785701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a8aa1-ce06-453a-9b34-08a164912cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:26.786751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a8aa1-ce06-453a-9b34-08a164912cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:26.787177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a8aa1-ce06-453a-9b34-08a164912cb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:26.787970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a8aa1-ce06-453a-9b34-08a164912cb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:26.788277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a8aa1-ce06-453a-9b34-08a164912cb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:26.789771 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a8aa1-ce06-453a-9b34-08a164912cb8 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:26.803360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 411/822] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:26.804757 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a8aa1-ce06-453a-9b34-08a164912cb8 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:26.809404 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:26.818979 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197013cd-df74-41b2-a68b-78daaccd19d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:26.819667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197013cd-df74-41b2-a68b-78daaccd19d8 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:26.819930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197013cd-df74-41b2-a68b-78daaccd19d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:26.820228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197013cd-df74-41b2-a68b-78daaccd19d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:26.821093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197013cd-df74-41b2-a68b-78daaccd19d8 None admin] RBAC: Adding query filter params (role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=a7c1bb51c2b642ffa4708122d826fc67) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:26.821460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197013cd-df74-41b2-a68b-78daaccd19d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:26.822920 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197013cd-df74-41b2-a68b-78daaccd19d8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:26.831347 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 412/823] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:15:26 2022] GET /identity/v3/role_assignments?user.id=a7c1bb51c2b642ffa4708122d826fc67&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:26.831615 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197013cd-df74-41b2-a68b-78daaccd19d8 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:26.928706 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:26.939882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a8aa1-ce06-453a-9b34-08a164912cb8 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:26.951769 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197013cd-df74-41b2-a68b-78daaccd19d8 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:26.988960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7474d-3b3f-4c9d-a78b-4e3457996094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:26.989883 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7474d-3b3f-4c9d-a78b-4e3457996094 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:26.990264 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7474d-3b3f-4c9d-a78b-4e3457996094 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:26.990553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7474d-3b3f-4c9d-a78b-4e3457996094 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:26.991437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7474d-3b3f-4c9d-a78b-4e3457996094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:26.991719 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7474d-3b3f-4c9d-a78b-4e3457996094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:26.992376 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9488b-9ae7-475b-8265-78bb7cd06e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:26.993177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7474d-3b3f-4c9d-a78b-4e3457996094 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:26.993667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9488b-9ae7-475b-8265-78bb7cd06e62 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:26.994101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9488b-9ae7-475b-8265-78bb7cd06e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:26.994620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9488b-9ae7-475b-8265-78bb7cd06e62 None admin] PATH_INFO: `/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/ade969d7aa3d49c08782a68ec5997382/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:26.997090 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9488b-9ae7-475b-8265-78bb7cd06e62 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fee99b2e9234f88ac79ff70429b6f20, user_id=ade969d7aa3d49c08782a68ec5997382, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:26.998777 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9488b-9ae7-475b-8265-78bb7cd06e62 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:27.008700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 412/824] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:27.014207 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7474d-3b3f-4c9d-a78b-4e3457996094 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:27.016408 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 413/825] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:15:26 2022] PUT /identity/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/ade969d7aa3d49c08782a68ec5997382/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:15:27.094840 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:27.140901 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7474d-3b3f-4c9d-a78b-4e3457996094 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:27.178893 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7ec0e-482f-4ef2-997d-342a409b0fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:27.179821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7ec0e-482f-4ef2-997d-342a409b0fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:27.180103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7ec0e-482f-4ef2-997d-342a409b0fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:27.180382 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7ec0e-482f-4ef2-997d-342a409b0fc4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:27.187984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7ec0e-482f-4ef2-997d-342a409b0fc4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:27.189461 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7ec0e-482f-4ef2-997d-342a409b0fc4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:27.205647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-71d7ec0e-482f-4ef2-997d-342a409b0fc4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:15:27.205647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:27.205647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:27.205647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:27.205647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:27.205647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:27.205647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:27.205647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:27.205647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:27.205647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:27.205647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:27.205647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:27.205647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:27.205647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:27.205647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:27.205647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:27.206599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:27.206599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:27.206599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:27.206599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:27.206599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:27.206599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:27.206599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:27.206599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:27.206599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:27.206599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:27.206599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:27.206599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:27.206599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:27.206599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:27.206599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:27.206599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:27.206599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:27.206599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:27.207537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:27.207537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:27.207537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:27.207537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:27.207537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:27.207537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:27.207537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:27.207537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:27.207537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:15:27.207537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:27.207537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 413/826] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Jul 12 18:15:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:27.215414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9488b-9ae7-475b-8265-78bb7cd06e62 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:27.321114 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9488b-9ae7-475b-8265-78bb7cd06e62 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:27.363563 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cced0cb-af0b-421d-b78e-45c5d8561869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:27.364263 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cced0cb-af0b-421d-b78e-45c5d8561869 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:27.364546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cced0cb-af0b-421d-b78e-45c5d8561869 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:27.364818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cced0cb-af0b-421d-b78e-45c5d8561869 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:27.365682 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cced0cb-af0b-421d-b78e-45c5d8561869 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:27.365990 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cced0cb-af0b-421d-b78e-45c5d8561869 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:27.367434 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cced0cb-af0b-421d-b78e-45c5d8561869 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:27.377168 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:27.387541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 414/827] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Jul 12 18:15:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:27.393648 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7ec0e-482f-4ef2-997d-342a409b0fc4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:27.503220 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7ec0e-482f-4ef2-997d-342a409b0fc4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:27.527912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:27.540232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0e2db-f577-4521-ab4a-ce0551ef794b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:27.541032 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0e2db-f577-4521-ab4a-ce0551ef794b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:27.541339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0e2db-f577-4521-ab4a-ce0551ef794b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:27.541616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0e2db-f577-4521-ab4a-ce0551ef794b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:27.553406 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0e2db-f577-4521-ab4a-ce0551ef794b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:27.554862 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0e2db-f577-4521-ab4a-ce0551ef794b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:27.577345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-19d0e2db-f577-4521-ab4a-ce0551ef794b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:27.577345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:27.577345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:27.577345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:27.577345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:27.577345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:27.577345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:27.577345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:27.577345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:27.577345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:27.577345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:27.577345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:27.577345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:27.577345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:27.577345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:27.578233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:27.578233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:27.578233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:27.578233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:27.578233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:27.578233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:27.578233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:27.578233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:27.578233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:27.578233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:27.578233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:27.578233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:27.578233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:27.578233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:27.578233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:27.578233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:27.578233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:27.579120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:27.579120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:27.579120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:27.579120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:27.579120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 414/828] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:27.582369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cced0cb-af0b-421d-b78e-45c5d8561869 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:27.692130 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cced0cb-af0b-421d-b78e-45c5d8561869 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:27.727295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d52ca8-df5c-421e-a7d9-44c5acd4453b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:27.727960 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d52ca8-df5c-421e-a7d9-44c5acd4453b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:27.728239 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d52ca8-df5c-421e-a7d9-44c5acd4453b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:27.728511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d52ca8-df5c-421e-a7d9-44c5acd4453b None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:27.729233 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d52ca8-df5c-421e-a7d9-44c5acd4453b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:27.729567 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d52ca8-df5c-421e-a7d9-44c5acd4453b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:27.730940 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d52ca8-df5c-421e-a7d9-44c5acd4453b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:27.743721 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 415/829] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:27.749311 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0e2db-f577-4521-ab4a-ce0551ef794b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:27.856859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0e2db-f577-4521-ab4a-ce0551ef794b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:27.891170 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d39447-3ce2-4aeb-a6d1-0b6ca42c49ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:27.892170 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d39447-3ce2-4aeb-a6d1-0b6ca42c49ec None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:27.892597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d39447-3ce2-4aeb-a6d1-0b6ca42c49ec None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:27.893016 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d39447-3ce2-4aeb-a6d1-0b6ca42c49ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:27.900164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d39447-3ce2-4aeb-a6d1-0b6ca42c49ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:27.901788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d39447-3ce2-4aeb-a6d1-0b6ca42c49ec None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:27.916530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-37d39447-3ce2-4aeb-a6d1-0b6ca42c49ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:27.916530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:27.916530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:27.916530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:27.916530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:27.916530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:27.916530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:27.916530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:27.916530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:27.916530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:27.916530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:27.916530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:27.916530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:27.916530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:27.916530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:27.917610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:27.917610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:27.917610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:27.917610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:27.917610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:27.917610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:27.917610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:27.917610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:27.917610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:27.917610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:27.917610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:27.917610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:27.917610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:27.917610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:27.917610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:27.917610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:27.917610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:27.918721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:27.918721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:27.918721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:27.918721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:27.918721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:27.918721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:27.918721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:27.918721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:27.920764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 415/830] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:27.926250 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d52ca8-df5c-421e-a7d9-44c5acd4453b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:27.985911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ab3ce-3736-409e-9322-90096f9aaea5 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:27.986561 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ab3ce-3736-409e-9322-90096f9aaea5 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:27.986850 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ab3ce-3736-409e-9322-90096f9aaea5 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:27.988491 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:27.988918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 416/831] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:15:27.994697 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81b7f7-a2cb-4eee-a6df-6a5c6dbaa483 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:27.995284 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81b7f7-a2cb-4eee-a6df-6a5c6dbaa483 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:27.995553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81b7f7-a2cb-4eee-a6df-6a5c6dbaa483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:28.017152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ce81b7f7-a2cb-4eee-a6df-6a5c6dbaa483 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:28.018928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ce81b7f7-a2cb-4eee-a6df-6a5c6dbaa483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:28.037713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d52ca8-df5c-421e-a7d9-44c5acd4453b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:28.053525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:28.077445 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cd153-a906-405b-ae52-3ddd169170a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:28.078117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cd153-a906-405b-ae52-3ddd169170a2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:28.078402 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cd153-a906-405b-ae52-3ddd169170a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:28.078674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cd153-a906-405b-ae52-3ddd169170a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:28.079461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cd153-a906-405b-ae52-3ddd169170a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:28.079770 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cd153-a906-405b-ae52-3ddd169170a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:28.081212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cd153-a906-405b-ae52-3ddd169170a2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:28.093989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 416/832] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:28.101389 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cd153-a906-405b-ae52-3ddd169170a2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:28.105619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 417/833] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:15:28.131737 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81b7f7-a2cb-4eee-a6df-6a5c6dbaa483 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:28.235399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cd153-a906-405b-ae52-3ddd169170a2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:28.253897 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:28.260107 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81b7f7-a2cb-4eee-a6df-6a5c6dbaa483 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:28.271724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be57c4c-fff5-4fcf-bc30-db169cef0504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:28.272608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be57c4c-fff5-4fcf-bc30-db169cef0504 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:28.272890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be57c4c-fff5-4fcf-bc30-db169cef0504 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:28.273170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be57c4c-fff5-4fcf-bc30-db169cef0504 None admin] PATH_INFO: `/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/54189575a60a4d9dbaabb78d44e9c31e/roles/82fa784b33dd4fe19c62367f39ac45b2` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:28.288546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be57c4c-fff5-4fcf-bc30-db169cef0504 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fee99b2e9234f88ac79ff70429b6f20, user_id=54189575a60a4d9dbaabb78d44e9c31e, role_id=82fa784b33dd4fe19c62367f39ac45b2)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:28.290036 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be57c4c-fff5-4fcf-bc30-db169cef0504 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:28.305539 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7f2ca-2ba0-48ee-9684-2e5d96de6870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:28.306340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7f2ca-2ba0-48ee-9684-2e5d96de6870 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:28.306621 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7f2ca-2ba0-48ee-9684-2e5d96de6870 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:28.306896 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7f2ca-2ba0-48ee-9684-2e5d96de6870 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:28.307557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7f2ca-2ba0-48ee-9684-2e5d96de6870 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:28.308950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7f2ca-2ba0-48ee-9684-2e5d96de6870 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:28.317370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 417/834] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:15:28 2022] PUT /identity/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/54189575a60a4d9dbaabb78d44e9c31e/roles/82fa784b33dd4fe19c62367f39ac45b2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:15:28.330826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-36b7f2ca-2ba0-48ee-9684-2e5d96de6870 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:15:28.330826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:28.330826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:28.330826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:28.330826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:28.330826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:28.330826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:28.330826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:28.330826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:15:28.330826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:28.330826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:28.330826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:28.330826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:28.330826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:28.330826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:28.330826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:28.330826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:28.331935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:28.331935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:28.331935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:28.331935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:28.331935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:28.331935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:28.331935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:28.331935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:28.331935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:28.331935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:28.331935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:28.331935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:28.331935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:28.331935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:28.331935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:28.331935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:28.332752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:28.332752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:28.332752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:28.332752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:28.332752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:28.332752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:28.332752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:28.332752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:28.332752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:28.332752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:28.332752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:28.332752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:28.332752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:15:28.332752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:28.332752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 418/835] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:15:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:28.340304 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be57c4c-fff5-4fcf-bc30-db169cef0504 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:28.451864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be57c4c-fff5-4fcf-bc30-db169cef0504 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:28.492174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fca88-a646-4996-b61f-6c1eb2c6556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:28.493283 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fca88-a646-4996-b61f-6c1eb2c6556f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:28.493799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fca88-a646-4996-b61f-6c1eb2c6556f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:28.494278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fca88-a646-4996-b61f-6c1eb2c6556f None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:28.495211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fca88-a646-4996-b61f-6c1eb2c6556f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:28.495782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fca88-a646-4996-b61f-6c1eb2c6556f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:28.497448 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fca88-a646-4996-b61f-6c1eb2c6556f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:28.504558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 418/836] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:15:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:28.510527 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7f2ca-2ba0-48ee-9684-2e5d96de6870 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:28.542783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:28.622078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7f2ca-2ba0-48ee-9684-2e5d96de6870 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:28.658441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84131dc-070a-487f-97e0-8fc65d124a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:28.659114 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84131dc-070a-487f-97e0-8fc65d124a22 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:28.659403 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84131dc-070a-487f-97e0-8fc65d124a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:28.659693 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84131dc-070a-487f-97e0-8fc65d124a22 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:28.660398 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84131dc-070a-487f-97e0-8fc65d124a22 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:28.660710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84131dc-070a-487f-97e0-8fc65d124a22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:28.662157 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84131dc-070a-487f-97e0-8fc65d124a22 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:28.667284 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 419/837] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:15:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:29.134013 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a969f8-91b1-4b7b-9672-3b1745d6b9e2 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:29.134518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a969f8-91b1-4b7b-9672-3b1745d6b9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:29.134596 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a969f8-91b1-4b7b-9672-3b1745d6b9e2 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:29.136162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 419/838] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:29.141536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7445417-fa28-42dc-9e32-36e538689f4d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:29.141953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7445417-fa28-42dc-9e32-36e538689f4d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:29.142124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7445417-fa28-42dc-9e32-36e538689f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:29.160575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd417a-c85e-4d71-8dc3-b200c8a1c663 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:29.160891 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd417a-c85e-4d71-8dc3-b200c8a1c663 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:29.161161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd417a-c85e-4d71-8dc3-b200c8a1c663 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:29.162074 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d7445417-fa28-42dc-9e32-36e538689f4d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:29.162864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 420/839] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:15:29.163298 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d7445417-fa28-42dc-9e32-36e538689f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:29.170448 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a2e48-9642-41db-a3d9-879f733f8dae None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:29.170731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a2e48-9642-41db-a3d9-879f733f8dae None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:29.171006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a2e48-9642-41db-a3d9-879f733f8dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:29.192011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6d0a2e48-9642-41db-a3d9-879f733f8dae None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:29.194065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6d0a2e48-9642-41db-a3d9-879f733f8dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:29.224879 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:29.237407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 420/840] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:29.259241 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7445417-fa28-42dc-9e32-36e538689f4d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:29.275734 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 421/841] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:15:29.285497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:29.298381 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a2e48-9642-41db-a3d9-879f733f8dae None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:29.373536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7445417-fa28-42dc-9e32-36e538689f4d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:29.410008 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d56f5f-3aaa-400f-b980-4855c3fadf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:29.410733 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d56f5f-3aaa-400f-b980-4855c3fadf30 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:29.411044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d56f5f-3aaa-400f-b980-4855c3fadf30 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:29.411151 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a2e48-9642-41db-a3d9-879f733f8dae None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:29.411337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d56f5f-3aaa-400f-b980-4855c3fadf30 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:29.411957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d56f5f-3aaa-400f-b980-4855c3fadf30 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:29.414300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d56f5f-3aaa-400f-b980-4855c3fadf30 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:29.429246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-c5d56f5f-3aaa-400f-b980-4855c3fadf30 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:15:29.429246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:29.429246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:29.429246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:29.429246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:29.429246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:29.429246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:29.429246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:29.429246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:15:29.429246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:29.429246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:29.429246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:29.429246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:29.429246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:29.429246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:29.429246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:29.430239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:29.430239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:29.430239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:29.430239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:29.430239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:29.430239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:29.430239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:29.430239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:29.430239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:29.430239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:29.430239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:29.430239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:29.430239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:29.430239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:29.430239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:29.430239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:29.431084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:29.431084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:29.431084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:29.431084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:29.431084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:29.431084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:29.431084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:29.431084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:29.431084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:29.431084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:29.431084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:29.431084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:29.431084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:29.431084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:15:29.431084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:29.431084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 421/842] 10.222.0.57 () {56 vars in 1132 bytes} [Tue Jul 12 18:15:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:29.437900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d56f5f-3aaa-400f-b980-4855c3fadf30 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:29.447274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b79494-804e-476e-bbdf-bae27591b648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:29.448124 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b79494-804e-476e-bbdf-bae27591b648 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:29.448674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b79494-804e-476e-bbdf-bae27591b648 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:29.448951 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b79494-804e-476e-bbdf-bae27591b648 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:29.460964 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b79494-804e-476e-bbdf-bae27591b648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:29.469174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-d4b79494-804e-476e-bbdf-bae27591b648 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:15:29.469174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:29.469174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:29.469174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:29.469174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:29.469174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:29.469174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:29.469174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:29.469174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:29.469174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:29.469174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:29.469174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:29.469174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:29.469174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:29.469174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:29.469174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:29.471134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:29.471134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:29.471134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:29.471134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:29.471134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:29.471134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:29.471134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:29.471134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:29.471134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:29.471134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:29.471134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:29.471134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:29.471134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:29.471134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:29.471134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:29.471134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:29.472177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:29.472177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:29.472177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:29.472177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:29.472177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:29.472177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:29.472177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:29.472177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:29.472177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:29.472177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:29.472177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:15:29.472177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:29.472177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 422/843] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:15:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:29.481205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b79494-804e-476e-bbdf-bae27591b648 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:29.511755 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:29.557642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:29.568316 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d56f5f-3aaa-400f-b980-4855c3fadf30 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:29.608723 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b79494-804e-476e-bbdf-bae27591b648 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:29.613674 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829407b-4268-48f8-912b-db30603fd5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:29.614371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829407b-4268-48f8-912b-db30603fd5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:29.614656 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829407b-4268-48f8-912b-db30603fd5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:29.614933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829407b-4268-48f8-912b-db30603fd5c7 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:29.615649 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829407b-4268-48f8-912b-db30603fd5c7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:29.615957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829407b-4268-48f8-912b-db30603fd5c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:29.617350 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829407b-4268-48f8-912b-db30603fd5c7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:29.628283 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 422/844] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Jul 12 18:15:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:29.630582 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829407b-4268-48f8-912b-db30603fd5c7 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:29.654265 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5c2a2-48f2-4e53-8897-39543f15ef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:29.654961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5c2a2-48f2-4e53-8897-39543f15ef63 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:29.655251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5c2a2-48f2-4e53-8897-39543f15ef63 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:29.655530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5c2a2-48f2-4e53-8897-39543f15ef63 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:29.656718 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5c2a2-48f2-4e53-8897-39543f15ef63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:29.657033 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5c2a2-48f2-4e53-8897-39543f15ef63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:29.658751 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5c2a2-48f2-4e53-8897-39543f15ef63 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:29.673795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 423/845] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:15:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:29.675704 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5c2a2-48f2-4e53-8897-39543f15ef63 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:29.757617 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829407b-4268-48f8-912b-db30603fd5c7 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:29.766744 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:29.784709 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5c2a2-48f2-4e53-8897-39543f15ef63 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:29.799542 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1def05-43b7-4d5c-89c0-1c2fb2156818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:29.800208 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1def05-43b7-4d5c-89c0-1c2fb2156818 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:29.800495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1def05-43b7-4d5c-89c0-1c2fb2156818 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:29.800911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1def05-43b7-4d5c-89c0-1c2fb2156818 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:29.802209 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1def05-43b7-4d5c-89c0-1c2fb2156818 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:29.802549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1def05-43b7-4d5c-89c0-1c2fb2156818 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:29.804574 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1def05-43b7-4d5c-89c0-1c2fb2156818 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:29.817301 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 423/846] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Jul 12 18:15:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:29.836411 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a512f27-e113-419b-b7c6-02bb85c2d125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:29.837743 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a512f27-e113-419b-b7c6-02bb85c2d125 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:29.838222 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a512f27-e113-419b-b7c6-02bb85c2d125 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:29.838684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a512f27-e113-419b-b7c6-02bb85c2d125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:29.851978 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a512f27-e113-419b-b7c6-02bb85c2d125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:29.853856 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a512f27-e113-419b-b7c6-02bb85c2d125 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:29.873969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-0a512f27-e113-419b-b7c6-02bb85c2d125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:29.873969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:29.873969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:29.873969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:29.873969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:29.873969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:29.873969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:29.873969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:29.873969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:29.873969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:29.873969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:29.873969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:29.873969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:29.873969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:29.873969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:29.874908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:29.874908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:29.874908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:29.874908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:29.874908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:29.874908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:29.874908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:29.874908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:29.874908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:29.874908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:29.874908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:29.874908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:29.874908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:29.874908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:29.874908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:29.874908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:29.874908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:29.875779 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:29.875779 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:29.875779 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:29.875779 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:29.877908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 424/847] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:29.883849 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1def05-43b7-4d5c-89c0-1c2fb2156818 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:29.901690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:29.999567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1def05-43b7-4d5c-89c0-1c2fb2156818 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:30.036435 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce64b-1eb5-428e-a5e6-ff0c36de65d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:30.037162 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce64b-1eb5-428e-a5e6-ff0c36de65d4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:30.037418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce64b-1eb5-428e-a5e6-ff0c36de65d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:30.037698 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce64b-1eb5-428e-a5e6-ff0c36de65d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:30.038425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ce64b-1eb5-428e-a5e6-ff0c36de65d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:30.038733 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ce64b-1eb5-428e-a5e6-ff0c36de65d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:30.040261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ce64b-1eb5-428e-a5e6-ff0c36de65d4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:30.053827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 424/848] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:30.059027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a512f27-e113-419b-b7c6-02bb85c2d125 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:30.167326 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a512f27-e113-419b-b7c6-02bb85c2d125 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:30.203005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d81ba-c725-4639-86e4-00e2e9a8eb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:30.204138 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d81ba-c725-4639-86e4-00e2e9a8eb73 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:30.204664 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d81ba-c725-4639-86e4-00e2e9a8eb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:30.205140 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d81ba-c725-4639-86e4-00e2e9a8eb73 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:30.208472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:30.213790 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d81ba-c725-4639-86e4-00e2e9a8eb73 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:30.215492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d81ba-c725-4639-86e4-00e2e9a8eb73 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:30.231032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-935d81ba-c725-4639-86e4-00e2e9a8eb73 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:15:30.231032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:30.231032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:30.231032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:30.231032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:30.231032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:30.231032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:30.231032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:30.231032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:30.231032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:30.231032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:30.231032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:30.231032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:30.231032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:30.231032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:30.231032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:30.231991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:30.231991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:30.231991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:30.231991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:30.231991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:30.231991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:30.231991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:30.231991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:30.231991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:30.231991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:30.231991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:30.231991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:30.231991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:30.231991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:30.231991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:30.231991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:30.231991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:30.231991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:30.232945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:30.232945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:30.232945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:30.232945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:30.232945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:30.232945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:30.232945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:30.232945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:30.232945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:15:30.232945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:30.235616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 425/849] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:15:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:30.241550 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce64b-1eb5-428e-a5e6-ff0c36de65d4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:30.326979 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:30.367525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce64b-1eb5-428e-a5e6-ff0c36de65d4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:30.404663 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e941c90-174e-4ac0-8924-dffc44076a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:30.405751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e941c90-174e-4ac0-8924-dffc44076a52 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:30.406253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e941c90-174e-4ac0-8924-dffc44076a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:30.406724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e941c90-174e-4ac0-8924-dffc44076a52 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:30.407753 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e941c90-174e-4ac0-8924-dffc44076a52 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:30.408294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e941c90-174e-4ac0-8924-dffc44076a52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:30.410028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e941c90-174e-4ac0-8924-dffc44076a52 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:30.429431 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 425/850] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Jul 12 18:15:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:30.438374 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d81ba-c725-4639-86e4-00e2e9a8eb73 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:30.477404 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7841ca-bb20-41ba-ba39-121a6240f807 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:30.477778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7841ca-bb20-41ba-ba39-121a6240f807 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:30.477952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7841ca-bb20-41ba-ba39-121a6240f807 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:30.480461 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 426/851] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:15:30.484405 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc41c1d-8c84-430a-b2fd-216e97be1209 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:30.484689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc41c1d-8c84-430a-b2fd-216e97be1209 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:30.484962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc41c1d-8c84-430a-b2fd-216e97be1209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:30.503116 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-7fc41c1d-8c84-430a-b2fd-216e97be1209 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:30.504403 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7fc41c1d-8c84-430a-b2fd-216e97be1209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:30.545343 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d81ba-c725-4639-86e4-00e2e9a8eb73 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:30.593353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 427/852] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:15:30.593527 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a27ae9-ae63-43d9-9152-0b184059734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:30.593527 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a27ae9-ae63-43d9-9152-0b184059734e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:30.593527 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a27ae9-ae63-43d9-9152-0b184059734e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:30.593527 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a27ae9-ae63-43d9-9152-0b184059734e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:30.606919 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc41c1d-8c84-430a-b2fd-216e97be1209 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:30.675225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:30.685164 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a27ae9-ae63-43d9-9152-0b184059734e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:30.686643 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a27ae9-ae63-43d9-9152-0b184059734e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:30.694189 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:30.740661 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc41c1d-8c84-430a-b2fd-216e97be1209 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:30.775712 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d7551-84a2-4d1a-9b3e-e5819ec07c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:30.776539 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d7551-84a2-4d1a-9b3e-e5819ec07c99 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:30.776827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d7551-84a2-4d1a-9b3e-e5819ec07c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:30.777103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d7551-84a2-4d1a-9b3e-e5819ec07c99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:30.788849 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d7551-84a2-4d1a-9b3e-e5819ec07c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:30.796826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-b02d7551-84a2-4d1a-9b3e-e5819ec07c99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:30.796826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:30.796826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:30.796826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:30.796826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:30.796826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:30.796826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:30.796826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:30.796826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:30.796826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:30.796826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:30.796826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:30.796826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:30.796826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:30.796826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:30.796826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:30.797754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:30.797754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:30.797754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:30.797754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:30.797754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:30.797754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:30.797754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:30.797754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:30.797754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:30.797754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:30.797754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:30.797754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:30.797754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:30.797754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:30.797754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:30.797754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:30.798581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:30.798581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:30.798581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:30.798581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:30.798581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:30.798581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:30.798581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:30.798581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:30.798581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:30.798581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:30.798581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:15:30.798581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:30.803168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 428/853] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:15:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:30.804072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d7551-84a2-4d1a-9b3e-e5819ec07c99 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:30.824636 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 426/854] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:15:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:15:30.825589 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a27ae9-ae63-43d9-9152-0b184059734e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:30.918069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d7551-84a2-4d1a-9b3e-e5819ec07c99 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:30.940092 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:30.941606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:30.948494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a27ae9-ae63-43d9-9152-0b184059734e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:30.954667 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d12905-8bc8-41b3-a8d9-10a275cc739e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:30.955460 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d12905-8bc8-41b3-a8d9-10a275cc739e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:30.955747 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d12905-8bc8-41b3-a8d9-10a275cc739e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:30.956024 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d12905-8bc8-41b3-a8d9-10a275cc739e None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:30.956763 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d12905-8bc8-41b3-a8d9-10a275cc739e None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:30.957073 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d12905-8bc8-41b3-a8d9-10a275cc739e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:30.959038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d12905-8bc8-41b3-a8d9-10a275cc739e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:30.972120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 429/855] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:15:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:30.972120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd97efc-6ae9-4339-b3e0-399df267f81a None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:30.972120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd97efc-6ae9-4339-b3e0-399df267f81a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:30.972120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd97efc-6ae9-4339-b3e0-399df267f81a None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:30.972120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 430/856] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:30.973687 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd97efc-6ae9-4339-b3e0-399df267f81a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:30.985217 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451fb8d-5c72-4476-af58-7ef85d46ae28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:30.986042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451fb8d-5c72-4476-af58-7ef85d46ae28 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:30.986326 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451fb8d-5c72-4476-af58-7ef85d46ae28 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:30.986602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451fb8d-5c72-4476-af58-7ef85d46ae28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:30.997117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451fb8d-5c72-4476-af58-7ef85d46ae28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:30.998699 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451fb8d-5c72-4476-af58-7ef85d46ae28 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:31.017167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-8451fb8d-5c72-4476-af58-7ef85d46ae28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:31.017167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:31.017167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:31.017167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:31.017167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:31.017167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:31.017167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:31.017167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:31.017167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:31.017167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:31.017167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:31.017167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:31.017167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:31.017167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:31.017167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:31.018214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:31.018214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:31.018214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:31.018214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:31.018214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:31.018214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:31.018214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:31.018214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:31.018214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:31.018214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:31.018214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:31.018214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:31.018214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:31.018214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:31.018214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:31.018214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:31.018214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:31.019135 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:31.019135 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:31.019135 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:31.019135 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:31.021684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 427/857] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:31.023995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b1c73-a949-4863-92a1-a8727642945e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:31.024538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b1c73-a949-4863-92a1-a8727642945e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:31.025166 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b1c73-a949-4863-92a1-a8727642945e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:31.041608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6c8b1c73-a949-4863-92a1-a8727642945e None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:31.042831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6c8b1c73-a949-4863-92a1-a8727642945e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:31.086602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd97efc-6ae9-4339-b3e0-399df267f81a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:31.121312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 428/858] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:31.121312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b1c73-a949-4863-92a1-a8727642945e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:31.131415 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc00f7-9d79-436c-802e-da75ae26ee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:31.132373 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc00f7-9d79-436c-802e-da75ae26ee7b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:31.132804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc00f7-9d79-436c-802e-da75ae26ee7b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:31.133574 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc00f7-9d79-436c-802e-da75ae26ee7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:31.146668 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc00f7-9d79-436c-802e-da75ae26ee7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:31.148205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc00f7-9d79-436c-802e-da75ae26ee7b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:31.165875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-27fc00f7-9d79-436c-802e-da75ae26ee7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:31.165875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:31.165875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:31.165875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:31.165875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:31.165875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:31.165875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:31.165875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:31.165875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:31.165875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:31.165875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:31.165875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:31.165875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:31.165875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:31.165875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:31.166984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:31.166984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:31.166984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:31.166984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:31.166984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:31.166984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:31.166984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:31.166984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:31.166984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:31.166984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:31.166984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:31.166984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:31.166984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:31.166984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:31.166984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:31.166984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:31.166984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:31.168123 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:31.168123 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:31.168123 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:31.168123 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:31.171505 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 431/859] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:31.172359 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc00f7-9d79-436c-802e-da75ae26ee7b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:31.211309 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:31.211800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:31.235469 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b1c73-a949-4863-92a1-a8727642945e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:31.272316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425e6e0-a7f0-42e5-a193-5097bca76046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:31.273206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425e6e0-a7f0-42e5-a193-5097bca76046 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:31.273687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425e6e0-a7f0-42e5-a193-5097bca76046 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:31.274162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425e6e0-a7f0-42e5-a193-5097bca76046 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:31.275143 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425e6e0-a7f0-42e5-a193-5097bca76046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:31.275635 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425e6e0-a7f0-42e5-a193-5097bca76046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:31.277391 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425e6e0-a7f0-42e5-a193-5097bca76046 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:31.280165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc00f7-9d79-436c-802e-da75ae26ee7b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:31.293139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 429/860] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:31.293139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425e6e0-a7f0-42e5-a193-5097bca76046 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:31.320105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d3f07-6df8-4be5-9314-e25ccabda689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:31.320769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d3f07-6df8-4be5-9314-e25ccabda689 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:31.321057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d3f07-6df8-4be5-9314-e25ccabda689 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:31.321360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d3f07-6df8-4be5-9314-e25ccabda689 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:31.322142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d3f07-6df8-4be5-9314-e25ccabda689 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:31.323763 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d3f07-6df8-4be5-9314-e25ccabda689 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:31.336616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 432/861] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Jul 12 18:15:31 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:15:31.337734 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d3f07-6df8-4be5-9314-e25ccabda689 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:31.432483 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425e6e0-a7f0-42e5-a193-5097bca76046 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:31.475389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:31.483672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ace10-216b-48b4-af1d-e561ea822577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:31.484016 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d3f07-6df8-4be5-9314-e25ccabda689 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:31.484732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ace10-216b-48b4-af1d-e561ea822577 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:31.485074 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ace10-216b-48b4-af1d-e561ea822577 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:31.485444 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ace10-216b-48b4-af1d-e561ea822577 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:31.486242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ace10-216b-48b4-af1d-e561ea822577 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:31.487344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ace10-216b-48b4-af1d-e561ea822577 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:31.489686 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ace10-216b-48b4-af1d-e561ea822577 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:31.490892 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:31.504052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 430/862] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:31.510287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ace10-216b-48b4-af1d-e561ea822577 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:31.534017 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b995398-70c6-4a6a-a4a7-196f7c040410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:31.534808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b995398-70c6-4a6a-a4a7-196f7c040410 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:31.535089 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b995398-70c6-4a6a-a4a7-196f7c040410 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:31.535358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b995398-70c6-4a6a-a4a7-196f7c040410 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:31.547857 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b995398-70c6-4a6a-a4a7-196f7c040410 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:31.549447 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b995398-70c6-4a6a-a4a7-196f7c040410 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:31.564235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-4b995398-70c6-4a6a-a4a7-196f7c040410 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:31.564235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:31.564235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:31.564235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:31.564235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:31.564235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:31.564235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:31.564235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:31.564235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:31.564235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:31.564235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:31.564235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:31.564235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:31.564235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:31.564235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:31.565079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:31.565079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:31.565079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:31.565079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:31.565079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:31.565079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:31.565079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:31.565079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:31.565079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:31.565079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:31.565079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:31.565079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:31.565079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:31.565079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:31.565079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:31.565079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:31.565079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:31.566993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:31.566993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:31.566993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:31.566993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:31.566993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:31.566993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:31.566993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:31.566993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:31.566993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 433/863] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:31.573573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b995398-70c6-4a6a-a4a7-196f7c040410 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:31.638503 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ace10-216b-48b4-af1d-e561ea822577 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:31.675645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f715f3-8d3b-4d4b-892e-f3910725ab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:31.676518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f715f3-8d3b-4d4b-892e-f3910725ab06 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:31.676808 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f715f3-8d3b-4d4b-892e-f3910725ab06 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:31.677087 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f715f3-8d3b-4d4b-892e-f3910725ab06 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:31.677882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b995398-70c6-4a6a-a4a7-196f7c040410 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:31.685116 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f715f3-8d3b-4d4b-892e-f3910725ab06 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:31.686554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f715f3-8d3b-4d4b-892e-f3910725ab06 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:31.704692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-10f715f3-8d3b-4d4b-892e-f3910725ab06 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:15:31.704692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:31.704692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:31.704692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:31.704692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:31.704692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:31.704692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:31.704692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:31.704692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:31.704692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:31.704692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:31.704692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:31.704692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:31.704692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:31.704692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:31.704692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:31.705707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:31.705707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:31.705707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:31.705707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:31.705707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:31.705707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:31.705707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:31.705707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:31.705707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:31.705707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:31.705707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:31.705707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:31.705707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:31.705707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:31.705707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:31.705707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:31.705707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:31.705707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:31.706883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:31.706883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:31.706883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:31.706883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:31.706883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:31.706883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:31.706883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:31.706883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:31.706883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:15:31.706883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:31.706883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 431/864] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Jul 12 18:15:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:31.713428 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4839c-b0f2-4488-ab72-40447195e09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:31.714231 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4839c-b0f2-4488-ab72-40447195e09b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:31.714483 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f715f3-8d3b-4d4b-892e-f3910725ab06 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:31.714700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4839c-b0f2-4488-ab72-40447195e09b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:31.715069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4839c-b0f2-4488-ab72-40447195e09b None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:31.715984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4839c-b0f2-4488-ab72-40447195e09b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:31.716390 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4839c-b0f2-4488-ab72-40447195e09b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:31.717988 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4839c-b0f2-4488-ab72-40447195e09b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:31.736581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 434/865] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:31.737702 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4839c-b0f2-4488-ab72-40447195e09b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:31.757737 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:31.796076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:31.849195 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4839c-b0f2-4488-ab72-40447195e09b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:31.863027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f715f3-8d3b-4d4b-892e-f3910725ab06 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:31.891479 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60efae-0ec5-4644-85fa-efe96baf7f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:31.892508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60efae-0ec5-4644-85fa-efe96baf7f92 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:31.892999 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60efae-0ec5-4644-85fa-efe96baf7f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:31.893589 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60efae-0ec5-4644-85fa-efe96baf7f92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:31.894640 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60efae-0ec5-4644-85fa-efe96baf7f92 None admin] RBAC: Adding query filter params (role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=ade969d7aa3d49c08782a68ec5997382) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:31.895165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60efae-0ec5-4644-85fa-efe96baf7f92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:31.896878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60efae-0ec5-4644-85fa-efe96baf7f92 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:31.903673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 435/866] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:15:31 2022] GET /identity/v3/role_assignments?user.id=ade969d7aa3d49c08782a68ec5997382&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:31.907889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43b01b-9c84-41c6-83f8-98b7561798b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:31.908901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43b01b-9c84-41c6-83f8-98b7561798b2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:31.909441 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43b01b-9c84-41c6-83f8-98b7561798b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:31.909942 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43b01b-9c84-41c6-83f8-98b7561798b2 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:31.911556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43b01b-9c84-41c6-83f8-98b7561798b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:31.912085 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43b01b-9c84-41c6-83f8-98b7561798b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:31.913879 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43b01b-9c84-41c6-83f8-98b7561798b2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:31.935893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 432/867] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Jul 12 18:15:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:31.942613 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60efae-0ec5-4644-85fa-efe96baf7f92 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:31.983610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb8638-c8da-4947-85d9-f19ef19d14df None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:31.983964 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb8638-c8da-4947-85d9-f19ef19d14df None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:31.984211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb8638-c8da-4947-85d9-f19ef19d14df None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:31.989916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 433/868] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:31.994428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e129d-471b-4eea-ab51-9f92fcb5f2e8 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:31.994710 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e129d-471b-4eea-ab51-9f92fcb5f2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:31.994991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e129d-471b-4eea-ab51-9f92fcb5f2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:32.019672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-999e129d-471b-4eea-ab51-9f92fcb5f2e8 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:32.022114 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-999e129d-471b-4eea-ab51-9f92fcb5f2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:32.047584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:32.076525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60efae-0ec5-4644-85fa-efe96baf7f92 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:32.105162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 434/869] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:31 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:32.119615 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ec8cf-16bb-418e-ab75-51b7045804ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:32.120281 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ec8cf-16bb-418e-ab75-51b7045804ee None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:32.120564 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ec8cf-16bb-418e-ab75-51b7045804ee None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:32.120842 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ec8cf-16bb-418e-ab75-51b7045804ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:32.132430 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e129d-471b-4eea-ab51-9f92fcb5f2e8 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:32.197772 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:32.203966 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ec8cf-16bb-418e-ab75-51b7045804ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:32.205465 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ec8cf-16bb-418e-ab75-51b7045804ee None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:32.259960 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e129d-471b-4eea-ab51-9f92fcb5f2e8 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:32.288564 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:32.301405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00b7cd-711d-4ecd-a541-bbe2b790c839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:32.302598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00b7cd-711d-4ecd-a541-bbe2b790c839 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:32.303173 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00b7cd-711d-4ecd-a541-bbe2b790c839 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:32.303743 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00b7cd-711d-4ecd-a541-bbe2b790c839 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:32.304660 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00b7cd-711d-4ecd-a541-bbe2b790c839 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:32.306386 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00b7cd-711d-4ecd-a541-bbe2b790c839 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:32.313296 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 436/870] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:15:31 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:15:32.316345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ec8cf-16bb-418e-ab75-51b7045804ee None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:32.333284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 435/871] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Jul 12 18:15:32 2022] POST /identity/v3/services => generated 269 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:15:32.440455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ec8cf-16bb-418e-ab75-51b7045804ee None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:32.491370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bd231-27a0-4ee2-a452-451936adf798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:32.492089 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bd231-27a0-4ee2-a452-451936adf798 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:32.492374 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bd231-27a0-4ee2-a452-451936adf798 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:32.492651 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bd231-27a0-4ee2-a452-451936adf798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:32.504025 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bd231-27a0-4ee2-a452-451936adf798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:32.506046 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bd231-27a0-4ee2-a452-451936adf798 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:32.524307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-154bd231-27a0-4ee2-a452-451936adf798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:32.524307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:32.524307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:32.524307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:32.524307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:32.524307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:32.524307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:32.524307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:32.524307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:32.524307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:32.524307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:32.524307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:32.524307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:32.524307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:32.524307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:32.525347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:32.525347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:32.525347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:32.525347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:32.525347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:32.525347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:32.525347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:32.525347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:32.525347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:32.525347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:32.525347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:32.525347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:32.525347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:32.525347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:32.525347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:32.525347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:32.525347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:32.526234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:32.526234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:32.526234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:32.526234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:32.528283 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 437/872] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:32.531540 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00b7cd-711d-4ecd-a541-bbe2b790c839 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:32.649198 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00b7cd-711d-4ecd-a541-bbe2b790c839 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:32.650788 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:32.684442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb78bb-d9fd-42ed-902b-048ce5c07773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:32.685105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb78bb-d9fd-42ed-902b-048ce5c07773 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:32.685420 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb78bb-d9fd-42ed-902b-048ce5c07773 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:32.685694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb78bb-d9fd-42ed-902b-048ce5c07773 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:32.686420 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb78bb-d9fd-42ed-902b-048ce5c07773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:32.686725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb78bb-d9fd-42ed-902b-048ce5c07773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:32.688097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb78bb-d9fd-42ed-902b-048ce5c07773 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:32.705369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 436/873] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:32.706912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bd231-27a0-4ee2-a452-451936adf798 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:32.737965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:32.811859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bd231-27a0-4ee2-a452-451936adf798 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:32.847365 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7ada1-1cf2-4e7d-b584-1eaba3e3d5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:32.848159 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7ada1-1cf2-4e7d-b584-1eaba3e3d5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:32.848468 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7ada1-1cf2-4e7d-b584-1eaba3e3d5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:32.848739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7ada1-1cf2-4e7d-b584-1eaba3e3d5b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:32.855648 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7ada1-1cf2-4e7d-b584-1eaba3e3d5b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:32.857098 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7ada1-1cf2-4e7d-b584-1eaba3e3d5b3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:32.871597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-8fc7ada1-1cf2-4e7d-b584-1eaba3e3d5b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:32.871597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:32.871597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:32.871597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:32.871597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:32.871597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:32.871597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:32.871597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:32.871597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:32.871597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:32.871597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:32.871597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:32.871597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:32.871597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:32.871597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:32.872508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:32.872508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:32.872508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:32.872508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:32.872508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:32.872508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:32.872508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:32.872508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:32.872508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:32.872508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:32.872508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:32.872508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:32.872508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:32.872508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:32.872508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:32.872508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:32.872508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:32.873466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:32.873466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:32.873466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:32.873466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:32.873466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:32.873466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:32.873466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:32.873466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:32.877454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 438/874] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:32.878813 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb78bb-d9fd-42ed-902b-048ce5c07773 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:32.980177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb78bb-d9fd-42ed-902b-048ce5c07773 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:33.015321 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcbced-ce14-497e-a058-414f37f59b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:33.015983 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcbced-ce14-497e-a058-414f37f59b9d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:33.016266 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcbced-ce14-497e-a058-414f37f59b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:33.016543 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcbced-ce14-497e-a058-414f37f59b9d None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:33.017350 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcbced-ce14-497e-a058-414f37f59b9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:33.017664 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcbced-ce14-497e-a058-414f37f59b9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:33.019097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcbced-ce14-497e-a058-414f37f59b9d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:33.035819 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 437/875] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:33.037266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7ada1-1cf2-4e7d-b584-1eaba3e3d5b3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:33.133011 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:33.147830 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7ada1-1cf2-4e7d-b584-1eaba3e3d5b3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:33.184470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b6195-9fbe-4d29-8602-017a749a6b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:33.185126 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b6195-9fbe-4d29-8602-017a749a6b19 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:33.185445 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b6195-9fbe-4d29-8602-017a749a6b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:33.185796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b6195-9fbe-4d29-8602-017a749a6b19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:33.186701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b6195-9fbe-4d29-8602-017a749a6b19 None admin] RBAC: Adding query filter params (role.id=82fa784b33dd4fe19c62367f39ac45b2, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=54189575a60a4d9dbaabb78d44e9c31e) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:33.187015 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b6195-9fbe-4d29-8602-017a749a6b19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:33.188502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b6195-9fbe-4d29-8602-017a749a6b19 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:33.201403 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 439/876] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:15:33 2022] GET /identity/v3/role_assignments?user.id=54189575a60a4d9dbaabb78d44e9c31e&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=82fa784b33dd4fe19c62367f39ac45b2 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:33.466756 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fb1c8-be63-436d-85ac-ae722a4ada4e None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:33.467248 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fb1c8-be63-436d-85ac-ae722a4ada4e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:33.467248 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fb1c8-be63-436d-85ac-ae722a4ada4e None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:33.468824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 438/877] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:33.474394 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba84b1a-4d52-4c02-8372-35e488dd8537 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:33.474815 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba84b1a-4d52-4c02-8372-35e488dd8537 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:33.474961 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba84b1a-4d52-4c02-8372-35e488dd8537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:33.492512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-cba84b1a-4d52-4c02-8372-35e488dd8537 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:33.493758 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-cba84b1a-4d52-4c02-8372-35e488dd8537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:33.569389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 440/878] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:33.592386 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fb1c8-be63-436d-85ac-ae722a4ada4e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:33.617698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:33.699542 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fb1c8-be63-436d-85ac-ae722a4ada4e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:33.734867 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944edc4a-84ff-4b7a-a16f-c5cfbe2f2d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:33.735590 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944edc4a-84ff-4b7a-a16f-c5cfbe2f2d1a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:33.735873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944edc4a-84ff-4b7a-a16f-c5cfbe2f2d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:33.736145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944edc4a-84ff-4b7a-a16f-c5cfbe2f2d1a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:33.736800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944edc4a-84ff-4b7a-a16f-c5cfbe2f2d1a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:33.738198 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944edc4a-84ff-4b7a-a16f-c5cfbe2f2d1a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:33.750004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-944edc4a-84ff-4b7a-a16f-c5cfbe2f2d1a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:15:33.750004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:33.750004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:33.750004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:33.750004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:33.750004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:33.750004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:33.750004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:33.750004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:15:33.750004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:33.750004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:33.750004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:33.750004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:33.750004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:33.750004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:33.750004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:33.750004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:33.750967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:33.750967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:33.750967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:33.750967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:33.750967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:33.750967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:33.750967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:33.750967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:33.750967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:33.750967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:33.750967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:33.750967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:33.750967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:33.750967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:33.750967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:33.750967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:33.751822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:33.751822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:33.751822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:33.751822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:33.751822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:33.751822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:33.751822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:33.751822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:33.751822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:33.751822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:33.751822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:33.751822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:33.751822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:15:33.751822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:33.751822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 439/879] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:15:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:33.758688 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba84b1a-4d52-4c02-8372-35e488dd8537 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:33.844835 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:33.864196 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba84b1a-4d52-4c02-8372-35e488dd8537 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:33.899071 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b9bd5-88c8-4b4e-9021-d1fba8446cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:33.899970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b9bd5-88c8-4b4e-9021-d1fba8446cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:33.900446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b9bd5-88c8-4b4e-9021-d1fba8446cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:33.900891 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b9bd5-88c8-4b4e-9021-d1fba8446cf5 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:33.901801 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b9bd5-88c8-4b4e-9021-d1fba8446cf5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:33.902280 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b9bd5-88c8-4b4e-9021-d1fba8446cf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:33.903811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b9bd5-88c8-4b4e-9021-d1fba8446cf5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:33.908966 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 441/880] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:15:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:33.915315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944edc4a-84ff-4b7a-a16f-c5cfbe2f2d1a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:34.002696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:34.019239 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944edc4a-84ff-4b7a-a16f-c5cfbe2f2d1a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:34.055695 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c12213-d4d6-48a6-90d6-d1099f577ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:34.056771 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c12213-d4d6-48a6-90d6-d1099f577ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:34.057283 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c12213-d4d6-48a6-90d6-d1099f577ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:34.057805 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c12213-d4d6-48a6-90d6-d1099f577ca2 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:34.058719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c12213-d4d6-48a6-90d6-d1099f577ca2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:34.059232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c12213-d4d6-48a6-90d6-d1099f577ca2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:34.060817 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c12213-d4d6-48a6-90d6-d1099f577ca2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:34.066746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 440/881] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:15:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:34.073730 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b9bd5-88c8-4b4e-9021-d1fba8446cf5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:34.085668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da479a13-73f1-40e4-92e0-7630a63fecdf None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:34.085967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da479a13-73f1-40e4-92e0-7630a63fecdf None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:34.086257 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da479a13-73f1-40e4-92e0-7630a63fecdf None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:34.091709 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 441/882] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:34.092926 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867eb9a-428a-4a1f-a05d-6581ae57ec2b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:34.093222 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867eb9a-428a-4a1f-a05d-6581ae57ec2b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:34.093528 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867eb9a-428a-4a1f-a05d-6581ae57ec2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:34.111246 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a867eb9a-428a-4a1f-a05d-6581ae57ec2b None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:34.112449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a867eb9a-428a-4a1f-a05d-6581ae57ec2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:34.176057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b9bd5-88c8-4b4e-9021-d1fba8446cf5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:34.189619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 442/883] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:34.212006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c2259-6a45-43d6-87fc-bf2a62c78bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:34.212664 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c2259-6a45-43d6-87fc-bf2a62c78bec None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:34.212943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c2259-6a45-43d6-87fc-bf2a62c78bec None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:34.213279 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c2259-6a45-43d6-87fc-bf2a62c78bec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:34.214121 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c2259-6a45-43d6-87fc-bf2a62c78bec None admin] RBAC: Adding query filter params (interface=public, service_id=e889ed78e8c141eca8d2ffadba9d32c8, region_id=RegionOne) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:34.214429 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c2259-6a45-43d6-87fc-bf2a62c78bec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:34.215971 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867eb9a-428a-4a1f-a05d-6581ae57ec2b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:34.216088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c2259-6a45-43d6-87fc-bf2a62c78bec None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:34.221920 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 442/884] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Jul 12 18:15:34 2022] GET /identity/v3/endpoints?service_id=e889ed78e8c141eca8d2ffadba9d32c8&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:34.227709 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c2259-6a45-43d6-87fc-bf2a62c78bec None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:34.240585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:34.307018 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:34.329435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867eb9a-428a-4a1f-a05d-6581ae57ec2b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:34.330773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c2259-6a45-43d6-87fc-bf2a62c78bec None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:34.370698 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375324ab-5058-4914-89ce-62d6f11b3456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:34.371358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375324ab-5058-4914-89ce-62d6f11b3456 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:34.371638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375324ab-5058-4914-89ce-62d6f11b3456 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:34.371752 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f08cfb-2859-4f9d-97ee-4b9d4d5c3c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:34.371932 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375324ab-5058-4914-89ce-62d6f11b3456 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:34.372563 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f08cfb-2859-4f9d-97ee-4b9d4d5c3c60 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:34.372670 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375324ab-5058-4914-89ce-62d6f11b3456 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:34.372847 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f08cfb-2859-4f9d-97ee-4b9d4d5c3c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:34.373125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f08cfb-2859-4f9d-97ee-4b9d4d5c3c60 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:34.373830 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f08cfb-2859-4f9d-97ee-4b9d4d5c3c60 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:34.373951 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375324ab-5058-4914-89ce-62d6f11b3456 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:34.375492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f08cfb-2859-4f9d-97ee-4b9d4d5c3c60 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:34.388696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-12f08cfb-2859-4f9d-97ee-4b9d4d5c3c60 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:15:34.388696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:34.388696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:34.388696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:34.388696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:34.388696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:34.388696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:34.388696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:34.388696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:15:34.388696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:34.388696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:34.388696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:34.388696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:34.388696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:34.388696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:34.388696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:34.388696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:34.389795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:34.389795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:34.389795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:34.389795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:34.389795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:34.389795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:34.389795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:34.389795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:34.389795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:34.389795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:34.389795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:34.389795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:34.389795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:34.389795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:34.389795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:34.389795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:34.390628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:34.390628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:34.390628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:34.390628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:34.390628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:34.390628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:34.390628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:34.390628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:34.390628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:34.390628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:34.390628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:34.390628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:34.390628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:15:34.390628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:34.391364 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 443/885] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Jul 12 18:15:34 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:15:34.391438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 443/886] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Jul 12 18:15:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:34.398339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375324ab-5058-4914-89ce-62d6f11b3456 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:34.489957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:34.521049 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375324ab-5058-4914-89ce-62d6f11b3456 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:34.558940 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848547b1-73eb-4f1e-9e05-5aacc49f4ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:34.559527 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848547b1-73eb-4f1e-9e05-5aacc49f4ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:34.559809 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848547b1-73eb-4f1e-9e05-5aacc49f4ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:34.560084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848547b1-73eb-4f1e-9e05-5aacc49f4ed5 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:34.560787 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848547b1-73eb-4f1e-9e05-5aacc49f4ed5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:34.561096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848547b1-73eb-4f1e-9e05-5aacc49f4ed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:34.562565 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848547b1-73eb-4f1e-9e05-5aacc49f4ed5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:34.567786 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 444/887] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Jul 12 18:15:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:34.574051 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f08cfb-2859-4f9d-97ee-4b9d4d5c3c60 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:34.616245 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bced48-f4b3-4f3f-a8a8-95d07d2f1cc4 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:34.616536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bced48-f4b3-4f3f-a8a8-95d07d2f1cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:34.616981 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bced48-f4b3-4f3f-a8a8-95d07d2f1cc4 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:34.618716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 445/888] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:15:34.623633 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14e4a2-649e-494a-bcce-281fe1d3605d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:34.623996 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14e4a2-649e-494a-bcce-281fe1d3605d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:34.624353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14e4a2-649e-494a-bcce-281fe1d3605d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:34.641418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5e14e4a2-649e-494a-bcce-281fe1d3605d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:34.642708 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5e14e4a2-649e-494a-bcce-281fe1d3605d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:34.717483 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 446/889] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:15:34.741102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14e4a2-649e-494a-bcce-281fe1d3605d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:34.814902 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:34.815617 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f08cfb-2859-4f9d-97ee-4b9d4d5c3c60 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:34.856967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866f3b7-77a5-43ff-adf4-4b725dd46c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:34.857950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866f3b7-77a5-43ff-adf4-4b725dd46c8c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:34.858269 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866f3b7-77a5-43ff-adf4-4b725dd46c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:34.858616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866f3b7-77a5-43ff-adf4-4b725dd46c8c None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:34.859394 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866f3b7-77a5-43ff-adf4-4b725dd46c8c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:34.859781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866f3b7-77a5-43ff-adf4-4b725dd46c8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:34.861314 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866f3b7-77a5-43ff-adf4-4b725dd46c8c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:34.865188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14e4a2-649e-494a-bcce-281fe1d3605d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:34.867070 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 444/890] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Jul 12 18:15:34 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:34.906181 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81346d-f4bc-4ac8-a94f-710c4e48b154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:34.907295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81346d-f4bc-4ac8-a94f-710c4e48b154 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:34.907722 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81346d-f4bc-4ac8-a94f-710c4e48b154 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:34.908137 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81346d-f4bc-4ac8-a94f-710c4e48b154 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:34.908960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81346d-f4bc-4ac8-a94f-710c4e48b154 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:34.910528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81346d-f4bc-4ac8-a94f-710c4e48b154 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:34.924453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-7d81346d-f4bc-4ac8-a94f-710c4e48b154 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:15:34.924453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:34.924453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:34.924453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:34.924453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:34.924453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:34.924453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:34.924453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:34.924453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:15:34.924453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:34.924453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:34.924453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:34.924453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:34.924453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:34.924453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:34.924453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:34.925703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:34.925703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:34.925703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:34.925703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:34.925703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:34.925703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:34.925703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:34.925703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:34.925703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:34.925703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:34.925703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:34.925703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:34.925703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:34.925703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:34.925703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:34.925703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:34.927304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:34.927304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:34.927304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:34.927304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:34.927304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:34.927304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:34.927304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:34.927304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:34.927304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:34.927304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:34.927304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:34.927304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:34.927304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:34.927304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:15:34.927304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:34.929989 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 447/891] 10.222.0.57 () {56 vars in 1132 bytes} [Tue Jul 12 18:15:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:34.937308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866f3b7-77a5-43ff-adf4-4b725dd46c8c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:34.949215 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:35.050062 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866f3b7-77a5-43ff-adf4-4b725dd46c8c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:35.084534 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a8472-9f58-483f-ad2a-d2cf0323bd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:35.085121 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a8472-9f58-483f-ad2a-d2cf0323bd88 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:35.085440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a8472-9f58-483f-ad2a-d2cf0323bd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:35.085723 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a8472-9f58-483f-ad2a-d2cf0323bd88 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:35.086431 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a8472-9f58-483f-ad2a-d2cf0323bd88 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:35.086743 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a8472-9f58-483f-ad2a-d2cf0323bd88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:35.088130 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a8472-9f58-483f-ad2a-d2cf0323bd88 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:35.093333 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 445/892] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Jul 12 18:15:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:35.098986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81346d-f4bc-4ac8-a94f-710c4e48b154 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:35.205430 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81346d-f4bc-4ac8-a94f-710c4e48b154 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:35.235656 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:35.242854 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0c0d7-9047-4244-a659-55f216716f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:35.243524 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0c0d7-9047-4244-a659-55f216716f7d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:35.243809 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0c0d7-9047-4244-a659-55f216716f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:35.244150 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0c0d7-9047-4244-a659-55f216716f7d None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:35.244867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0c0d7-9047-4244-a659-55f216716f7d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:35.245227 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0c0d7-9047-4244-a659-55f216716f7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:35.246643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0c0d7-9047-4244-a659-55f216716f7d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:35.252397 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 448/893] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Jul 12 18:15:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:35.260114 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a8472-9f58-483f-ad2a-d2cf0323bd88 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:35.332330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:35.364732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a8472-9f58-483f-ad2a-d2cf0323bd88 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:35.399892 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c4932-2db4-44b8-95d6-87c03420ae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:35.400785 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c4932-2db4-44b8-95d6-87c03420ae6e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:35.400976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfc13d-9214-4605-bdc2-26c45692d116 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:35.401290 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfc13d-9214-4605-bdc2-26c45692d116 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:35.401594 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfc13d-9214-4605-bdc2-26c45692d116 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:35.401724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c4932-2db4-44b8-95d6-87c03420ae6e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:35.402122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c4932-2db4-44b8-95d6-87c03420ae6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:35.403050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c4932-2db4-44b8-95d6-87c03420ae6e None admin] RBAC: Adding query filter params (interface=public, service_id=3a2efd75aaac46e5ac61fa95b524bbff, region_id=RegionOne) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:35.403207 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 449/894] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:35.403650 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c4932-2db4-44b8-95d6-87c03420ae6e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:35.405244 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c4932-2db4-44b8-95d6-87c03420ae6e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:35.408046 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fe7ed-287b-4da3-88b4-7669b187fff0 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:35.408336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fe7ed-287b-4da3-88b4-7669b187fff0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:35.408619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fe7ed-287b-4da3-88b4-7669b187fff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:35.411867 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 446/895] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Jul 12 18:15:35 2022] GET /identity/v3/endpoints?service_id=3a2efd75aaac46e5ac61fa95b524bbff&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:35.417302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c4932-2db4-44b8-95d6-87c03420ae6e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:35.430064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-295fe7ed-287b-4da3-88b4-7669b187fff0 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:35.431546 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-295fe7ed-287b-4da3-88b4-7669b187fff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:35.521288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 450/896] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:15:35.536998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c4932-2db4-44b8-95d6-87c03420ae6e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:35.538714 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fe7ed-287b-4da3-88b4-7669b187fff0 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:35.591189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e3c2-26f7-4167-abe3-00e982c7bdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:35.592532 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e3c2-26f7-4167-abe3-00e982c7bdb1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:35.593041 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e3c2-26f7-4167-abe3-00e982c7bdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:35.593580 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e3c2-26f7-4167-abe3-00e982c7bdb1 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:35.594473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247e3c2-26f7-4167-abe3-00e982c7bdb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:35.596676 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247e3c2-26f7-4167-abe3-00e982c7bdb1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:35.599996 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:35.608259 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 447/897] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Jul 12 18:15:35 2022] GET /identity/v3/services => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:15:35.671583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fe7ed-287b-4da3-88b4-7669b187fff0 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:35.701984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:35.712100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72671b-29b3-4eb4-925a-30718216e090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:35.712930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72671b-29b3-4eb4-925a-30718216e090 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:35.713211 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72671b-29b3-4eb4-925a-30718216e090 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:35.713518 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72671b-29b3-4eb4-925a-30718216e090 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:35.725626 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72671b-29b3-4eb4-925a-30718216e090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:35.734492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-3c72671b-29b3-4eb4-925a-30718216e090 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:15:35.734492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:35.734492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:35.734492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:35.734492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:35.734492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:35.734492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:35.734492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:35.734492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:35.734492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:35.734492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:35.734492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:35.734492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:35.734492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:35.734492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:35.734492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:35.735490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:35.735490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:35.735490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:35.735490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:35.735490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:35.735490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:35.735490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:35.735490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:35.735490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:35.735490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:35.735490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:35.735490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:35.735490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:35.735490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:35.735490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:35.735490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:35.736330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:35.736330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:35.736330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:35.736330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:35.736330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:35.736330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:35.736330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:35.736330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:35.736330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:35.736330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:35.736330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:15:35.736330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:35.736330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 451/898] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Jul 12 18:15:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:35.744295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e3c2-26f7-4167-abe3-00e982c7bdb1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:35.860203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e3c2-26f7-4167-abe3-00e982c7bdb1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:35.896473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a19f6-537f-436b-add0-3d415c4b1bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:35.897142 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a19f6-537f-436b-add0-3d415c4b1bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:35.897472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a19f6-537f-436b-add0-3d415c4b1bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:35.897748 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a19f6-537f-436b-add0-3d415c4b1bb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:35.898495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a19f6-537f-436b-add0-3d415c4b1bb9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:35.898806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a19f6-537f-436b-add0-3d415c4b1bb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:35.900232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a19f6-537f-436b-add0-3d415c4b1bb9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:35.908874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 448/899] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Jul 12 18:15:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:35.915065 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72671b-29b3-4eb4-925a-30718216e090 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:36.019236 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72671b-29b3-4eb4-925a-30718216e090 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:36.054882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc0799-51cc-48fe-82ff-7bae4ab2a3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:36.056021 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc0799-51cc-48fe-82ff-7bae4ab2a3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:36.056509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc0799-51cc-48fe-82ff-7bae4ab2a3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:36.057094 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc0799-51cc-48fe-82ff-7bae4ab2a3c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:36.068737 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc0799-51cc-48fe-82ff-7bae4ab2a3c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:36.070591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc0799-51cc-48fe-82ff-7bae4ab2a3c1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:36.090718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-f0cc0799-51cc-48fe-82ff-7bae4ab2a3c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:36.090718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:36.090718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:36.090718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:36.090718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:36.090718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:36.090718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:36.090718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:36.090718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:36.090718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:36.090718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:36.090718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:36.090718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:36.090718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:36.090718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:36.091669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:36.091669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:36.091669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:36.091669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:36.091669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:36.091669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:36.091669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:36.091669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:36.091669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:36.091669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:36.091669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:36.091669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:36.091669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:36.091669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:36.091669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:36.091669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:36.091669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:36.092539 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:36.092539 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:36.092539 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:36.092539 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:36.094844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 452/900] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:36.101382 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a19f6-537f-436b-add0-3d415c4b1bb9 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:36.166947 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:36.207506 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a19f6-537f-436b-add0-3d415c4b1bb9 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:36.243175 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea9499-e8d8-4f54-aed9-fac5ca3f5792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:36.243832 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea9499-e8d8-4f54-aed9-fac5ca3f5792 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:36.244111 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea9499-e8d8-4f54-aed9-fac5ca3f5792 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:36.244383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea9499-e8d8-4f54-aed9-fac5ca3f5792 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:36.245104 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea9499-e8d8-4f54-aed9-fac5ca3f5792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:36.245435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea9499-e8d8-4f54-aed9-fac5ca3f5792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:36.246804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea9499-e8d8-4f54-aed9-fac5ca3f5792 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:36.259816 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 449/901] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:36.265393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc0799-51cc-48fe-82ff-7bae4ab2a3c1 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:36.308886 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:36.377439 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc0799-51cc-48fe-82ff-7bae4ab2a3c1 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:36.413310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c897c5-9691-4766-a744-d8ef378d9d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:36.414124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c897c5-9691-4766-a744-d8ef378d9d92 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:36.414407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c897c5-9691-4766-a744-d8ef378d9d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:36.414682 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c897c5-9691-4766-a744-d8ef378d9d92 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:36.421934 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c897c5-9691-4766-a744-d8ef378d9d92 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:36.423409 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c897c5-9691-4766-a744-d8ef378d9d92 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:36.438894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-18c897c5-9691-4766-a744-d8ef378d9d92 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:15:36.438894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:36.438894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:36.438894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:36.438894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:36.438894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:36.438894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:36.438894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:36.438894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:36.438894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:36.438894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:36.438894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:36.438894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:36.438894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:36.438894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:36.438894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:36.439848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:36.439848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:36.439848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:36.439848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:36.439848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:36.439848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:36.439848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:36.439848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:36.439848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:36.439848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:36.439848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:36.439848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:36.439848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:36.439848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:36.439848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:36.439848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:36.439848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:36.439848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:36.440791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:36.440791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:36.440791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:36.440791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:36.440791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:36.440791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:36.440791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:36.440791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:36.440791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:15:36.440791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:36.440791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 453/902] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Jul 12 18:15:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:36.447692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea9499-e8d8-4f54-aed9-fac5ca3f5792 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:36.555707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea9499-e8d8-4f54-aed9-fac5ca3f5792 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:36.588548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:36.602332 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2c57a-b369-4a6e-a7fe-e76477888a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:36.603709 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2c57a-b369-4a6e-a7fe-e76477888a13 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:36.604219 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2c57a-b369-4a6e-a7fe-e76477888a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:36.604710 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2c57a-b369-4a6e-a7fe-e76477888a13 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:36.605815 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2c57a-b369-4a6e-a7fe-e76477888a13 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:36.606331 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2c57a-b369-4a6e-a7fe-e76477888a13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:36.607967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2c57a-b369-4a6e-a7fe-e76477888a13 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:36.619669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e80096-1fb5-4364-9c8e-5e7dc2e6b044 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:36.620151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e80096-1fb5-4364-9c8e-5e7dc2e6b044 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:36.620230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e80096-1fb5-4364-9c8e-5e7dc2e6b044 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:36.621914 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 454/903] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:36.626652 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c81763-8ee2-4cd3-8cb1-996110ed00d2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:36.626938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c81763-8ee2-4cd3-8cb1-996110ed00d2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:36.627218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c81763-8ee2-4cd3-8cb1-996110ed00d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:36.628309 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 450/904] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Jul 12 18:15:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:36.634127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2c57a-b369-4a6e-a7fe-e76477888a13 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:36.644285 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-22c81763-8ee2-4cd3-8cb1-996110ed00d2 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:36.649307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-22c81763-8ee2-4cd3-8cb1-996110ed00d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:36.727282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 455/905] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:15:36.742138 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2c57a-b369-4a6e-a7fe-e76477888a13 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:36.749683 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c81763-8ee2-4cd3-8cb1-996110ed00d2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:36.779266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:36.780648 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ce77b-22d3-4805-a341-a36b20b4ee5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:36.781863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ce77b-22d3-4805-a341-a36b20b4ee5a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:36.782480 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ce77b-22d3-4805-a341-a36b20b4ee5a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:36.782963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ce77b-22d3-4805-a341-a36b20b4ee5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:36.834079 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:36.856984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ce77b-22d3-4805-a341-a36b20b4ee5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:36.858853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ce77b-22d3-4805-a341-a36b20b4ee5a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:36.864271 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c81763-8ee2-4cd3-8cb1-996110ed00d2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:36.901414 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a409402-9d17-4c50-89b0-f35840c5276f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:36.902502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a409402-9d17-4c50-89b0-f35840c5276f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:36.902926 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a409402-9d17-4c50-89b0-f35840c5276f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:36.903341 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a409402-9d17-4c50-89b0-f35840c5276f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:36.904195 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a409402-9d17-4c50-89b0-f35840c5276f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:36.905758 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a409402-9d17-4c50-89b0-f35840c5276f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:36.918200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-6a409402-9d17-4c50-89b0-f35840c5276f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:15:36.918200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:36.918200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:36.918200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:36.918200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:36.918200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:36.918200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:36.918200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:36.918200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:15:36.918200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:36.918200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:36.918200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:36.918200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:36.918200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:36.918200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:36.918200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:36.918200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:36.919184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:36.919184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:36.919184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:36.919184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:36.919184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:36.919184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:36.919184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:36.919184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:36.919184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:36.919184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:36.919184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:36.919184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:36.919184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:36.919184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:36.919184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:36.919184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:36.920000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:36.920000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:36.920000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:36.920000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:36.920000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:36.920000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:36.920000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:36.920000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:36.920000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:36.920000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:36.920000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:36.920000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:36.920000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:15:36.920000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:36.922899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 456/906] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:15:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:36.928655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a409402-9d17-4c50-89b0-f35840c5276f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:36.981948 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 451/907] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:15:36 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 18:15:36.987264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ce77b-22d3-4805-a341-a36b20b4ee5a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:37.053862 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:37.067635 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a409402-9d17-4c50-89b0-f35840c5276f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:37.069695 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:37.092114 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ce77b-22d3-4805-a341-a36b20b4ee5a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:37.109243 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4122a33-bf1f-4409-8346-1b69a50988bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:37.110227 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4122a33-bf1f-4409-8346-1b69a50988bd None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:37.110514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4122a33-bf1f-4409-8346-1b69a50988bd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:37.110790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4122a33-bf1f-4409-8346-1b69a50988bd None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:37.111500 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4122a33-bf1f-4409-8346-1b69a50988bd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:37.111805 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4122a33-bf1f-4409-8346-1b69a50988bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:37.113643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4122a33-bf1f-4409-8346-1b69a50988bd None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:37.118541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 457/908] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:15:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:37.118541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee1848-6c7c-4658-b08c-ea60969709ea None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:37.118541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee1848-6c7c-4658-b08c-ea60969709ea None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:37.118541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee1848-6c7c-4658-b08c-ea60969709ea None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:37.118541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 458/909] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:37.126145 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee1848-6c7c-4658-b08c-ea60969709ea None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:37.131833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524bd3d-2be7-4eca-bced-61f356ef73c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:37.132628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524bd3d-2be7-4eca-bced-61f356ef73c8 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:37.132908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524bd3d-2be7-4eca-bced-61f356ef73c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:37.133181 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524bd3d-2be7-4eca-bced-61f356ef73c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:37.143735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524bd3d-2be7-4eca-bced-61f356ef73c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:37.145734 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524bd3d-2be7-4eca-bced-61f356ef73c8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:37.163717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-2524bd3d-2be7-4eca-bced-61f356ef73c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:37.163717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:37.163717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:37.163717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:37.163717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:37.163717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:37.163717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:37.163717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:37.163717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:37.163717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:37.163717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:37.163717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:37.163717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:37.163717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:37.163717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:37.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:37.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:37.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:37.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:37.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:37.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:37.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:37.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:37.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:37.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:37.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:37.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:37.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:37.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:37.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:37.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:37.164612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:37.165639 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:37.165639 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:37.165639 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:37.165639 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:37.165639 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 452/910] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:37.166554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac546783-dec1-4820-a6e0-525ed7c2b3a6 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:37.166909 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac546783-dec1-4820-a6e0-525ed7c2b3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:37.167296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac546783-dec1-4820-a6e0-525ed7c2b3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:37.184472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ac546783-dec1-4820-a6e0-525ed7c2b3a6 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:37.185794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ac546783-dec1-4820-a6e0-525ed7c2b3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:37.245798 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee1848-6c7c-4658-b08c-ea60969709ea None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:37.256806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 453/911] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:37.258586 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac546783-dec1-4820-a6e0-525ed7c2b3a6 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:37.283130 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b795fe7-9155-4e84-bbad-7e30f4675764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:37.283799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b795fe7-9155-4e84-bbad-7e30f4675764 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:37.284082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b795fe7-9155-4e84-bbad-7e30f4675764 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:37.284457 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b795fe7-9155-4e84-bbad-7e30f4675764 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:37.285162 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b795fe7-9155-4e84-bbad-7e30f4675764 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:37.285541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b795fe7-9155-4e84-bbad-7e30f4675764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:37.287039 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b795fe7-9155-4e84-bbad-7e30f4675764 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:37.292480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 459/912] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Jul 12 18:15:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:37.293407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b795fe7-9155-4e84-bbad-7e30f4675764 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:37.316486 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:37.335283 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:37.379408 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac546783-dec1-4820-a6e0-525ed7c2b3a6 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:37.411633 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b795fe7-9155-4e84-bbad-7e30f4675764 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:37.415662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4189f-57f0-4b2d-96c9-24b4a60655f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:37.416326 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4189f-57f0-4b2d-96c9-24b4a60655f7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:37.416610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4189f-57f0-4b2d-96c9-24b4a60655f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:37.416886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4189f-57f0-4b2d-96c9-24b4a60655f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:37.417638 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4189f-57f0-4b2d-96c9-24b4a60655f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:37.417947 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4189f-57f0-4b2d-96c9-24b4a60655f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:37.419324 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4189f-57f0-4b2d-96c9-24b4a60655f7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:37.431828 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 454/913] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:37.432689 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4189f-57f0-4b2d-96c9-24b4a60655f7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:37.456254 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb6b38-ce9c-4071-9fec-83c1023a0db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:37.456918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb6b38-ce9c-4071-9fec-83c1023a0db6 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:37.457198 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb6b38-ce9c-4071-9fec-83c1023a0db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:37.457532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb6b38-ce9c-4071-9fec-83c1023a0db6 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:37.458219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb6b38-ce9c-4071-9fec-83c1023a0db6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:37.459588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb6b38-ce9c-4071-9fec-83c1023a0db6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:37.481300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 460/914] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Jul 12 18:15:37 2022] POST /identity/v3/services => generated 241 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:15:37.481300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb6b38-ce9c-4071-9fec-83c1023a0db6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:37.564878 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4189f-57f0-4b2d-96c9-24b4a60655f7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:37.594311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:37.606457 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:37.615990 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58167113-4ed5-4c90-8552-32bb2abb5c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:37.616656 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58167113-4ed5-4c90-8552-32bb2abb5c10 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:37.617119 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58167113-4ed5-4c90-8552-32bb2abb5c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:37.617968 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58167113-4ed5-4c90-8552-32bb2abb5c10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:37.618731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58167113-4ed5-4c90-8552-32bb2abb5c10 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:37.620822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58167113-4ed5-4c90-8552-32bb2abb5c10 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:37.632736 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb6b38-ce9c-4071-9fec-83c1023a0db6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:37.645193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 455/915] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Jul 12 18:15:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:15:37.705641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a7b27-813e-416d-b954-bb5f3314713d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:37.706463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a7b27-813e-416d-b954-bb5f3314713d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:37.706463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a7b27-813e-416d-b954-bb5f3314713d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:37.706643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a7b27-813e-416d-b954-bb5f3314713d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:37.716089 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a7b27-813e-416d-b954-bb5f3314713d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:37.717311 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a7b27-813e-416d-b954-bb5f3314713d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:37.734325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-821a7b27-813e-416d-b954-bb5f3314713d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:37.734325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:37.734325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:37.734325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:37.734325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:37.734325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:37.734325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:37.734325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:37.734325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:37.734325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:37.734325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:37.734325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:37.734325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:37.734325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:37.734325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:37.735270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:37.735270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:37.735270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:37.735270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:37.735270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:37.735270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:37.735270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:37.735270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:37.735270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:37.735270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:37.735270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:37.735270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:37.735270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:37.735270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:37.735270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:37.735270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:37.735270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:37.736164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:37.736164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:37.736164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:37.736164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:37.736164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:37.736164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:37.736164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:37.736164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:37.738143 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 461/916] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:37.747597 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58167113-4ed5-4c90-8552-32bb2abb5c10 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:37.788940 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103aa0a0-439a-4bd2-ab34-7f408e7be935 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:37.789308 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103aa0a0-439a-4bd2-ab34-7f408e7be935 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:37.789519 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103aa0a0-439a-4bd2-ab34-7f408e7be935 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:37.791044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 462/917] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:37.796684 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07c93a-79b2-45ed-bcb5-a61860ab2260 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:37.797315 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07c93a-79b2-45ed-bcb5-a61860ab2260 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:37.797789 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07c93a-79b2-45ed-bcb5-a61860ab2260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:37.817422 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4a07c93a-79b2-45ed-bcb5-a61860ab2260 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:37.818973 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4a07c93a-79b2-45ed-bcb5-a61860ab2260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:37.870802 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58167113-4ed5-4c90-8552-32bb2abb5c10 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:37.909395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 463/918] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:15:37.914017 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc95277-bbeb-4f02-b9eb-00dfff48ce2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:37.914928 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc95277-bbeb-4f02-b9eb-00dfff48ce2a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:37.915419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc95277-bbeb-4f02-b9eb-00dfff48ce2a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:37.915909 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc95277-bbeb-4f02-b9eb-00dfff48ce2a None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:37.916912 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc95277-bbeb-4f02-b9eb-00dfff48ce2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:37.917446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc95277-bbeb-4f02-b9eb-00dfff48ce2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:37.919111 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc95277-bbeb-4f02-b9eb-00dfff48ce2a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:37.933106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07c93a-79b2-45ed-bcb5-a61860ab2260 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:37.934618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 456/919] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:37.941369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc95277-bbeb-4f02-b9eb-00dfff48ce2a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:37.989766 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:38.010026 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:38.056303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc95277-bbeb-4f02-b9eb-00dfff48ce2a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:38.064466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07c93a-79b2-45ed-bcb5-a61860ab2260 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:38.093714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ceda0-1558-4fff-a6b9-8975dd9a6629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:38.094525 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ceda0-1558-4fff-a6b9-8975dd9a6629 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:38.094899 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ceda0-1558-4fff-a6b9-8975dd9a6629 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:38.095324 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ceda0-1558-4fff-a6b9-8975dd9a6629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:38.096185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ceda0-1558-4fff-a6b9-8975dd9a6629 None admin] RBAC: Adding query filter params (role.id=70c740362c964f449be0b5c279cb35c0, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=54189575a60a4d9dbaabb78d44e9c31e) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:38.096593 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ceda0-1558-4fff-a6b9-8975dd9a6629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:38.098293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ceda0-1558-4fff-a6b9-8975dd9a6629 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:38.113303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 457/920] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:15:37 2022] GET /identity/v3/role_assignments?user.id=54189575a60a4d9dbaabb78d44e9c31e&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=70c740362c964f449be0b5c279cb35c0 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:38.120266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11158e7-d46d-4aed-b1a3-7554a407eaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:38.121103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11158e7-d46d-4aed-b1a3-7554a407eaf6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:38.121428 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11158e7-d46d-4aed-b1a3-7554a407eaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:38.121699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11158e7-d46d-4aed-b1a3-7554a407eaf6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:38.122362 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11158e7-d46d-4aed-b1a3-7554a407eaf6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:38.123794 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11158e7-d46d-4aed-b1a3-7554a407eaf6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:38.137506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-c11158e7-d46d-4aed-b1a3-7554a407eaf6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:15:38.137506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:38.137506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:38.137506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:38.137506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:38.137506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:38.137506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:38.137506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:38.137506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:15:38.137506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:38.137506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:38.137506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:38.137506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:38.137506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:38.137506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:38.137506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:38.138548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:38.138548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:38.138548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:38.138548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:38.138548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:38.138548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:38.138548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:38.138548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:38.138548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:38.138548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:38.138548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:38.138548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:38.138548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:38.138548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:38.138548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:38.138548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:38.139822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:38.139822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:38.139822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:38.139822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:38.139822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:38.139822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:38.139822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:38.139822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:38.139822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:38.139822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:38.139822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:38.139822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:38.139822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:38.139822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:15:38.139822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:38.139822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 464/921] 10.222.0.57 () {56 vars in 1132 bytes} [Tue Jul 12 18:15:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:38.145683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ceda0-1558-4fff-a6b9-8975dd9a6629 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:38.261087 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:38.265322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ceda0-1558-4fff-a6b9-8975dd9a6629 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:38.305052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531372e-db3f-414e-b51b-891b458bc388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:38.305760 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531372e-db3f-414e-b51b-891b458bc388 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:38.306038 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531372e-db3f-414e-b51b-891b458bc388 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:38.306306 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531372e-db3f-414e-b51b-891b458bc388 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:38.307004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531372e-db3f-414e-b51b-891b458bc388 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:38.307307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531372e-db3f-414e-b51b-891b458bc388 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:38.308671 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531372e-db3f-414e-b51b-891b458bc388 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:38.313840 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 458/922] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Jul 12 18:15:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:38.319411 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11158e7-d46d-4aed-b1a3-7554a407eaf6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:38.421795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11158e7-d46d-4aed-b1a3-7554a407eaf6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:38.451438 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:38.458868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff9cd0-760f-42f4-a20e-a2f3628db6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:38.459789 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff9cd0-760f-42f4-a20e-a2f3628db6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:38.460294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff9cd0-760f-42f4-a20e-a2f3628db6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:38.460775 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff9cd0-760f-42f4-a20e-a2f3628db6c2 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:38.461751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff9cd0-760f-42f4-a20e-a2f3628db6c2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:38.462279 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff9cd0-760f-42f4-a20e-a2f3628db6c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:38.463843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff9cd0-760f-42f4-a20e-a2f3628db6c2 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:38.469505 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 465/923] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Jul 12 18:15:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:38.477362 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531372e-db3f-414e-b51b-891b458bc388 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:38.580884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531372e-db3f-414e-b51b-891b458bc388 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:38.615742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ad4a1-38e0-465f-87c0-1c197107ddd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:38.616404 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ad4a1-38e0-465f-87c0-1c197107ddd6 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:38.616941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ad4a1-38e0-465f-87c0-1c197107ddd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:38.616941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ad4a1-38e0-465f-87c0-1c197107ddd6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:38.617712 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ad4a1-38e0-465f-87c0-1c197107ddd6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:38.619087 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ad4a1-38e0-465f-87c0-1c197107ddd6 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:38.639468 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 459/924] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Jul 12 18:15:38 2022] POST /identity/v3/endpoints => generated 347 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:15:39.680403 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e17e8-3b27-414a-993f-5b7634432b38 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:39.681008 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e17e8-3b27-414a-993f-5b7634432b38 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:39.681008 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e17e8-3b27-414a-993f-5b7634432b38 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:39.682710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 466/925] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:39.688189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0765854-4f85-4e15-bb49-f39bce4bc1cf None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:39.688987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0765854-4f85-4e15-bb49-f39bce4bc1cf None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:39.689520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0765854-4f85-4e15-bb49-f39bce4bc1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:39.706431 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d0765854-4f85-4e15-bb49-f39bce4bc1cf None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:39.708413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d0765854-4f85-4e15-bb49-f39bce4bc1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:39.722167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:39.808606 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 460/926] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:39.836541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e17e8-3b27-414a-993f-5b7634432b38 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:39.950830 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc7556-a73c-475b-b614-bb3f6c302c87 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:39.951119 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc7556-a73c-475b-b614-bb3f6c302c87 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:39.951588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc7556-a73c-475b-b614-bb3f6c302c87 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:39.956941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 461/927] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:39.958939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b55f83-210f-4016-8b8c-9c993836263d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:39.959392 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b55f83-210f-4016-8b8c-9c993836263d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:39.959824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b55f83-210f-4016-8b8c-9c993836263d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:39.977444 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-00b55f83-210f-4016-8b8c-9c993836263d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:39.979007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-00b55f83-210f-4016-8b8c-9c993836263d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:40.003489 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e17e8-3b27-414a-993f-5b7634432b38 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:40.046497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b15716-6d3e-4907-8f9c-1d95e9d37c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:40.047764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b15716-6d3e-4907-8f9c-1d95e9d37c4f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:40.048277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b15716-6d3e-4907-8f9c-1d95e9d37c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:40.048788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b15716-6d3e-4907-8f9c-1d95e9d37c4f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:40.049591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b15716-6d3e-4907-8f9c-1d95e9d37c4f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:40.051265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b15716-6d3e-4907-8f9c-1d95e9d37c4f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:40.064555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 462/928] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:15:40.065642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-d8b15716-6d3e-4907-8f9c-1d95e9d37c4f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:15:40.065642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:40.065642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:40.065642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:40.065642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:40.065642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:40.065642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:40.065642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:40.065642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:15:40.065642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:40.065642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:40.065642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:40.065642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:40.065642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:40.065642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:40.065642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:40.065642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:40.066945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:40.066945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:40.066945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:40.066945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:40.066945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:40.066945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:40.066945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:40.066945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:40.066945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:40.066945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:40.066945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:40.066945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:40.066945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:40.066945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:40.066945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:40.066945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:40.067958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:40.067958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:40.067958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:40.067958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:40.067958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:40.067958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:40.067958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:40.067958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:40.067958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:40.067958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:40.067958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:40.067958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:40.067958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:15:40.067958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:40.070827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 467/929] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Jul 12 18:15:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:40.078328 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b55f83-210f-4016-8b8c-9c993836263d None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:40.095115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b15716-6d3e-4907-8f9c-1d95e9d37c4f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:40.167729 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:40.173549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:40.195984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b55f83-210f-4016-8b8c-9c993836263d None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:40.220920 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b15716-6d3e-4907-8f9c-1d95e9d37c4f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:40.238261 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c3aed-3ea4-4b02-a86f-52668164043e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:40.239540 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c3aed-3ea4-4b02-a86f-52668164043e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:40.239771 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c3aed-3ea4-4b02-a86f-52668164043e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:40.240050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c3aed-3ea4-4b02-a86f-52668164043e None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:40.240763 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c3aed-3ea4-4b02-a86f-52668164043e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:40.241070 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c3aed-3ea4-4b02-a86f-52668164043e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:40.242632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c3aed-3ea4-4b02-a86f-52668164043e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:40.253487 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 463/930] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Jul 12 18:15:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:40.258489 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c3aed-3ea4-4b02-a86f-52668164043e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:40.271062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb98d1-2128-4118-8d31-1d2b2f40ff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:40.272278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb98d1-2128-4118-8d31-1d2b2f40ff5d None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:40.272565 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb98d1-2128-4118-8d31-1d2b2f40ff5d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:40.272840 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb98d1-2128-4118-8d31-1d2b2f40ff5d None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:40.273583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb98d1-2128-4118-8d31-1d2b2f40ff5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:40.275515 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb98d1-2128-4118-8d31-1d2b2f40ff5d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:40.277334 dv-cinder-835384-15-smb devstack@keystone.service[80226]: WARNING keystone.server.flask.common [None req-6bfb98d1-2128-4118-8d31-1d2b2f40ff5d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 18:15:40.300948 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.sql.core [None req-6bfb98d1-2128-4118-8d31-1d2b2f40ff5d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 18:15:40.300948 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 18:15:40.300948 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [parameters: {'id': '4d093a3a6c5448fca15c8d14567dbb93', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 18:15:40.300948 dv-cinder-835384-15-smb devstack@keystone.service[80226]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80226) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 18:15:40.310535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-6bfb98d1-2128-4118-8d31-1d2b2f40ff5d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4d093a3a6c5448fca15c8d14567dbb93.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4d093a3a6c5448fca15c8d14567dbb93. Jul 12 18:15:40.310535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:40.310535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 18:15:40.310535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 18:15:40.310535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 18:15:40.310535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 18:15:40.310535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 18:15:40.310535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 18:15:40.310535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 18:15:40.310535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application conn.query(q) Jul 12 18:15:40.310535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 18:15:40.310535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 18:15:40.310535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 18:15:40.311393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application result.read() Jul 12 18:15:40.311393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 18:15:40.311393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 18:15:40.311393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 18:15:40.311393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 18:15:40.311393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 18:15:40.311393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 18:15:40.311393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 18:15:40.311393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 18:15:40.311393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 18:15:40.311393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:40.311393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 18:15:40.311393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:40.311393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:40.311393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 18:15:40.311393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 18:15:40.311393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 12 18:15:40.311393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 12 18:15:40.312363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 18:15:40.312363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application next(self.gen) Jul 12 18:15:40.312363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 18:15:40.312363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application yield resource Jul 12 18:15:40.312363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 18:15:40.312363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application next(self.gen) Jul 12 18:15:40.312363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 18:15:40.312363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 18:15:40.312363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 18:15:40.312363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 18:15:40.312363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 18:15:40.312363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise self.value Jul 12 18:15:40.312363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 18:15:40.312363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 18:15:40.312363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 18:15:40.312363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application session.commit() Jul 12 18:15:40.312363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 18:15:40.313294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 18:15:40.313294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 18:15:40.313294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 18:15:40.313294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 18:15:40.313294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self.session.flush() Jul 12 18:15:40.313294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 18:15:40.313294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 18:15:40.313294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 18:15:40.313294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 18:15:40.313294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 18:15:40.313294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application compat.raise_( Jul 12 18:15:40.313294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 18:15:40.313294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception Jul 12 18:15:40.313294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 18:15:40.313294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 18:15:40.313294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 18:15:40.313294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 18:15:40.314870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 18:15:40.314870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 18:15:40.314870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 18:15:40.314870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 18:15:40.314870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 18:15:40.314870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 18:15:40.314870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 18:15:40.314870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 18:15:40.314870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 18:15:40.314870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 18:15:40.314870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 18:15:40.314870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 18:15:40.314870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 18:15:40.314870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 18:15:40.314870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 18:15:40.315632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 18:15:40.315632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 18:15:40.315632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception Jul 12 18:15:40.315632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 18:15:40.315632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 18:15:40.315632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 18:15:40.315632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 18:15:40.315632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 18:15:40.315632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 18:15:40.315632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 18:15:40.315632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application conn.query(q) Jul 12 18:15:40.315632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 18:15:40.315632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 18:15:40.315632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 18:15:40.315632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application result.read() Jul 12 18:15:40.315632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 18:15:40.315632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 18:15:40.318278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 18:15:40.318278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 18:15:40.318278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 18:15:40.318278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 18:15:40.318278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 18:15:40.318278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 18:15:40.318278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 18:15:40.318278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 18:15:40.318278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [parameters: {'id': '4d093a3a6c5448fca15c8d14567dbb93', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 18:15:40.318278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 18:15:40.318278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:40.318278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:40.318278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:40.318278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:40.318278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 12 18:15:40.320424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 12 18:15:40.320424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 18:15:40.320424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 18:15:40.320424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 12 18:15:40.320424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:40.320424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:40.320424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:40.320424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:40.320424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:40.320424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:40.320424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:40.320424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:40.320424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:40.320424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:40.320424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:40.320424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:40.320424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:40.322761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:40.322761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 12 18:15:40.322761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 12 18:15:40.322761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:40.322761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:40.322761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 12 18:15:40.322761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 12 18:15:40.322761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4d093a3a6c5448fca15c8d14567dbb93. Jul 12 18:15:40.322761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:40.322761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 468/931] 10.222.0.57 () {60 vars in 1140 bytes} [Tue Jul 12 18:15:40 2022] POST /identity/v3/projects => generated 262 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:40.322761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb98d1-2128-4118-8d31-1d2b2f40ff5d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:40.397249 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c3aed-3ea4-4b02-a86f-52668164043e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:40.438475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10268e3a-4153-4244-9693-092f77fd6bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:40.438710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb98d1-2128-4118-8d31-1d2b2f40ff5d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:40.439135 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10268e3a-4153-4244-9693-092f77fd6bfd None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:40.439415 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10268e3a-4153-4244-9693-092f77fd6bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:40.439685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10268e3a-4153-4244-9693-092f77fd6bfd None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:40.440505 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10268e3a-4153-4244-9693-092f77fd6bfd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:40.441436 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10268e3a-4153-4244-9693-092f77fd6bfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:40.442997 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10268e3a-4153-4244-9693-092f77fd6bfd None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:40.453602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 464/932] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Jul 12 18:15:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:40.453602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6c83a-d4bf-4789-8611-28190e303480 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:40.453602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6c83a-d4bf-4789-8611-28190e303480 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:40.453602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6c83a-d4bf-4789-8611-28190e303480 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:40.453602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 465/933] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:40.454712 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6c83a-d4bf-4789-8611-28190e303480 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:40.458077 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:40.460606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:40.483147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765ba73-5ace-4aaf-8d9b-9b861d8ea62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:40.483961 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765ba73-5ace-4aaf-8d9b-9b861d8ea62d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:40.484283 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765ba73-5ace-4aaf-8d9b-9b861d8ea62d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:40.484561 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765ba73-5ace-4aaf-8d9b-9b861d8ea62d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:40.492223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765ba73-5ace-4aaf-8d9b-9b861d8ea62d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:40.493915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765ba73-5ace-4aaf-8d9b-9b861d8ea62d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:40.508567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-d765ba73-5ace-4aaf-8d9b-9b861d8ea62d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:40.508567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:40.508567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:40.508567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:40.508567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:40.508567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:40.508567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:40.508567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:40.508567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:40.508567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:40.508567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:40.508567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:40.508567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:40.508567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:40.508567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:40.509548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:40.509548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:40.509548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:40.509548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:40.509548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:40.509548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:40.509548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:40.509548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:40.509548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:40.509548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:40.509548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:40.509548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:40.509548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:40.509548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:40.509548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:40.509548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:40.509548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:40.510478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:40.510478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:40.510478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:40.510478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:40.510478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:40.510478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:40.510478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:40.510478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:40.510478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 469/934] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:40.511627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220825e3-74dd-4c9c-b339-2cd9b8ecdb38 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:40.511627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220825e3-74dd-4c9c-b339-2cd9b8ecdb38 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:40.511627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220825e3-74dd-4c9c-b339-2cd9b8ecdb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:40.529165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-220825e3-74dd-4c9c-b339-2cd9b8ecdb38 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:40.530725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-220825e3-74dd-4c9c-b339-2cd9b8ecdb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:40.568664 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6c83a-d4bf-4789-8611-28190e303480 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:40.606575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd565d49-671a-44e7-ac71-c4722a69e052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:40.607355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd565d49-671a-44e7-ac71-c4722a69e052 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:40.607920 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd565d49-671a-44e7-ac71-c4722a69e052 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:40.607920 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd565d49-671a-44e7-ac71-c4722a69e052 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:40.608712 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd565d49-671a-44e7-ac71-c4722a69e052 None admin] RBAC: Adding query filter params (interface=public, service_id=7240e2e7984c459c88152d9c8bfcfc02, region_id=RegionOne) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:40.609032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd565d49-671a-44e7-ac71-c4722a69e052 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:40.610490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd565d49-671a-44e7-ac71-c4722a69e052 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:40.620800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 466/935] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Jul 12 18:15:40 2022] GET /identity/v3/endpoints?service_id=7240e2e7984c459c88152d9c8bfcfc02&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:40.620800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd565d49-671a-44e7-ac71-c4722a69e052 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:40.621541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 470/936] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:40.622413 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220825e3-74dd-4c9c-b339-2cd9b8ecdb38 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:40.689698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:40.726276 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd565d49-671a-44e7-ac71-c4722a69e052 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:40.735932 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220825e3-74dd-4c9c-b339-2cd9b8ecdb38 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:40.740014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:40.761166 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155ceb3-0baf-4e09-9368-49c05b790905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:40.761860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155ceb3-0baf-4e09-9368-49c05b790905 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:40.762146 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155ceb3-0baf-4e09-9368-49c05b790905 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:40.762423 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155ceb3-0baf-4e09-9368-49c05b790905 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:40.763175 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155ceb3-0baf-4e09-9368-49c05b790905 None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:40.763482 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155ceb3-0baf-4e09-9368-49c05b790905 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:40.764928 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155ceb3-0baf-4e09-9368-49c05b790905 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:40.776842 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981daf6b-be30-4907-814f-4ff5d0ec9fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:40.777531 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981daf6b-be30-4907-814f-4ff5d0ec9fad None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:40.777813 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981daf6b-be30-4907-814f-4ff5d0ec9fad None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:40.778084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981daf6b-be30-4907-814f-4ff5d0ec9fad None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:40.778921 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981daf6b-be30-4907-814f-4ff5d0ec9fad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:40.780109 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981daf6b-be30-4907-814f-4ff5d0ec9fad None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:40.789289 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 467/937] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Jul 12 18:15:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:40.789289 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155ceb3-0baf-4e09-9368-49c05b790905 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:40.799245 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 471/938] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Jul 12 18:15:40 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:15:40.905030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db92a82-2281-4f9f-b175-cb4af7eb8d56 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:40.905397 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db92a82-2281-4f9f-b175-cb4af7eb8d56 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:40.905625 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db92a82-2281-4f9f-b175-cb4af7eb8d56 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:40.907344 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 472/939] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:15:40.914160 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d374a24-fed6-4e3a-b226-6882ae755671 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:40.914160 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d374a24-fed6-4e3a-b226-6882ae755671 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:40.914160 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d374a24-fed6-4e3a-b226-6882ae755671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:40.924914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155ceb3-0baf-4e09-9368-49c05b790905 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:40.941394 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-3d374a24-fed6-4e3a-b226-6882ae755671 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:40.942723 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3d374a24-fed6-4e3a-b226-6882ae755671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:40.961873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:40.974961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a216a45-2122-4d0a-bdd1-ead975c66b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:40.976257 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a216a45-2122-4d0a-bdd1-ead975c66b2b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:40.976542 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a216a45-2122-4d0a-bdd1-ead975c66b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:40.976815 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a216a45-2122-4d0a-bdd1-ead975c66b2b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:40.991738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a216a45-2122-4d0a-bdd1-ead975c66b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:41.000725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-3a216a45-2122-4d0a-bdd1-ead975c66b2b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:15:41.000725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:41.000725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:41.000725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:41.000725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:41.000725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:41.000725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:41.000725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:41.000725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:41.000725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:41.000725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:41.000725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:41.000725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:41.000725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:41.000725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:41.000725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:41.001865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:41.001865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:41.001865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:41.001865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:41.001865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:41.001865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:41.001865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:41.001865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:41.001865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:41.001865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:41.001865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:41.001865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:41.001865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:41.001865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:41.001865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:41.001865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:41.003134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:41.003134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:41.003134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:41.003134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:41.003134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:41.003134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:41.003134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:41.003134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:41.003134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:41.003134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:41.003134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:15:41.003134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:41.003134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 468/940] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Jul 12 18:15:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:41.008758 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a216a45-2122-4d0a-bdd1-ead975c66b2b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:41.036885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 473/941] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:15:41.059280 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d374a24-fed6-4e3a-b226-6882ae755671 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:41.122375 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a216a45-2122-4d0a-bdd1-ead975c66b2b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:41.171473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da728a7-91ae-4fe6-85fd-b1998c32cbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:41.172421 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da728a7-91ae-4fe6-85fd-b1998c32cbaa None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:41.172709 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da728a7-91ae-4fe6-85fd-b1998c32cbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:41.172989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da728a7-91ae-4fe6-85fd-b1998c32cbaa None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:41.173772 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da728a7-91ae-4fe6-85fd-b1998c32cbaa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:41.174085 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da728a7-91ae-4fe6-85fd-b1998c32cbaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:41.174767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:41.176871 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da728a7-91ae-4fe6-85fd-b1998c32cbaa None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:41.179950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d374a24-fed6-4e3a-b226-6882ae755671 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:41.188296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 469/942] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Jul 12 18:15:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:41.193901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da728a7-91ae-4fe6-85fd-b1998c32cbaa None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:41.218965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa599a-5a85-4cfb-9ecd-9a9d0726e4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:41.220116 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa599a-5a85-4cfb-9ecd-9a9d0726e4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:41.220625 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa599a-5a85-4cfb-9ecd-9a9d0726e4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:41.221116 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa599a-5a85-4cfb-9ecd-9a9d0726e4b9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:41.222065 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa599a-5a85-4cfb-9ecd-9a9d0726e4b9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:41.224247 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa599a-5a85-4cfb-9ecd-9a9d0726e4b9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:41.236803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-f6aa599a-5a85-4cfb-9ecd-9a9d0726e4b9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:15:41.236803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:41.236803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:41.236803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:41.236803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:41.236803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:41.236803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:41.236803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:41.236803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:15:41.236803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:41.236803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:41.236803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:41.236803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:41.236803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:41.236803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:41.236803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:41.236803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:41.237887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:41.237887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:41.237887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:41.237887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:41.237887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:41.237887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:41.237887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:41.237887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:41.237887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:41.237887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:41.237887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:41.237887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:41.237887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:41.237887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:41.237887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:41.237887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:41.238769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:41.238769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:41.238769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:41.238769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:41.238769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:41.238769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:41.238769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:41.238769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:41.238769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:41.238769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:41.238769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:41.238769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:41.238769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:15:41.238769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:41.241620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 474/943] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:41.247627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa599a-5a85-4cfb-9ecd-9a9d0726e4b9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:41.258052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:41.326486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da728a7-91ae-4fe6-85fd-b1998c32cbaa None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:41.366873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ebe74-04bd-4358-beb9-6e8ce6b5912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:41.367964 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ebe74-04bd-4358-beb9-6e8ce6b5912e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:41.368466 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ebe74-04bd-4358-beb9-6e8ce6b5912e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:41.368934 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ebe74-04bd-4358-beb9-6e8ce6b5912e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:41.369176 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa599a-5a85-4cfb-9ecd-9a9d0726e4b9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:41.381387 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ebe74-04bd-4358-beb9-6e8ce6b5912e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:41.383095 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ebe74-04bd-4358-beb9-6e8ce6b5912e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:41.402191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-4f5ebe74-04bd-4358-beb9-6e8ce6b5912e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:41.402191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:41.402191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:41.402191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:41.402191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:41.402191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:41.402191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:41.402191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:41.402191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:41.402191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:41.402191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:41.402191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:41.402191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:41.402191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:41.402191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:41.403132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:41.403132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:41.403132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:41.403132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:41.403132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:41.403132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:41.403132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:41.403132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:41.403132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:41.403132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:41.403132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:41.403132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:41.403132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:41.403132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:41.403132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:41.403132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:41.403132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:41.404032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:41.404032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:41.404032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:41.404032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:41.406389 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 470/944] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:41.411429 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a85947-7b05-47fa-ad16-cbd0a2b5e43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:41.412097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a85947-7b05-47fa-ad16-cbd0a2b5e43c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:41.412378 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a85947-7b05-47fa-ad16-cbd0a2b5e43c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:41.412652 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a85947-7b05-47fa-ad16-cbd0a2b5e43c None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:41.413383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a85947-7b05-47fa-ad16-cbd0a2b5e43c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:41.413690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a85947-7b05-47fa-ad16-cbd0a2b5e43c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:41.414341 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ebe74-04bd-4358-beb9-6e8ce6b5912e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:41.415067 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a85947-7b05-47fa-ad16-cbd0a2b5e43c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:41.420573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 475/945] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Jul 12 18:15:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:41.426838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a85947-7b05-47fa-ad16-cbd0a2b5e43c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:41.455454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:41.517581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ebe74-04bd-4358-beb9-6e8ce6b5912e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:41.533795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:41.548395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a85947-7b05-47fa-ad16-cbd0a2b5e43c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:41.553883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528eef9-faa3-4511-81f1-5d4b023ab49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:41.554669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528eef9-faa3-4511-81f1-5d4b023ab49b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:41.555055 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528eef9-faa3-4511-81f1-5d4b023ab49b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:41.555507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528eef9-faa3-4511-81f1-5d4b023ab49b None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:41.556339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528eef9-faa3-4511-81f1-5d4b023ab49b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:41.556772 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528eef9-faa3-4511-81f1-5d4b023ab49b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:41.558296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528eef9-faa3-4511-81f1-5d4b023ab49b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:41.576555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 471/946] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:41.589288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528eef9-faa3-4511-81f1-5d4b023ab49b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:41.591227 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14e24c-14c8-4a37-bd4f-ee8c87fa4c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:41.592439 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14e24c-14c8-4a37-bd4f-ee8c87fa4c42 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:41.592826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14e24c-14c8-4a37-bd4f-ee8c87fa4c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:41.593202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14e24c-14c8-4a37-bd4f-ee8c87fa4c42 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:41.594423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14e24c-14c8-4a37-bd4f-ee8c87fa4c42 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:41.594833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14e24c-14c8-4a37-bd4f-ee8c87fa4c42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:41.596911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14e24c-14c8-4a37-bd4f-ee8c87fa4c42 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:41.609377 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 476/947] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Jul 12 18:15:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:41.696307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528eef9-faa3-4511-81f1-5d4b023ab49b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:41.733737 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2acfb-408a-46bb-a6eb-046662c3351a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:41.734471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2acfb-408a-46bb-a6eb-046662c3351a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:41.734748 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2acfb-408a-46bb-a6eb-046662c3351a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:41.735021 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2acfb-408a-46bb-a6eb-046662c3351a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:41.743646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2acfb-408a-46bb-a6eb-046662c3351a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:41.745111 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2acfb-408a-46bb-a6eb-046662c3351a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:41.762031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-f0d2acfb-408a-46bb-a6eb-046662c3351a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:15:41.762031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:41.762031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:41.762031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:41.762031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:41.762031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:41.762031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:41.762031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:41.762031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:41.762031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:41.762031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:41.762031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:41.762031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:41.762031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:41.762031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:41.762031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:41.764014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:41.764014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:41.764014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:41.764014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:41.764014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:41.764014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:41.764014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:41.764014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:41.764014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:41.764014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:41.764014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:41.764014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:41.764014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:41.764014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:41.764014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:41.764014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:41.764014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:41.764014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:41.766032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:41.766032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:41.766032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:41.766032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:41.766032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:41.766032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:41.766032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:41.766032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:41.766032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:15:41.766032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:41.766032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 472/948] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Jul 12 18:15:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:41.769309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14e24c-14c8-4a37-bd4f-ee8c87fa4c42 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:41.864468 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:41.874779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14e24c-14c8-4a37-bd4f-ee8c87fa4c42 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:41.910177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0709155-74b7-4dfe-b91a-397c70608f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:41.910885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0709155-74b7-4dfe-b91a-397c70608f0d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:41.911166 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0709155-74b7-4dfe-b91a-397c70608f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:41.911444 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0709155-74b7-4dfe-b91a-397c70608f0d None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:41.912280 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0709155-74b7-4dfe-b91a-397c70608f0d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:41.912590 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0709155-74b7-4dfe-b91a-397c70608f0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:41.914061 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0709155-74b7-4dfe-b91a-397c70608f0d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:41.932717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 477/949] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Jul 12 18:15:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:41.938099 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2acfb-408a-46bb-a6eb-046662c3351a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:41.962487 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:42.045949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2acfb-408a-46bb-a6eb-046662c3351a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:42.088888 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41841cb-1f6e-4003-b4ed-fdc1f231a631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:42.089852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41841cb-1f6e-4003-b4ed-fdc1f231a631 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:42.090181 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41841cb-1f6e-4003-b4ed-fdc1f231a631 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:42.090502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41841cb-1f6e-4003-b4ed-fdc1f231a631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:42.103805 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41841cb-1f6e-4003-b4ed-fdc1f231a631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:42.105518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41841cb-1f6e-4003-b4ed-fdc1f231a631 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:42.126588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-b41841cb-1f6e-4003-b4ed-fdc1f231a631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:42.126588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:42.126588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:42.126588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:42.126588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:42.126588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:42.126588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:42.126588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:42.126588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:42.126588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:42.126588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:42.126588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:42.126588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:42.126588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:42.126588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:42.128724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:42.128724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:42.128724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:42.128724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:42.128724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:42.128724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:42.128724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:42.128724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:42.128724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:42.128724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:42.128724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:42.128724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:42.128724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:42.128724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:42.128724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:42.128724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:42.128724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:42.131014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:42.131014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:42.131014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:42.131014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:42.131014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 473/950] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:42.134407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0709155-74b7-4dfe-b91a-397c70608f0d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:42.248866 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0709155-74b7-4dfe-b91a-397c70608f0d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:42.296305 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e061f0-9bfa-4c1f-827b-37532abe3c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:42.297038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e061f0-9bfa-4c1f-827b-37532abe3c61 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:42.297489 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e061f0-9bfa-4c1f-827b-37532abe3c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:42.297824 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e061f0-9bfa-4c1f-827b-37532abe3c61 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:42.298735 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e061f0-9bfa-4c1f-827b-37532abe3c61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:42.299091 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e061f0-9bfa-4c1f-827b-37532abe3c61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:42.300678 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e061f0-9bfa-4c1f-827b-37532abe3c61 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:42.315408 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 478/951] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:42.320811 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41841cb-1f6e-4003-b4ed-fdc1f231a631 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:42.402271 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:42.437755 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41841cb-1f6e-4003-b4ed-fdc1f231a631 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:42.477926 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873eb68b-47f2-4330-8a12-ef2ef6e2533b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:42.478818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eb68b-47f2-4330-8a12-ef2ef6e2533b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:42.479146 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eb68b-47f2-4330-8a12-ef2ef6e2533b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:42.479469 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eb68b-47f2-4330-8a12-ef2ef6e2533b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:42.487645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873eb68b-47f2-4330-8a12-ef2ef6e2533b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:42.489948 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873eb68b-47f2-4330-8a12-ef2ef6e2533b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:42.506900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-873eb68b-47f2-4330-8a12-ef2ef6e2533b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:42.506900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:42.506900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:42.506900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:42.506900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:42.506900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:42.506900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:42.506900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:42.506900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:42.506900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:42.506900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:42.506900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:42.506900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:42.506900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:42.506900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:42.509155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:42.509155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:42.509155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:42.509155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:42.509155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:42.509155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:42.509155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:42.509155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:42.509155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:42.509155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:42.509155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:42.509155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:42.509155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:42.509155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:42.509155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:42.509155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:42.509155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:42.510501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:42.510501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:42.510501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:42.510501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:42.510501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:42.510501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:42.510501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:42.510501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:42.510501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 474/952] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:42.514094 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e061f0-9bfa-4c1f-827b-37532abe3c61 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:42.527711 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:42.621348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e061f0-9bfa-4c1f-827b-37532abe3c61 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:42.656418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2d740-a3e3-4149-a219-eda4de9d5d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:42.657074 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2d740-a3e3-4149-a219-eda4de9d5d0a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:42.657391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2d740-a3e3-4149-a219-eda4de9d5d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:42.657672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2d740-a3e3-4149-a219-eda4de9d5d0a None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:42.658456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2d740-a3e3-4149-a219-eda4de9d5d0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:42.658765 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2d740-a3e3-4149-a219-eda4de9d5d0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:42.660205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2d740-a3e3-4149-a219-eda4de9d5d0a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:42.673959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 479/953] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:42.679599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873eb68b-47f2-4330-8a12-ef2ef6e2533b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:42.787255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873eb68b-47f2-4330-8a12-ef2ef6e2533b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:42.818583 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:42.822359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15c010-1375-446b-b6dd-19399a0f5f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:42.825503 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15c010-1375-446b-b6dd-19399a0f5f7e None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:42.825503 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15c010-1375-446b-b6dd-19399a0f5f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:42.825503 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15c010-1375-446b-b6dd-19399a0f5f7e None admin] PATH_INFO: `/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/54189575a60a4d9dbaabb78d44e9c31e/roles/70c740362c964f449be0b5c279cb35c0` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:42.826326 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15c010-1375-446b-b6dd-19399a0f5f7e None admin] RBAC: Authorizing `identity:create_grant(project_id=5fee99b2e9234f88ac79ff70429b6f20, user_id=54189575a60a4d9dbaabb78d44e9c31e, role_id=70c740362c964f449be0b5c279cb35c0)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:42.827837 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15c010-1375-446b-b6dd-19399a0f5f7e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:42.843205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 475/954] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:15:42 2022] PUT /identity/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/54189575a60a4d9dbaabb78d44e9c31e/roles/70c740362c964f449be0b5c279cb35c0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:15:42.915200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8e482-97cd-4bd6-b242-79ecdd2a6054 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:42.915756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8e482-97cd-4bd6-b242-79ecdd2a6054 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:42.915845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8e482-97cd-4bd6-b242-79ecdd2a6054 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:42.917477 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 480/955] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:42.923407 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd643b-8a68-451f-a01f-7315da0c68af None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:42.924033 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd643b-8a68-451f-a01f-7315da0c68af None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:42.924526 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd643b-8a68-451f-a01f-7315da0c68af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:42.944217 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-bcbd643b-8a68-451f-a01f-7315da0c68af None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:42.945860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-bcbd643b-8a68-451f-a01f-7315da0c68af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:43.025343 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 476/956] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:43.047150 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8e482-97cd-4bd6-b242-79ecdd2a6054 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:43.110752 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cf883-afd6-4c52-938d-07f46d01e4aa None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:43.111081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cf883-afd6-4c52-938d-07f46d01e4aa None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:43.111252 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cf883-afd6-4c52-938d-07f46d01e4aa None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:43.112675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 477/957] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:43.117791 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c5c09-b69b-4a17-bc56-11c71ba0be66 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:43.118306 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c5c09-b69b-4a17-bc56-11c71ba0be66 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:43.118805 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c5c09-b69b-4a17-bc56-11c71ba0be66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:43.122534 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:43.137753 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-411c5c09-b69b-4a17-bc56-11c71ba0be66 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:43.139598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-411c5c09-b69b-4a17-bc56-11c71ba0be66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:43.161156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8e482-97cd-4bd6-b242-79ecdd2a6054 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:43.203976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b5e57-0711-4df9-8892-b8eabf87b021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:43.204966 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b5e57-0711-4df9-8892-b8eabf87b021 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:43.205373 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b5e57-0711-4df9-8892-b8eabf87b021 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:43.205747 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b5e57-0711-4df9-8892-b8eabf87b021 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:43.206487 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b5e57-0711-4df9-8892-b8eabf87b021 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:43.209006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b5e57-0711-4df9-8892-b8eabf87b021 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:43.229278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-205b5e57-0711-4df9-8892-b8eabf87b021 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:15:43.229278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:43.229278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:43.229278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:43.229278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:43.229278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:43.229278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:43.229278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:43.229278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:15:43.229278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:43.229278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:43.229278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:43.229278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:43.229278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:43.229278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:43.229278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:43.229278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:43.230453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:43.230453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:43.230453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:43.230453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:43.230453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:43.230453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:43.230453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:43.230453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:43.230453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:43.230453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:43.230453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:43.230453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:43.230453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:43.230453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:43.230453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:43.230453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:43.231371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:43.231371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:43.231371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:43.231371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:43.231371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:43.231371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:43.231371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:43.231371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:43.231371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:43.231371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:43.231371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:43.231371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:43.231371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:15:43.231371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:43.231371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 481/959] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Jul 12 18:15:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:43.232213 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 478/959] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:15:43.236459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b5e57-0711-4df9-8892-b8eabf87b021 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:43.257357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c5c09-b69b-4a17-bc56-11c71ba0be66 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:43.347731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:43.357744 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b5e57-0711-4df9-8892-b8eabf87b021 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:43.392104 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:43.400064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96383135-2ebe-4159-877b-c4a046a4a0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:43.401444 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96383135-2ebe-4159-877b-c4a046a4a0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:43.402366 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96383135-2ebe-4159-877b-c4a046a4a0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:43.402837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96383135-2ebe-4159-877b-c4a046a4a0b6 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:43.404229 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96383135-2ebe-4159-877b-c4a046a4a0b6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:43.404876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96383135-2ebe-4159-877b-c4a046a4a0b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:43.406730 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96383135-2ebe-4159-877b-c4a046a4a0b6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:43.412582 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c5c09-b69b-4a17-bc56-11c71ba0be66 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:43.418398 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 482/960] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Jul 12 18:15:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:43.420772 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96383135-2ebe-4159-877b-c4a046a4a0b6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:43.454402 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed958ddd-26d2-44d5-b5f2-b718fa9bfb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:43.455148 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed958ddd-26d2-44d5-b5f2-b718fa9bfb99 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:43.455427 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed958ddd-26d2-44d5-b5f2-b718fa9bfb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:43.455697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed958ddd-26d2-44d5-b5f2-b718fa9bfb99 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:43.456408 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed958ddd-26d2-44d5-b5f2-b718fa9bfb99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:43.457932 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed958ddd-26d2-44d5-b5f2-b718fa9bfb99 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:43.459282 dv-cinder-835384-15-smb devstack@keystone.service[80227]: WARNING keystone.server.flask.common [None req-ed958ddd-26d2-44d5-b5f2-b718fa9bfb99 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 18:15:43.472500 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.sql.core [None req-ed958ddd-26d2-44d5-b5f2-b718fa9bfb99 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 18:15:43.472500 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 18:15:43.472500 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [parameters: {'user_id': '7ce43468a462483a89ab81b97a5be24e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 18:15:43.472500 dv-cinder-835384-15-smb devstack@keystone.service[80227]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80227) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 18:15:43.494584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-ed958ddd-26d2-44d5-b5f2-b718fa9bfb99 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 18:15:43.494584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:43.494584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 18:15:43.494584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 18:15:43.494584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 18:15:43.494584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 18:15:43.494584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 18:15:43.494584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 18:15:43.494584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 18:15:43.494584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application conn.query(q) Jul 12 18:15:43.494584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 18:15:43.494584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 18:15:43.494584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 18:15:43.494584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application result.read() Jul 12 18:15:43.494584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 18:15:43.495844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 18:15:43.495844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 18:15:43.495844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 18:15:43.495844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 18:15:43.495844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 18:15:43.495844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 18:15:43.495844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 18:15:43.495844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 18:15:43.495844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:43.495844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 18:15:43.495844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:43.495844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:43.495844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 18:15:43.495844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 18:15:43.495844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 12 18:15:43.495844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 12 18:15:43.495844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 18:15:43.495844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application next(self.gen) Jul 12 18:15:43.497358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 18:15:43.497358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application yield resource Jul 12 18:15:43.497358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 18:15:43.497358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application next(self.gen) Jul 12 18:15:43.497358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 18:15:43.497358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 18:15:43.497358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 18:15:43.497358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 18:15:43.497358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 18:15:43.497358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise self.value Jul 12 18:15:43.497358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 18:15:43.497358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 18:15:43.497358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 18:15:43.497358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application session.commit() Jul 12 18:15:43.497358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 18:15:43.497358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 18:15:43.497358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 18:15:43.498544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 18:15:43.498544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 18:15:43.498544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self.session.flush() Jul 12 18:15:43.498544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 18:15:43.498544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 18:15:43.498544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 18:15:43.498544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 18:15:43.498544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 18:15:43.498544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application compat.raise_( Jul 12 18:15:43.498544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 18:15:43.498544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception Jul 12 18:15:43.498544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 18:15:43.498544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 18:15:43.498544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 18:15:43.498544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 18:15:43.498544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 18:15:43.498544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 18:15:43.499759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 18:15:43.499759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 18:15:43.499759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 12 18:15:43.499759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 12 18:15:43.499759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 18:15:43.499759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 18:15:43.499759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 18:15:43.499759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 18:15:43.499759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 18:15:43.499759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 18:15:43.499759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 18:15:43.499759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 18:15:43.499759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 18:15:43.499759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 18:15:43.499759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 18:15:43.499759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception Jul 12 18:15:43.500974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 18:15:43.500974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 18:15:43.500974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 18:15:43.500974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 18:15:43.500974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 18:15:43.500974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 18:15:43.500974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 18:15:43.500974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application conn.query(q) Jul 12 18:15:43.500974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 18:15:43.500974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 18:15:43.500974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 18:15:43.500974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application result.read() Jul 12 18:15:43.500974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 18:15:43.500974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 18:15:43.500974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 18:15:43.500974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 18:15:43.503465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 18:15:43.503465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 18:15:43.503465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 18:15:43.503465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 18:15:43.503465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 18:15:43.503465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 18:15:43.503465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [parameters: {'user_id': '7ce43468a462483a89ab81b97a5be24e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 18:15:43.503465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 18:15:43.503465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:43.503465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:43.503465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:43.503465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:43.503465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:43.503465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:43.503465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:43.507311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:43.507311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:43.507311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:43.507311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:43.507311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:43.507311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:43.507311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:43.507311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 12 18:15:43.507311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 12 18:15:43.507311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:43.507311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:43.507311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:43.507311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:43.507311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:43.507311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:43.507311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 12 18:15:43.507311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 12 18:15:43.508523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 12 18:15:43.508523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 12 18:15:43.508523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 18:15:43.508523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 18:15:43.508523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 18:15:43.508523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:43.508523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 479/961] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Jul 12 18:15:43 2022] POST /identity/v3/users => generated 160 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:43.508523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed958ddd-26d2-44d5-b5f2-b718fa9bfb99 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:43.578728 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96383135-2ebe-4159-877b-c4a046a4a0b6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:43.626584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080330e-e19c-40ee-b0a0-48c9030b8dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:43.627622 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080330e-e19c-40ee-b0a0-48c9030b8dce None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:43.628090 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080330e-e19c-40ee-b0a0-48c9030b8dce None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:43.628557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080330e-e19c-40ee-b0a0-48c9030b8dce None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:43.629510 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080330e-e19c-40ee-b0a0-48c9030b8dce None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:43.630000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080330e-e19c-40ee-b0a0-48c9030b8dce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:43.631569 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080330e-e19c-40ee-b0a0-48c9030b8dce None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:43.636380 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed958ddd-26d2-44d5-b5f2-b718fa9bfb99 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:43.641421 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 483/962] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Jul 12 18:15:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:43.643403 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080330e-e19c-40ee-b0a0-48c9030b8dce None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:43.652663 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:43.681077 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cf06a-b07c-40d2-9a6a-ca7144eed773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:43.682234 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cf06a-b07c-40d2-9a6a-ca7144eed773 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:43.682582 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cf06a-b07c-40d2-9a6a-ca7144eed773 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:43.683332 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cf06a-b07c-40d2-9a6a-ca7144eed773 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:43.693189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cf06a-b07c-40d2-9a6a-ca7144eed773 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:43.695466 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cf06a-b07c-40d2-9a6a-ca7144eed773 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:43.716994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-999cf06a-b07c-40d2-9a6a-ca7144eed773 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:15:43.716994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:43.716994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:43.716994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:43.716994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:43.716994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:43.716994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:43.716994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:43.716994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:43.716994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:43.716994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:43.716994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:43.716994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:43.716994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:43.716994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:43.716994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:43.718042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:43.718042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:43.718042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:43.718042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:43.718042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:43.718042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:43.718042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:43.718042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:43.718042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:43.718042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:43.718042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:43.718042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:43.718042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:43.718042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:43.718042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:43.718042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:43.718042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:43.718042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:43.718998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:43.718998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:43.718998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:43.718998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:43.718998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:43.718998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:43.718998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:43.718998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:43.718998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:15:43.718998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:43.724329 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:43.724450 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 480/963] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:15:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:43.725289 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cf06a-b07c-40d2-9a6a-ca7144eed773 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:43.782814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080330e-e19c-40ee-b0a0-48c9030b8dce None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:43.826834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afd886-cdec-4e31-96c9-d63312788964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:43.827069 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cf06a-b07c-40d2-9a6a-ca7144eed773 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:43.827476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afd886-cdec-4e31-96c9-d63312788964 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:43.827775 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afd886-cdec-4e31-96c9-d63312788964 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:43.828029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afd886-cdec-4e31-96c9-d63312788964 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:43.829378 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afd886-cdec-4e31-96c9-d63312788964 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:43.830795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afd886-cdec-4e31-96c9-d63312788964 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:43.850035 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 484/964] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Jul 12 18:15:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:15:43.851321 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3c7e2-acff-4b8f-8465-baa25e1dd3c9 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:43.851610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3c7e2-acff-4b8f-8465-baa25e1dd3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:43.851886 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3c7e2-acff-4b8f-8465-baa25e1dd3c9 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:43.857414 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 485/965] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:43.859069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fd8cc-26c8-4daf-b045-1f42475d7f07 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:43.859189 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fd8cc-26c8-4daf-b045-1f42475d7f07 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:43.859408 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fd8cc-26c8-4daf-b045-1f42475d7f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:43.881122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fdb26-ebee-4919-bf48-cccf481f8de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:43.881828 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fdb26-ebee-4919-bf48-cccf481f8de0 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:43.882109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fdb26-ebee-4919-bf48-cccf481f8de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:43.882381 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fdb26-ebee-4919-bf48-cccf481f8de0 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:43.883195 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fdb26-ebee-4919-bf48-cccf481f8de0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:43.883497 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fdb26-ebee-4919-bf48-cccf481f8de0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:43.884981 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fdb26-ebee-4919-bf48-cccf481f8de0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:43.888511 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b57fd8cc-26c8-4daf-b045-1f42475d7f07 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:43.890148 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b57fd8cc-26c8-4daf-b045-1f42475d7f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:43.924583 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 481/966] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Jul 12 18:15:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:43.969454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 486/967] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:43.994790 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fdb26-ebee-4919-bf48-cccf481f8de0 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:44.032746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:44.114795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fdb26-ebee-4919-bf48-cccf481f8de0 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:44.154875 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d501d-3d13-49a1-ba70-57f13a986d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:44.155579 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d501d-3d13-49a1-ba70-57f13a986d5e None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:44.155821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d501d-3d13-49a1-ba70-57f13a986d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:44.156090 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d501d-3d13-49a1-ba70-57f13a986d5e None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:44.156809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d501d-3d13-49a1-ba70-57f13a986d5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:44.158268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d501d-3d13-49a1-ba70-57f13a986d5e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:44.176109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 482/968] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Jul 12 18:15:43 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:15:44.997611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd311f4-5ce0-46ec-a8b7-aab3111a35ed None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:44.998168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd311f4-5ce0-46ec-a8b7-aab3111a35ed None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:44.998168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd311f4-5ce0-46ec-a8b7-aab3111a35ed None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:44.999736 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 487/969] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:45.005972 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c021bdd-0718-4ae5-b8a1-2b8fb2be12bb None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:45.006467 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c021bdd-0718-4ae5-b8a1-2b8fb2be12bb None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:45.006560 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c021bdd-0718-4ae5-b8a1-2b8fb2be12bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:45.023917 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8c021bdd-0718-4ae5-b8a1-2b8fb2be12bb None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:45.025465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8c021bdd-0718-4ae5-b8a1-2b8fb2be12bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:45.101121 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 483/970] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:45.124105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd311f4-5ce0-46ec-a8b7-aab3111a35ed None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:45.172456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:45.229008 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd311f4-5ce0-46ec-a8b7-aab3111a35ed None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:45.263425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11feb20-b455-4eb2-99b4-037c497fa4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:45.264165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11feb20-b455-4eb2-99b4-037c497fa4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:45.264448 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11feb20-b455-4eb2-99b4-037c497fa4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:45.264722 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11feb20-b455-4eb2-99b4-037c497fa4c2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:45.274936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11feb20-b455-4eb2-99b4-037c497fa4c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:45.283363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-e11feb20-b455-4eb2-99b4-037c497fa4c2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:15:45.283363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:45.283363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:45.283363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:45.283363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:45.283363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:45.283363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:45.283363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:45.283363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:45.283363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:45.283363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:45.283363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:45.283363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:45.283363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:45.283363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:45.283363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:45.284335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:45.284335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:45.284335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:45.284335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:45.284335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:45.284335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:45.284335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:45.284335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:45.284335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:45.284335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:45.284335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:45.284335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:45.284335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:45.284335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:45.284335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:45.284335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:45.285182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:45.285182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:45.285182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:45.285182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:45.285182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:45.285182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:45.285182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:45.285182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:45.285182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:45.285182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:45.285182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:15:45.285182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:45.289644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 488/971] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Jul 12 18:15:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:45.290919 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c021bdd-0718-4ae5-b8a1-2b8fb2be12bb None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:45.308278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:45.397404 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c021bdd-0718-4ae5-b8a1-2b8fb2be12bb None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:45.431561 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ced74-dd6d-4b3c-bfdd-5084a8a73d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:45.432232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ced74-dd6d-4b3c-bfdd-5084a8a73d4b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:45.432572 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ced74-dd6d-4b3c-bfdd-5084a8a73d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:45.432861 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ced74-dd6d-4b3c-bfdd-5084a8a73d4b None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:45.433707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ced74-dd6d-4b3c-bfdd-5084a8a73d4b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:45.434021 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ced74-dd6d-4b3c-bfdd-5084a8a73d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:45.435431 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ced74-dd6d-4b3c-bfdd-5084a8a73d4b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:45.449228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 484/972] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Jul 12 18:15:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:45.450216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11feb20-b455-4eb2-99b4-037c497fa4c2 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:45.551843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11feb20-b455-4eb2-99b4-037c497fa4c2 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:45.559485 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:45.591742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682c072-3f74-41ec-906e-175b90d1b270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:45.592531 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682c072-3f74-41ec-906e-175b90d1b270 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:45.592811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682c072-3f74-41ec-906e-175b90d1b270 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:45.593081 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682c072-3f74-41ec-906e-175b90d1b270 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:45.604453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682c072-3f74-41ec-906e-175b90d1b270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:45.605921 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682c072-3f74-41ec-906e-175b90d1b270 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:45.623715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-d682c072-3f74-41ec-906e-175b90d1b270 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:45.623715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:45.623715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:45.623715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:45.623715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:45.623715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:45.623715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:45.623715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:45.623715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:45.623715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:45.623715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:45.623715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:45.623715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:45.623715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:45.623715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:45.624612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:45.624612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:45.624612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:45.624612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:45.624612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:45.624612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:45.624612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:45.624612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:45.624612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:45.624612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:45.624612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:45.624612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:45.624612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:45.624612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:45.624612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:45.624612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:45.624612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:45.630176 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:45.630176 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:45.630176 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:45.630176 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:45.630176 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 489/973] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:45.632346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ced74-dd6d-4b3c-bfdd-5084a8a73d4b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:45.713912 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:45.741714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ced74-dd6d-4b3c-bfdd-5084a8a73d4b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:45.775352 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74941987-aa25-42f1-98b0-1392f58c6622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:45.776027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941987-aa25-42f1-98b0-1392f58c6622 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:45.776313 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941987-aa25-42f1-98b0-1392f58c6622 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:45.776591 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941987-aa25-42f1-98b0-1392f58c6622 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:45.777343 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74941987-aa25-42f1-98b0-1392f58c6622 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:45.777656 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74941987-aa25-42f1-98b0-1392f58c6622 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:45.779033 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74941987-aa25-42f1-98b0-1392f58c6622 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:45.795953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 485/974] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:45.797223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682c072-3f74-41ec-906e-175b90d1b270 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:45.901541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682c072-3f74-41ec-906e-175b90d1b270 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:45.935453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635f074-b01d-4ab3-b34b-b6f7a06f03ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:45.936261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635f074-b01d-4ab3-b34b-b6f7a06f03ac None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:45.936547 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635f074-b01d-4ab3-b34b-b6f7a06f03ac None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:45.936822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635f074-b01d-4ab3-b34b-b6f7a06f03ac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:45.944487 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635f074-b01d-4ab3-b34b-b6f7a06f03ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:45.945961 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635f074-b01d-4ab3-b34b-b6f7a06f03ac None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:45.961713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-3635f074-b01d-4ab3-b34b-b6f7a06f03ac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:15:45.961713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:45.961713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:45.961713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:45.961713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:45.961713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:45.961713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:45.961713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:45.961713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:45.961713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:45.961713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:45.961713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:45.961713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:45.961713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:45.961713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:45.961713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:45.962696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:45.962696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:45.962696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:45.962696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:45.962696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:45.962696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:45.962696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:45.962696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:45.962696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:45.962696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:45.962696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:45.962696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:45.962696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:45.962696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:45.962696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:45.962696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:45.962696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:45.962696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:45.970066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:45.970066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:45.970066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:45.970066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:45.970066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:45.970066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:45.970066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:45.970066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:45.970066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:15:45.970066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:45.970066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 490/975] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Jul 12 18:15:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:45.972317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74941987-aa25-42f1-98b0-1392f58c6622 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:45.980789 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee401fe-5036-4823-b35c-1e4aed1c667c None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:45.981198 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee401fe-5036-4823-b35c-1e4aed1c667c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:45.981603 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee401fe-5036-4823-b35c-1e4aed1c667c None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:45.983663 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 491/976] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:15:45.988407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459adbd-274e-46e7-9e25-d0cdaf66bd13 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:45.988785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459adbd-274e-46e7-9e25-d0cdaf66bd13 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:45.989136 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459adbd-274e-46e7-9e25-d0cdaf66bd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:46.006433 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-f459adbd-274e-46e7-9e25-d0cdaf66bd13 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:46.007767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f459adbd-274e-46e7-9e25-d0cdaf66bd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:46.024603 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:46.087353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74941987-aa25-42f1-98b0-1392f58c6622 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:46.093197 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 492/977] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:15:46.119239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459adbd-274e-46e7-9e25-d0cdaf66bd13 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:46.125895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f52e4b-52bb-40ab-a479-1f6d9df5a601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:46.126571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f52e4b-52bb-40ab-a479-1f6d9df5a601 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:46.126852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f52e4b-52bb-40ab-a479-1f6d9df5a601 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:46.127127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f52e4b-52bb-40ab-a479-1f6d9df5a601 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:46.127965 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f52e4b-52bb-40ab-a479-1f6d9df5a601 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:46.128275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f52e4b-52bb-40ab-a479-1f6d9df5a601 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:46.129788 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f52e4b-52bb-40ab-a479-1f6d9df5a601 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:46.133196 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:46.154279 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 486/978] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Jul 12 18:15:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:46.155884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f52e4b-52bb-40ab-a479-1f6d9df5a601 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:46.230049 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459adbd-274e-46e7-9e25-d0cdaf66bd13 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:46.261900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f52e4b-52bb-40ab-a479-1f6d9df5a601 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:46.264620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c46b0-fc15-41b1-b741-cc6d584bb167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:46.265466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c46b0-fc15-41b1-b741-cc6d584bb167 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:46.265746 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c46b0-fc15-41b1-b741-cc6d584bb167 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:46.266024 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c46b0-fc15-41b1-b741-cc6d584bb167 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:46.266670 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c46b0-fc15-41b1-b741-cc6d584bb167 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:46.268040 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c46b0-fc15-41b1-b741-cc6d584bb167 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:46.282252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-611c46b0-fc15-41b1-b741-cc6d584bb167 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:15:46.282252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:46.282252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:46.282252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:46.282252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:46.282252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:46.282252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:46.282252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:46.282252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:15:46.282252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:46.282252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:46.282252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:46.282252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:46.282252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:46.282252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:46.282252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:46.282252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:46.283494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:46.283494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:46.283494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:46.283494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:46.283494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:46.283494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:46.283494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:46.283494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:46.283494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:46.283494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:46.283494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:46.283494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:46.283494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:46.283494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:46.283494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:46.283494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:46.284520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:46.284520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:46.284520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:46.284520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:46.284520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:46.284520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:46.284520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:46.284520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:46.284520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:46.284520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:46.284520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:46.284520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:46.284520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:15:46.284520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:46.284520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 493/979] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Jul 12 18:15:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:46.285573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f40d6e-d99f-4599-bd6a-5c8b23f8d10e None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:46.285573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f40d6e-d99f-4599-bd6a-5c8b23f8d10e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:46.285573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f40d6e-d99f-4599-bd6a-5c8b23f8d10e None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:46.286460 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 494/980] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:46.290039 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f40d6e-d99f-4599-bd6a-5c8b23f8d10e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:46.300617 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5294984-f4bc-40ee-b5c4-406353ccc0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:46.301319 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5294984-f4bc-40ee-b5c4-406353ccc0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:46.301604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5294984-f4bc-40ee-b5c4-406353ccc0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:46.301877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5294984-f4bc-40ee-b5c4-406353ccc0d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:46.306532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:46.368258 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:46.377726 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5294984-f4bc-40ee-b5c4-406353ccc0d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:46.379241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5294984-f4bc-40ee-b5c4-406353ccc0d1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:46.397052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f40d6e-d99f-4599-bd6a-5c8b23f8d10e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:46.431522 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a886627-ef57-499e-b7a1-c5945144c1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:46.432098 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a886627-ef57-499e-b7a1-c5945144c1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:46.432376 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a886627-ef57-499e-b7a1-c5945144c1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:46.432648 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a886627-ef57-499e-b7a1-c5945144c1f2 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:46.433374 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a886627-ef57-499e-b7a1-c5945144c1f2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:46.433678 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a886627-ef57-499e-b7a1-c5945144c1f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:46.435043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a886627-ef57-499e-b7a1-c5945144c1f2 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:46.439691 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 495/981] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Jul 12 18:15:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:46.440822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09ea4f-9609-44af-b5be-a81aec05e421 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:46.441109 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09ea4f-9609-44af-b5be-a81aec05e421 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:46.441409 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09ea4f-9609-44af-b5be-a81aec05e421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:46.457458 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-aa09ea4f-9609-44af-b5be-a81aec05e421 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:46.458632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-aa09ea4f-9609-44af-b5be-a81aec05e421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:46.481876 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 487/982] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:15:46 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 18:15:46.482725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5294984-f4bc-40ee-b5c4-406353ccc0d1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:46.525573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 496/983] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:46.526418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09ea4f-9609-44af-b5be-a81aec05e421 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:46.536519 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:46.578308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:46.585084 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5294984-f4bc-40ee-b5c4-406353ccc0d1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:46.619750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8079c-2120-4b06-bc6e-907b582823ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:46.620408 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8079c-2120-4b06-bc6e-907b582823ba None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:46.620687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8079c-2120-4b06-bc6e-907b582823ba None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:46.620959 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8079c-2120-4b06-bc6e-907b582823ba None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:46.621697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8079c-2120-4b06-bc6e-907b582823ba None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:46.622006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8079c-2120-4b06-bc6e-907b582823ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:46.623378 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8079c-2120-4b06-bc6e-907b582823ba None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:46.628199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 488/984] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Jul 12 18:15:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:46.628961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8079c-2120-4b06-bc6e-907b582823ba None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:46.630455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09ea4f-9609-44af-b5be-a81aec05e421 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:46.665691 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9722b2b-1b94-400e-979a-7645d45b7d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:46.666817 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9722b2b-1b94-400e-979a-7645d45b7d25 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:46.667107 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9722b2b-1b94-400e-979a-7645d45b7d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:46.667410 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9722b2b-1b94-400e-979a-7645d45b7d25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:46.677483 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9722b2b-1b94-400e-979a-7645d45b7d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:46.678927 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9722b2b-1b94-400e-979a-7645d45b7d25 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:46.696502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-d9722b2b-1b94-400e-979a-7645d45b7d25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:46.696502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:46.696502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:46.696502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:46.696502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:46.696502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:46.696502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:46.696502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:46.696502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:46.696502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:46.696502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:46.696502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:46.696502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:46.696502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:46.696502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:46.697616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:46.697616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:46.697616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:46.697616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:46.697616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:46.697616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:46.697616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:46.697616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:46.697616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:46.697616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:46.697616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:46.697616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:46.697616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:46.697616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:46.697616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:46.697616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:46.697616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:46.698881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:46.698881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:46.698881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:46.698881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:46.698881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 497/985] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:46.698881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9722b2b-1b94-400e-979a-7645d45b7d25 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:46.732363 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8079c-2120-4b06-bc6e-907b582823ba None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:46.756455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:46.765921 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c96fb-36cf-440a-9229-9fb4d231aab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:46.766715 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c96fb-36cf-440a-9229-9fb4d231aab2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:46.767000 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c96fb-36cf-440a-9229-9fb4d231aab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:46.767283 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c96fb-36cf-440a-9229-9fb4d231aab2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:46.767936 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c96fb-36cf-440a-9229-9fb4d231aab2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:46.769350 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c96fb-36cf-440a-9229-9fb4d231aab2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:46.781745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-b47c96fb-36cf-440a-9229-9fb4d231aab2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:15:46.781745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:46.781745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:46.781745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:46.781745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:46.781745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:46.781745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:46.781745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:46.781745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:15:46.781745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:46.781745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:46.781745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:46.781745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:46.781745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:46.781745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:46.781745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:46.781745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:46.782955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:46.782955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:46.782955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:46.782955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:46.782955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:46.782955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:46.782955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:46.782955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:46.782955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:46.782955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:46.782955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:46.782955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:46.782955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:46.782955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:46.782955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:46.782955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:46.783974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:46.783974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:46.783974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:46.783974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:46.783974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:46.783974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:46.783974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:46.783974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:46.783974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:46.783974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:46.783974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:46.783974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:46.783974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:15:46.783974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:46.783974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 489/986] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:46.784952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c96fb-36cf-440a-9229-9fb4d231aab2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:46.803276 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9722b2b-1b94-400e-979a-7645d45b7d25 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:46.809334 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:46.839230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68d8c6-cc88-42ec-ada5-728533d04a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:46.839887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68d8c6-cc88-42ec-ada5-728533d04a5a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:46.840171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68d8c6-cc88-42ec-ada5-728533d04a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:46.840446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68d8c6-cc88-42ec-ada5-728533d04a5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:46.841670 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68d8c6-cc88-42ec-ada5-728533d04a5a None admin] RBAC: Adding query filter params (interface=admin, service_id=7240e2e7984c459c88152d9c8bfcfc02, region_id=RegionOne) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:46.841987 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68d8c6-cc88-42ec-ada5-728533d04a5a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:46.843357 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68d8c6-cc88-42ec-ada5-728533d04a5a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:46.849052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 498/987] 10.222.0.57 () {56 vars in 1249 bytes} [Tue Jul 12 18:15:46 2022] GET /identity/v3/endpoints?service_id=7240e2e7984c459c88152d9c8bfcfc02&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:46.849855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68d8c6-cc88-42ec-ada5-728533d04a5a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:46.887540 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c96fb-36cf-440a-9229-9fb4d231aab2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:46.922720 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46835d68-6a5d-47e5-b605-4c21e6cc6ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:46.923383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46835d68-6a5d-47e5-b605-4c21e6cc6ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:46.923666 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46835d68-6a5d-47e5-b605-4c21e6cc6ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:46.923944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46835d68-6a5d-47e5-b605-4c21e6cc6ca9 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:46.924665 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46835d68-6a5d-47e5-b605-4c21e6cc6ca9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:46.924975 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46835d68-6a5d-47e5-b605-4c21e6cc6ca9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:46.926384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46835d68-6a5d-47e5-b605-4c21e6cc6ca9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:46.938289 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 490/988] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:46.939078 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46835d68-6a5d-47e5-b605-4c21e6cc6ca9 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:46.954394 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68d8c6-cc88-42ec-ada5-728533d04a5a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:46.977132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:46.988899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a2937-afbc-4cd8-afff-175c3869f954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:46.989594 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a2937-afbc-4cd8-afff-175c3869f954 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:46.989881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a2937-afbc-4cd8-afff-175c3869f954 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:46.990159 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a2937-afbc-4cd8-afff-175c3869f954 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:46.990859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a2937-afbc-4cd8-afff-175c3869f954 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:46.991177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a2937-afbc-4cd8-afff-175c3869f954 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:46.992549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a2937-afbc-4cd8-afff-175c3869f954 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:46.997334 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 499/989] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Jul 12 18:15:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:46.998103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a2937-afbc-4cd8-afff-175c3869f954 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:47.024843 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:47.043128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46835d68-6a5d-47e5-b605-4c21e6cc6ca9 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:47.078882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e482f59-cbfd-40ed-821b-c69a56050567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:47.079564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e482f59-cbfd-40ed-821b-c69a56050567 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:47.079849 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e482f59-cbfd-40ed-821b-c69a56050567 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:47.080123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e482f59-cbfd-40ed-821b-c69a56050567 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:47.080799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e482f59-cbfd-40ed-821b-c69a56050567 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:47.082226 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e482f59-cbfd-40ed-821b-c69a56050567 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:47.088861 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 491/990] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Jul 12 18:15:46 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:15:47.089661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e482f59-cbfd-40ed-821b-c69a56050567 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:47.097922 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a2937-afbc-4cd8-afff-175c3869f954 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:47.136143 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2f24b-48d8-46f7-a60d-154cbfdd1dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:47.136964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2f24b-48d8-46f7-a60d-154cbfdd1dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:47.137250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2f24b-48d8-46f7-a60d-154cbfdd1dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:47.137557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2f24b-48d8-46f7-a60d-154cbfdd1dd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:47.145921 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2f24b-48d8-46f7-a60d-154cbfdd1dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:47.147406 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2f24b-48d8-46f7-a60d-154cbfdd1dd6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:47.163156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-56b2f24b-48d8-46f7-a60d-154cbfdd1dd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:47.163156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:47.163156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:47.163156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:47.163156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:47.163156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:47.163156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:47.163156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:47.163156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:47.163156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:47.163156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:47.163156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:47.163156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:47.163156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:47.163156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:47.164144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:47.164144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:47.164144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:47.164144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:47.164144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:47.164144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:47.164144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:47.164144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:47.164144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:47.164144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:47.164144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:47.164144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:47.164144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:47.164144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:47.164144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:47.164144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:47.164144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:47.165040 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:47.165040 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:47.165040 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:47.165040 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:47.165040 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:47.165040 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:47.165040 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:47.165040 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:47.165040 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 500/991] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:47.170713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2f24b-48d8-46f7-a60d-154cbfdd1dd6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:47.206540 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e482f59-cbfd-40ed-821b-c69a56050567 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:47.226427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:47.246901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaed4cd-8df8-45b9-97b0-11623afd572f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:47.247564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaed4cd-8df8-45b9-97b0-11623afd572f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:47.247845 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaed4cd-8df8-45b9-97b0-11623afd572f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:47.248116 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaed4cd-8df8-45b9-97b0-11623afd572f None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:47.248823 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaed4cd-8df8-45b9-97b0-11623afd572f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:47.249127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaed4cd-8df8-45b9-97b0-11623afd572f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:47.250891 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaed4cd-8df8-45b9-97b0-11623afd572f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:47.257697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 492/992] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Jul 12 18:15:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:47.263397 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaed4cd-8df8-45b9-97b0-11623afd572f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:47.276133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:47.296761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2f24b-48d8-46f7-a60d-154cbfdd1dd6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:47.334630 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab37937-f613-4c45-be3a-e04140d3cdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:47.335287 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab37937-f613-4c45-be3a-e04140d3cdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:47.335567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab37937-f613-4c45-be3a-e04140d3cdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:47.335953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab37937-f613-4c45-be3a-e04140d3cdf5 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:47.336764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab37937-f613-4c45-be3a-e04140d3cdf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:47.337150 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab37937-f613-4c45-be3a-e04140d3cdf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:47.338616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab37937-f613-4c45-be3a-e04140d3cdf5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:47.351376 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 501/993] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:47.358449 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab37937-f613-4c45-be3a-e04140d3cdf5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:47.379651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaed4cd-8df8-45b9-97b0-11623afd572f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:47.418867 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05a1c1-e560-44dc-a0e5-7125028a9131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:47.419593 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05a1c1-e560-44dc-a0e5-7125028a9131 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:47.419874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05a1c1-e560-44dc-a0e5-7125028a9131 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:47.420149 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05a1c1-e560-44dc-a0e5-7125028a9131 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:47.421057 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05a1c1-e560-44dc-a0e5-7125028a9131 None admin] RBAC: Adding query filter params (interface=public, service_id=50cd0ebefc214110ae99eaa326b9676d, region_id=RegionOne) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:47.421411 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05a1c1-e560-44dc-a0e5-7125028a9131 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:47.422779 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05a1c1-e560-44dc-a0e5-7125028a9131 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:47.428099 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 493/994] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Jul 12 18:15:47 2022] GET /identity/v3/endpoints?service_id=50cd0ebefc214110ae99eaa326b9676d&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:47.433229 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05a1c1-e560-44dc-a0e5-7125028a9131 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:47.467421 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab37937-f613-4c45-be3a-e04140d3cdf5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:47.476079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:47.506335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c8131-7b14-4e9a-a989-c0a84d1dc0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:47.507002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c8131-7b14-4e9a-a989-c0a84d1dc0ec None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:47.507301 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c8131-7b14-4e9a-a989-c0a84d1dc0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:47.507564 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c8131-7b14-4e9a-a989-c0a84d1dc0ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:47.508395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c8131-7b14-4e9a-a989-c0a84d1dc0ec None admin] RBAC: Adding query filter params (role.id=70c740362c964f449be0b5c279cb35c0, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=54189575a60a4d9dbaabb78d44e9c31e) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:47.508709 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c8131-7b14-4e9a-a989-c0a84d1dc0ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:47.510177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c8131-7b14-4e9a-a989-c0a84d1dc0ec None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:47.515870 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:47.516396 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 502/995] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:15:47 2022] GET /identity/v3/role_assignments?user.id=54189575a60a4d9dbaabb78d44e9c31e&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=70c740362c964f449be0b5c279cb35c0 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:47.544935 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05a1c1-e560-44dc-a0e5-7125028a9131 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:47.588851 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70415ec-480e-4ad5-ae36-1ff6f029ca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:47.589569 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70415ec-480e-4ad5-ae36-1ff6f029ca39 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:47.589858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70415ec-480e-4ad5-ae36-1ff6f029ca39 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:47.590139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70415ec-480e-4ad5-ae36-1ff6f029ca39 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:47.590836 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70415ec-480e-4ad5-ae36-1ff6f029ca39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:47.592241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70415ec-480e-4ad5-ae36-1ff6f029ca39 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:47.609574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 494/996] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Jul 12 18:15:47 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:15:49.126211 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e9044-1157-4acb-aaf6-7b0c4f887f98 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:49.126759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e9044-1157-4acb-aaf6-7b0c4f887f98 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:49.126759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e9044-1157-4acb-aaf6-7b0c4f887f98 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:49.128165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 503/997] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:49.133307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53629d9-7c37-496c-93cc-ee8219324877 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:49.133695 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53629d9-7c37-496c-93cc-ee8219324877 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:49.133903 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53629d9-7c37-496c-93cc-ee8219324877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:49.151132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a53629d9-7c37-496c-93cc-ee8219324877 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:49.152317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a53629d9-7c37-496c-93cc-ee8219324877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:49.221339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 495/998] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:49.244766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e9044-1157-4acb-aaf6-7b0c4f887f98 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:49.349936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e9044-1157-4acb-aaf6-7b0c4f887f98 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:49.386400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5a297-583c-4ec8-bedf-396f7de2590c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:49.387509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5a297-583c-4ec8-bedf-396f7de2590c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:49.387985 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5a297-583c-4ec8-bedf-396f7de2590c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:49.388452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5a297-583c-4ec8-bedf-396f7de2590c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:49.389341 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5a297-583c-4ec8-bedf-396f7de2590c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:49.390884 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5a297-583c-4ec8-bedf-396f7de2590c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:49.402800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-98c5a297-583c-4ec8-bedf-396f7de2590c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:15:49.402800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:49.402800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:49.402800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:49.402800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:49.402800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:49.402800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:49.402800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:49.402800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:15:49.402800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:49.402800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:49.402800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:49.402800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:49.402800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:49.402800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:49.402800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:49.402800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:49.403782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:49.403782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:49.403782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:49.403782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:49.403782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:49.403782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:49.403782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:49.403782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:49.403782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:49.403782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:49.403782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:49.403782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:49.403782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:49.403782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:49.403782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:49.403782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:49.404629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:49.404629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:49.404629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:49.404629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:49.404629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:49.404629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:49.404629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:49.404629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:49.404629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:49.404629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:49.404629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:49.404629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:49.404629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:15:49.404629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:49.406708 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 504/999] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Jul 12 18:15:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:49.412991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53629d9-7c37-496c-93cc-ee8219324877 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:49.481858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:49.515827 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53629d9-7c37-496c-93cc-ee8219324877 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:49.549736 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3252ca-8109-404e-908e-55c6eea6a860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:49.550401 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3252ca-8109-404e-908e-55c6eea6a860 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:49.550687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3252ca-8109-404e-908e-55c6eea6a860 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:49.551531 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3252ca-8109-404e-908e-55c6eea6a860 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:49.552246 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3252ca-8109-404e-908e-55c6eea6a860 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:49.552552 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3252ca-8109-404e-908e-55c6eea6a860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:49.553954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3252ca-8109-404e-908e-55c6eea6a860 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:49.563744 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 496/1000] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Jul 12 18:15:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:49.565107 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5a297-583c-4ec8-bedf-396f7de2590c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:49.590168 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13841ef2-be6e-4633-9dc1-4bc746175943 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:49.590478 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13841ef2-be6e-4633-9dc1-4bc746175943 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:49.590732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13841ef2-be6e-4633-9dc1-4bc746175943 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:49.592275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 497/1001] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:15:49.596904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4d013-e970-489d-b22a-f5282e66eda9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:49.597197 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4d013-e970-489d-b22a-f5282e66eda9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:49.597514 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4d013-e970-489d-b22a-f5282e66eda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:49.602295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:49.615124 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6ae4d013-e970-489d-b22a-f5282e66eda9 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:49.616325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6ae4d013-e970-489d-b22a-f5282e66eda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:49.676100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5a297-583c-4ec8-bedf-396f7de2590c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:49.684260 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 498/1002] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:15:49.690028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f79cf-00a6-49b6-bdb4-7213c177651b None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:49.690316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f79cf-00a6-49b6-bdb4-7213c177651b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:49.690593 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f79cf-00a6-49b6-bdb4-7213c177651b None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:49.691936 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 499/1003] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:49.697393 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec874c0-8c98-4ec9-9bb0-a38c93fed9be None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:49.697828 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec874c0-8c98-4ec9-9bb0-a38c93fed9be None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:49.698103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec874c0-8c98-4ec9-9bb0-a38c93fed9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:49.711789 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ce604-5674-460e-8a12-64121cf545bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:49.712458 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ce604-5674-460e-8a12-64121cf545bb None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:49.712743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ce604-5674-460e-8a12-64121cf545bb None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:49.713041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ce604-5674-460e-8a12-64121cf545bb None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:49.713808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ce604-5674-460e-8a12-64121cf545bb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:49.714116 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ce604-5674-460e-8a12-64121cf545bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:49.714876 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7ec874c0-8c98-4ec9-9bb0-a38c93fed9be None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:49.715488 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ce604-5674-460e-8a12-64121cf545bb None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:49.716043 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7ec874c0-8c98-4ec9-9bb0-a38c93fed9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:49.721037 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 505/1004] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Jul 12 18:15:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:49.721836 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ce604-5674-460e-8a12-64121cf545bb None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:49.771655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:49.782947 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 500/1005] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:15:49.783730 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec874c0-8c98-4ec9-9bb0-a38c93fed9be None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:49.822455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:49.827003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ce604-5674-460e-8a12-64121cf545bb None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:49.860600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e93c4-e42c-448d-9e2c-0d2cea14167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:49.861405 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e93c4-e42c-448d-9e2c-0d2cea14167b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:49.861688 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e93c4-e42c-448d-9e2c-0d2cea14167b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:49.861962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e93c4-e42c-448d-9e2c-0d2cea14167b None admin] PATH_INFO: `/v3/services/image` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:49.862599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e93c4-e42c-448d-9e2c-0d2cea14167b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:49.863980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e93c4-e42c-448d-9e2c-0d2cea14167b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:49.875423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-784e93c4-e42c-448d-9e2c-0d2cea14167b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:15:49.875423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:49.875423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:49.875423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:49.875423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:49.875423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:49.875423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:49.875423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:49.875423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:15:49.875423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:49.875423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:49.875423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:49.875423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:49.875423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:49.875423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:49.875423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:49.875423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:49.876420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:49.876420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:49.876420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:49.876420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:49.876420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:49.876420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:49.876420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:49.876420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:49.876420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:49.876420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:49.876420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:49.876420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:49.876420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:49.876420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:49.876420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:49.876420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:49.877340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:49.877340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:49.877340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:49.877340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:49.877340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:49.877340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:49.877340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:49.877340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:49.877340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:49.877340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:49.877340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:49.877340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:49.877340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:15:49.877340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:49.877340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 506/1006] 10.222.0.57 () {56 vars in 1105 bytes} [Tue Jul 12 18:15:49 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:49.878168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e93c4-e42c-448d-9e2c-0d2cea14167b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:49.889692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec874c0-8c98-4ec9-9bb0-a38c93fed9be None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:49.923838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382be5e3-0111-4bcf-9617-c3c2fb265f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:49.924494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382be5e3-0111-4bcf-9617-c3c2fb265f7c None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:49.924778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382be5e3-0111-4bcf-9617-c3c2fb265f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:49.925058 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382be5e3-0111-4bcf-9617-c3c2fb265f7c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:49.925859 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382be5e3-0111-4bcf-9617-c3c2fb265f7c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:49.927310 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382be5e3-0111-4bcf-9617-c3c2fb265f7c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:49.942037 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 501/1007] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Jul 12 18:15:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:15:49.942997 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382be5e3-0111-4bcf-9617-c3c2fb265f7c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:49.984581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e93c4-e42c-448d-9e2c-0d2cea14167b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:50.018352 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:50.030727 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cef11-7e16-4f0a-ab0d-4c7b478b6946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:50.031528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cef11-7e16-4f0a-ab0d-4c7b478b6946 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:50.031804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cef11-7e16-4f0a-ab0d-4c7b478b6946 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:50.032069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cef11-7e16-4f0a-ab0d-4c7b478b6946 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:50.032718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cef11-7e16-4f0a-ab0d-4c7b478b6946 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:50.034155 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cef11-7e16-4f0a-ab0d-4c7b478b6946 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:50.047042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-e06cef11-7e16-4f0a-ab0d-4c7b478b6946 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:15:50.047042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:50.047042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:50.047042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:50.047042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:50.047042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:50.047042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:50.047042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:50.047042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:15:50.047042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:50.047042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:50.047042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:50.047042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:50.047042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:50.047042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:50.047042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:50.047042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:50.048164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:50.048164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:50.048164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:50.048164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:50.048164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:50.048164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:50.048164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:50.048164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:50.048164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:50.048164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:50.048164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:50.048164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:50.048164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:50.048164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:50.048164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:50.048164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:50.049103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:50.049103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:50.049103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:50.049103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:50.049103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:50.049103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:50.049103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:50.049103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:50.049103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:50.049103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:50.049103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:50.049103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:50.049103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:15:50.049103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:50.049103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 507/1008] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:50.054568 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cef11-7e16-4f0a-ab0d-4c7b478b6946 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:50.077361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382be5e3-0111-4bcf-9617-c3c2fb265f7c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:50.083640 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:50.116956 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30e50a-1058-4c93-b916-f9ec81a0fe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:50.117200 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30e50a-1058-4c93-b916-f9ec81a0fe93 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:50.117513 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30e50a-1058-4c93-b916-f9ec81a0fe93 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:50.117742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30e50a-1058-4c93-b916-f9ec81a0fe93 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:50.118452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30e50a-1058-4c93-b916-f9ec81a0fe93 None admin] RBAC: Adding query filter params (name=image) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:50.118764 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30e50a-1058-4c93-b916-f9ec81a0fe93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:50.120140 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30e50a-1058-4c93-b916-f9ec81a0fe93 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:50.126213 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 502/1009] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:50.132126 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30e50a-1058-4c93-b916-f9ec81a0fe93 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:50.173353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cef11-7e16-4f0a-ab0d-4c7b478b6946 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:50.209875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e141a-2c79-4072-9553-0292b859e40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:50.210469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e141a-2c79-4072-9553-0292b859e40c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:50.210755 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e141a-2c79-4072-9553-0292b859e40c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:50.211031 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e141a-2c79-4072-9553-0292b859e40c None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:50.211735 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e141a-2c79-4072-9553-0292b859e40c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:50.212043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e141a-2c79-4072-9553-0292b859e40c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:50.213444 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e141a-2c79-4072-9553-0292b859e40c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:50.218263 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 508/1010] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Jul 12 18:15:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:50.223812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e141a-2c79-4072-9553-0292b859e40c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:50.245440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30e50a-1058-4c93-b916-f9ec81a0fe93 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:50.264354 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:50.287624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b04566-380c-422a-ae41-a0a2c3706e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:50.288290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b04566-380c-422a-ae41-a0a2c3706e13 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:50.288576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b04566-380c-422a-ae41-a0a2c3706e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:50.288845 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b04566-380c-422a-ae41-a0a2c3706e13 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:50.289580 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b04566-380c-422a-ae41-a0a2c3706e13 None admin] RBAC: Adding query filter params (type=image) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:50.289885 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b04566-380c-422a-ae41-a0a2c3706e13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:50.291247 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b04566-380c-422a-ae41-a0a2c3706e13 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:50.305297 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 503/1011] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:50.330546 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:50.354946 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e141a-2c79-4072-9553-0292b859e40c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:50.395187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcced26-ae19-4cad-b00a-ba583b6a8a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:50.395875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcced26-ae19-4cad-b00a-ba583b6a8a64 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:50.396162 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcced26-ae19-4cad-b00a-ba583b6a8a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:50.396440 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcced26-ae19-4cad-b00a-ba583b6a8a64 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:50.397155 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcced26-ae19-4cad-b00a-ba583b6a8a64 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:50.397494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcced26-ae19-4cad-b00a-ba583b6a8a64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:50.398888 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcced26-ae19-4cad-b00a-ba583b6a8a64 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:50.409632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 509/1012] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Jul 12 18:15:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:50.411565 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b04566-380c-422a-ae41-a0a2c3706e13 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:50.519225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b04566-380c-422a-ae41-a0a2c3706e13 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:50.554318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93261381-8e86-4897-a2c6-e8020f1cf8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:50.555327 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261381-8e86-4897-a2c6-e8020f1cf8e6 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:50.555816 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261381-8e86-4897-a2c6-e8020f1cf8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:50.556275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261381-8e86-4897-a2c6-e8020f1cf8e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:50.557190 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93261381-8e86-4897-a2c6-e8020f1cf8e6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:50.558726 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93261381-8e86-4897-a2c6-e8020f1cf8e6 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:50.584955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 504/1013] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Jul 12 18:15:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:15:51.987771 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec3db7-9d8b-45ed-a03c-63cd26f1c246 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:51.988323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec3db7-9d8b-45ed-a03c-63cd26f1c246 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:51.988323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec3db7-9d8b-45ed-a03c-63cd26f1c246 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:51.989993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 510/1014] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:51.994951 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da2002-a1fc-42fd-a2d4-63a9c9a14717 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:51.995322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da2002-a1fc-42fd-a2d4-63a9c9a14717 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:51.995500 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da2002-a1fc-42fd-a2d4-63a9c9a14717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:52.012123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-45da2002-a1fc-42fd-a2d4-63a9c9a14717 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:52.013324 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-45da2002-a1fc-42fd-a2d4-63a9c9a14717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:52.043455 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:52.089087 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 505/1015] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:51 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:52.111877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec3db7-9d8b-45ed-a03c-63cd26f1c246 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:52.214305 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec3db7-9d8b-45ed-a03c-63cd26f1c246 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:52.249806 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbeec5-efcb-4836-948e-9aa2218e4f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:52.250677 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbeec5-efcb-4836-948e-9aa2218e4f23 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:52.251058 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbeec5-efcb-4836-948e-9aa2218e4f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:52.251427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbeec5-efcb-4836-948e-9aa2218e4f23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:52.253028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbeec5-efcb-4836-948e-9aa2218e4f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:52.255144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbeec5-efcb-4836-948e-9aa2218e4f23 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:52.256917 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 511/1016] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:52.262468 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da2002-a1fc-42fd-a2d4-63a9c9a14717 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:52.339969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5777f5-7bb6-44c7-9a61-626cb8d2fdef None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:52.340375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5777f5-7bb6-44c7-9a61-626cb8d2fdef None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:52.340536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5777f5-7bb6-44c7-9a61-626cb8d2fdef None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:52.341942 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 512/1017] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:15:52.346779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11e024-0639-4f85-a346-ad738567432e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:52.347066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11e024-0639-4f85-a346-ad738567432e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:52.347347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11e024-0639-4f85-a346-ad738567432e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:52.364990 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da2002-a1fc-42fd-a2d4-63a9c9a14717 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:52.365739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1a11e024-0639-4f85-a346-ad738567432e None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:52.366934 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1a11e024-0639-4f85-a346-ad738567432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:52.381003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:52.403193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6941d8-e0fa-4d0a-a271-19d20ac8f7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:52.403859 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6941d8-e0fa-4d0a-a271-19d20ac8f7ae None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:52.404141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6941d8-e0fa-4d0a-a271-19d20ac8f7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:52.404415 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6941d8-e0fa-4d0a-a271-19d20ac8f7ae None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:52.405136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6941d8-e0fa-4d0a-a271-19d20ac8f7ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:52.406617 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6941d8-e0fa-4d0a-a271-19d20ac8f7ae None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:52.435109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 506/1018] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Jul 12 18:15:52 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:15:52.450253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 513/1019] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:52 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:15:52.473896 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6941d8-e0fa-4d0a-a271-19d20ac8f7ae None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:52.492561 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:52.595348 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6941d8-e0fa-4d0a-a271-19d20ac8f7ae None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:52.630942 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff557d-3f39-4fca-b9a1-d288c330ed61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:52.631898 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff557d-3f39-4fca-b9a1-d288c330ed61 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:52.632353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff557d-3f39-4fca-b9a1-d288c330ed61 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:52.632802 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff557d-3f39-4fca-b9a1-d288c330ed61 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:52.633820 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff557d-3f39-4fca-b9a1-d288c330ed61 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:52.635211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff557d-3f39-4fca-b9a1-d288c330ed61 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:52.651177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 507/1020] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Jul 12 18:15:52 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:15:52.725723 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3a4dc-1a70-4da0-84a3-5f0522a2c583 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:52.726062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3a4dc-1a70-4da0-84a3-5f0522a2c583 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:52.726290 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3a4dc-1a70-4da0-84a3-5f0522a2c583 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:52.727874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 514/1021] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:52.733475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb1f46-a39d-4775-b57e-5cf0f42d744b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:52.733828 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb1f46-a39d-4775-b57e-5cf0f42d744b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:52.734036 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb1f46-a39d-4775-b57e-5cf0f42d744b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:52.751533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-adcb1f46-a39d-4775-b57e-5cf0f42d744b None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:52.752742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-adcb1f46-a39d-4775-b57e-5cf0f42d744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:52.830090 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:52.837839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 508/1022] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:52.861778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3a4dc-1a70-4da0-84a3-5f0522a2c583 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:52.966034 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3a4dc-1a70-4da0-84a3-5f0522a2c583 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:53.001536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73769b6c-21c9-42a5-971b-2a0ef9ce18ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:53.002386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73769b6c-21c9-42a5-971b-2a0ef9ce18ea None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:53.002636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73769b6c-21c9-42a5-971b-2a0ef9ce18ea None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:53.002911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73769b6c-21c9-42a5-971b-2a0ef9ce18ea None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:53.013985 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73769b6c-21c9-42a5-971b-2a0ef9ce18ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:53.022912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-73769b6c-21c9-42a5-971b-2a0ef9ce18ea None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:15:53.022912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:53.022912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:53.022912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:53.022912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:53.022912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:53.022912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:53.022912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:53.022912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:53.022912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:53.022912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:53.022912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:53.022912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:53.022912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:53.022912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:53.022912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:53.023851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:53.023851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:53.023851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:53.023851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:53.023851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:53.023851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:53.023851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:53.023851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:53.023851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:53.023851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:53.023851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:53.023851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:53.023851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:53.023851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:53.023851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:53.023851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:53.024841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:53.024841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:53.024841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:53.024841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:53.024841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:53.024841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:53.024841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:53.024841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:53.024841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:53.024841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:53.024841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:15:53.024841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:53.024841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 515/1023] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Jul 12 18:15:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:53.029954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb1f46-a39d-4775-b57e-5cf0f42d744b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:53.130030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb1f46-a39d-4775-b57e-5cf0f42d744b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:53.165517 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617699f-a1e3-4770-ba2c-bc35969586e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:53.166187 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617699f-a1e3-4770-ba2c-bc35969586e5 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:53.166469 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617699f-a1e3-4770-ba2c-bc35969586e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:53.166744 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617699f-a1e3-4770-ba2c-bc35969586e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:53.167490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617699f-a1e3-4770-ba2c-bc35969586e5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:53.167799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617699f-a1e3-4770-ba2c-bc35969586e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:53.169179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617699f-a1e3-4770-ba2c-bc35969586e5 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:53.182475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 509/1024] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Jul 12 18:15:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:53.183436 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73769b6c-21c9-42a5-971b-2a0ef9ce18ea None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:53.196116 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:53.288596 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73769b6c-21c9-42a5-971b-2a0ef9ce18ea None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:53.322893 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fd572-3c3b-4f7c-b71e-1ab4322519bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:53.323944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fd572-3c3b-4f7c-b71e-1ab4322519bf None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:53.324226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fd572-3c3b-4f7c-b71e-1ab4322519bf None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:53.324501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fd572-3c3b-4f7c-b71e-1ab4322519bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:53.335805 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fd572-3c3b-4f7c-b71e-1ab4322519bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:53.337246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fd572-3c3b-4f7c-b71e-1ab4322519bf None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:53.354976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-1c9fd572-3c3b-4f7c-b71e-1ab4322519bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:53.354976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:53.354976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:53.354976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:53.354976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:53.354976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:53.354976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:53.354976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:53.354976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:53.354976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:53.354976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:53.354976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:53.354976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:53.354976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:53.354976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:53.355882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:53.355882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:53.355882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:53.355882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:53.355882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:53.355882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:53.355882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:53.355882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:53.355882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:53.355882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:53.355882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:53.355882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:53.355882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:53.355882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:53.355882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:53.355882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:53.355882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:53.356874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:53.356874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:53.356874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:53.356874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:53.360917 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 516/1025] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:53.361946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617699f-a1e3-4770-ba2c-bc35969586e5 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:53.426224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:53.466368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617699f-a1e3-4770-ba2c-bc35969586e5 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:53.499447 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b071344-db4e-4ad4-b6dc-1b8b1e998b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:53.500101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b071344-db4e-4ad4-b6dc-1b8b1e998b45 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:53.500384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b071344-db4e-4ad4-b6dc-1b8b1e998b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:53.500659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b071344-db4e-4ad4-b6dc-1b8b1e998b45 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:53.501404 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b071344-db4e-4ad4-b6dc-1b8b1e998b45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:53.501713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b071344-db4e-4ad4-b6dc-1b8b1e998b45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:53.503084 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b071344-db4e-4ad4-b6dc-1b8b1e998b45 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:53.514945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 510/1026] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:53.520794 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fd572-3c3b-4f7c-b71e-1ab4322519bf None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:53.590726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:53.634977 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fd572-3c3b-4f7c-b71e-1ab4322519bf None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:53.669286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81167a2-949a-4a09-8be3-270a4ccb24d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:53.670085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81167a2-949a-4a09-8be3-270a4ccb24d3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:53.670369 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81167a2-949a-4a09-8be3-270a4ccb24d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:53.670646 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81167a2-949a-4a09-8be3-270a4ccb24d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:53.678363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81167a2-949a-4a09-8be3-270a4ccb24d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:53.679752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81167a2-949a-4a09-8be3-270a4ccb24d3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:53.693761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-a81167a2-949a-4a09-8be3-270a4ccb24d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:15:53.693761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:53.693761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:53.693761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:53.693761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:53.693761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:53.693761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:53.693761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:53.693761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:53.693761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:53.693761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:53.693761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:53.693761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:53.693761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:53.693761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:53.693761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:53.694701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:53.694701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:53.694701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:53.694701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:53.694701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:53.694701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:53.694701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:53.694701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:53.694701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:53.694701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:53.694701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:53.694701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:53.694701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:53.694701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:53.694701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:53.694701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:53.694701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:53.694701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:53.696223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:53.696223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:53.696223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:53.696223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:53.696223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:53.696223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:53.696223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:53.696223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:53.696223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:15:53.696223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:53.696223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 517/1027] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Jul 12 18:15:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:53.700873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b071344-db4e-4ad4-b6dc-1b8b1e998b45 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:53.805611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b071344-db4e-4ad4-b6dc-1b8b1e998b45 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:53.828730 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:53.841883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198f760-8a8b-472c-9c74-08a67074323a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:53.842549 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198f760-8a8b-472c-9c74-08a67074323a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:53.842833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198f760-8a8b-472c-9c74-08a67074323a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:53.843110 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198f760-8a8b-472c-9c74-08a67074323a None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:53.843949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198f760-8a8b-472c-9c74-08a67074323a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:53.844260 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198f760-8a8b-472c-9c74-08a67074323a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:53.845724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198f760-8a8b-472c-9c74-08a67074323a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:53.868724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 511/1028] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Jul 12 18:15:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:53.869915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81167a2-949a-4a09-8be3-270a4ccb24d3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:53.971410 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81167a2-949a-4a09-8be3-270a4ccb24d3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:53.991742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:54.006582 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379d3f5-a073-49c4-9e9a-873578533ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:54.007291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379d3f5-a073-49c4-9e9a-873578533ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:54.007512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379d3f5-a073-49c4-9e9a-873578533ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:54.007790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379d3f5-a073-49c4-9e9a-873578533ee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:54.075191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379d3f5-a073-49c4-9e9a-873578533ee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:54.076644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379d3f5-a073-49c4-9e9a-873578533ee9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:54.180196 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 518/1029] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:15:53 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:15:54.181568 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198f760-8a8b-472c-9c74-08a67074323a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:54.281847 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198f760-8a8b-472c-9c74-08a67074323a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:54.316911 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8db9c-a093-4a61-ae17-7109e14da91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:54.317796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8db9c-a093-4a61-ae17-7109e14da91d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:54.318084 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8db9c-a093-4a61-ae17-7109e14da91d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:54.318361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8db9c-a093-4a61-ae17-7109e14da91d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:54.328692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8db9c-a093-4a61-ae17-7109e14da91d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:54.330192 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8db9c-a093-4a61-ae17-7109e14da91d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:54.348685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-24d8db9c-a093-4a61-ae17-7109e14da91d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:54.348685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:54.348685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:54.348685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:54.348685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:54.348685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:54.348685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:54.348685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:54.348685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:54.348685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:54.348685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:54.348685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:54.348685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:54.348685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:54.348685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:54.349619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:54.349619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:54.349619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:54.349619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:54.349619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:54.349619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:54.349619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:54.349619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:54.349619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:54.349619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:54.349619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:54.349619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:54.349619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:54.349619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:54.349619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:54.349619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:54.349619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:54.350520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:54.350520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:54.350520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:54.350520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:54.350520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 512/1030] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:54.356369 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379d3f5-a073-49c4-9e9a-873578533ee9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:54.377792 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:54.469578 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379d3f5-a073-49c4-9e9a-873578533ee9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:54.503518 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffeee8-bfe2-495e-a028-e7569fb19487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:54.504710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffeee8-bfe2-495e-a028-e7569fb19487 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:54.504995 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffeee8-bfe2-495e-a028-e7569fb19487 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:54.505289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffeee8-bfe2-495e-a028-e7569fb19487 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:54.506012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffeee8-bfe2-495e-a028-e7569fb19487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:54.506322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffeee8-bfe2-495e-a028-e7569fb19487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:54.507686 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffeee8-bfe2-495e-a028-e7569fb19487 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:54.524652 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 519/1031] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:54.525876 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8db9c-a093-4a61-ae17-7109e14da91d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:54.529796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b6619-f62a-4890-b6fd-bb5e2f8aaa86 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:54.530087 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b6619-f62a-4890-b6fd-bb5e2f8aaa86 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:54.530366 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b6619-f62a-4890-b6fd-bb5e2f8aaa86 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:54.531731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 520/1032] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:15:54.537143 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9135c1-4996-4733-98e8-fda52b4ab557 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:54.537405 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9135c1-4996-4733-98e8-fda52b4ab557 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:54.537692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9135c1-4996-4733-98e8-fda52b4ab557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:54.554501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-dc9135c1-4996-4733-98e8-fda52b4ab557 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:54.556215 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-dc9135c1-4996-4733-98e8-fda52b4ab557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:54.558155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:54.635191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 521/1033] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:15:54.642459 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8db9c-a093-4a61-ae17-7109e14da91d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:54.660215 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9135c1-4996-4733-98e8-fda52b4ab557 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:54.671573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:54.681807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc0d0c-9d8b-4f0f-96ab-2d0f06e24bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:54.682625 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc0d0c-9d8b-4f0f-96ab-2d0f06e24bbf None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:54.682907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc0d0c-9d8b-4f0f-96ab-2d0f06e24bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:54.683202 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc0d0c-9d8b-4f0f-96ab-2d0f06e24bbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:54.690131 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc0d0c-9d8b-4f0f-96ab-2d0f06e24bbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:54.692120 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc0d0c-9d8b-4f0f-96ab-2d0f06e24bbf None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:54.705945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-b4cc0d0c-9d8b-4f0f-96ab-2d0f06e24bbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:54.705945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:54.705945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:54.705945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:54.705945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:54.705945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:54.705945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:54.705945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:54.705945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:54.705945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:54.705945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:54.705945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:54.705945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:54.705945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:54.705945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:54.706855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:54.706855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:54.706855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:54.706855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:54.706855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:54.706855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:54.706855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:54.706855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:54.706855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:54.706855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:54.706855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:54.706855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:54.706855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:54.706855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:54.706855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:54.706855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:54.706855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:54.708438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:54.708438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:54.708438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:54.708438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:54.708438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:54.708438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:54.708438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:54.708438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:54.709185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 513/1034] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:54.710625 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403db7b0-37c7-4cb8-a949-90c6ca2779ca None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:54.711059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403db7b0-37c7-4cb8-a949-90c6ca2779ca None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:54.711344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403db7b0-37c7-4cb8-a949-90c6ca2779ca None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:54.712849 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 514/1035] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:54.713555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403db7b0-37c7-4cb8-a949-90c6ca2779ca None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:54.763472 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9135c1-4996-4733-98e8-fda52b4ab557 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:54.797226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1951647-088b-48b3-819d-a604f9059e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:54.797977 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1951647-088b-48b3-819d-a604f9059e84 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:54.798259 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1951647-088b-48b3-819d-a604f9059e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:54.798535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1951647-088b-48b3-819d-a604f9059e84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:54.799778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1951647-088b-48b3-819d-a604f9059e84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:54.801246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1951647-088b-48b3-819d-a604f9059e84 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:54.802881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 522/1036] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:54.804583 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:54.806784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce91a26-749f-4b8a-a1b4-9e51b31305aa None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:54.807311 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce91a26-749f-4b8a-a1b4-9e51b31305aa None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:54.807867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce91a26-749f-4b8a-a1b4-9e51b31305aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:54.814368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403db7b0-37c7-4cb8-a949-90c6ca2779ca None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:54.824737 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-bce91a26-749f-4b8a-a1b4-9e51b31305aa None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:54.825958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bce91a26-749f-4b8a-a1b4-9e51b31305aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:54.849051 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e0b87-ab97-41df-a8eb-952ff6be72f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:54.849946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e0b87-ab97-41df-a8eb-952ff6be72f0 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:54.850231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e0b87-ab97-41df-a8eb-952ff6be72f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:54.850499 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e0b87-ab97-41df-a8eb-952ff6be72f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:54.851280 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e0b87-ab97-41df-a8eb-952ff6be72f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:54.851587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e0b87-ab97-41df-a8eb-952ff6be72f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:54.853018 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e0b87-ab97-41df-a8eb-952ff6be72f0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:54.865742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 515/1037] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:54.866319 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e0b87-ab97-41df-a8eb-952ff6be72f0 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:54.897407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 523/1038] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:54.898234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce91a26-749f-4b8a-a1b4-9e51b31305aa None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:54.908905 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:54.970987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e0b87-ab97-41df-a8eb-952ff6be72f0 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:55.001828 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce91a26-749f-4b8a-a1b4-9e51b31305aa None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:55.005222 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f995cc1-2652-4c69-9231-501733a379c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:55.005910 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f995cc1-2652-4c69-9231-501733a379c0 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:55.006193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f995cc1-2652-4c69-9231-501733a379c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:55.006467 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f995cc1-2652-4c69-9231-501733a379c0 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:55.007174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f995cc1-2652-4c69-9231-501733a379c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:55.008606 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f995cc1-2652-4c69-9231-501733a379c0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:55.041290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 516/1039] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Jul 12 18:15:54 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:15:55.041290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f995cc1-2652-4c69-9231-501733a379c0 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:55.041620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73574403-526c-4031-9e8e-7390f4f8bc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:55.041620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73574403-526c-4031-9e8e-7390f4f8bc8f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:55.041620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73574403-526c-4031-9e8e-7390f4f8bc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:55.041620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73574403-526c-4031-9e8e-7390f4f8bc8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:55.042269 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73574403-526c-4031-9e8e-7390f4f8bc8f None admin] RBAC: Adding query filter params (role.id=70c740362c964f449be0b5c279cb35c0, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=a7c1bb51c2b642ffa4708122d826fc67) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:55.042269 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73574403-526c-4031-9e8e-7390f4f8bc8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:55.042269 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73574403-526c-4031-9e8e-7390f4f8bc8f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:55.042447 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:55.048319 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 524/1040] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:15:54 2022] GET /identity/v3/role_assignments?user.id=a7c1bb51c2b642ffa4708122d826fc67&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=70c740362c964f449be0b5c279cb35c0 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:55.161474 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f995cc1-2652-4c69-9231-501733a379c0 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:55.203681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e7c64-9893-4e28-840c-6bfcd808ec48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:55.204483 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e7c64-9893-4e28-840c-6bfcd808ec48 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:55.204767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e7c64-9893-4e28-840c-6bfcd808ec48 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:55.205044 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e7c64-9893-4e28-840c-6bfcd808ec48 None admin] PATH_INFO: `/v3/services/image` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:55.205742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e7c64-9893-4e28-840c-6bfcd808ec48 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:55.207656 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e7c64-9893-4e28-840c-6bfcd808ec48 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:55.220953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-471e7c64-9893-4e28-840c-6bfcd808ec48 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:15:55.220953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:55.220953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:55.220953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:55.220953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:55.220953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:55.220953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:55.220953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:55.220953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:15:55.220953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:55.220953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:55.220953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:55.220953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:55.220953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:55.220953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:55.220953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:55.220953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:55.222203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:55.222203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:55.222203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:55.222203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:55.222203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:55.222203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:55.222203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:55.222203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:55.222203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:55.222203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:55.222203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:55.222203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:55.222203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:55.222203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:55.222203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:55.222203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:55.224224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:55.224224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:55.224224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:55.224224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:55.224224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:55.224224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:55.224224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:55.224224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:55.224224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:55.224224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:55.224224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:55.224224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:55.224224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:15:55.224224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:55.224224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 517/1041] 10.222.0.57 () {56 vars in 1105 bytes} [Tue Jul 12 18:15:55 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:55.228849 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73574403-526c-4031-9e8e-7390f4f8bc8f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:55.308371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:55.340480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73574403-526c-4031-9e8e-7390f4f8bc8f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:55.375258 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5bf67-6b7a-4600-a130-2c453ac324ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:55.375929 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5bf67-6b7a-4600-a130-2c453ac324ea None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:55.376212 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5bf67-6b7a-4600-a130-2c453ac324ea None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:55.376487 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5bf67-6b7a-4600-a130-2c453ac324ea None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:55.377191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5bf67-6b7a-4600-a130-2c453ac324ea None admin] RBAC: Adding query filter params (name=image) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:55.377522 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5bf67-6b7a-4600-a130-2c453ac324ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:55.378921 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5bf67-6b7a-4600-a130-2c453ac324ea None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:55.384048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 525/1042] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:55.389558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e7c64-9893-4e28-840c-6bfcd808ec48 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:55.460983 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:55.493138 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e7c64-9893-4e28-840c-6bfcd808ec48 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:55.526373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb032e-bd9c-48b0-8045-b701678a42a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:55.527042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb032e-bd9c-48b0-8045-b701678a42a9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:55.527339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb032e-bd9c-48b0-8045-b701678a42a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:55.527592 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb032e-bd9c-48b0-8045-b701678a42a9 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:55.528296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb032e-bd9c-48b0-8045-b701678a42a9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:55.528604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb032e-bd9c-48b0-8045-b701678a42a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:55.530006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb032e-bd9c-48b0-8045-b701678a42a9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:55.535567 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 518/1043] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:55.543085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5bf67-6b7a-4600-a130-2c453ac324ea None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:55.651008 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5bf67-6b7a-4600-a130-2c453ac324ea None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:55.684577 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e913a39-ac92-41d7-af77-269611f70b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:55.685232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e913a39-ac92-41d7-af77-269611f70b16 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:55.685543 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e913a39-ac92-41d7-af77-269611f70b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:55.685815 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e913a39-ac92-41d7-af77-269611f70b16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:55.686594 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e913a39-ac92-41d7-af77-269611f70b16 None admin] RBAC: Adding query filter params (interface=public, service_id=a9e2895b99e2487ea052e642e655ccef, region_id=RegionOne) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:55.686903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e913a39-ac92-41d7-af77-269611f70b16 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:55.688263 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e913a39-ac92-41d7-af77-269611f70b16 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:55.690778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:55.695043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 526/1044] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Jul 12 18:15:55 2022] GET /identity/v3/endpoints?service_id=a9e2895b99e2487ea052e642e655ccef&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:55.702472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb032e-bd9c-48b0-8045-b701678a42a9 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:55.804196 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb032e-bd9c-48b0-8045-b701678a42a9 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:55.838765 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e24d67-a4db-48ff-a25a-26a17e71ad0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:55.839723 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e24d67-a4db-48ff-a25a-26a17e71ad0f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:55.840209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e24d67-a4db-48ff-a25a-26a17e71ad0f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:55.840703 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e24d67-a4db-48ff-a25a-26a17e71ad0f None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:55.841614 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e24d67-a4db-48ff-a25a-26a17e71ad0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:55.843202 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e24d67-a4db-48ff-a25a-26a17e71ad0f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:55.845212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:55.857294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 519/1045] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Jul 12 18:15:55 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:15:57.099825 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ae6f3-9e9f-482e-a6f2-33277e2f84d3 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:57.100345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ae6f3-9e9f-482e-a6f2-33277e2f84d3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:57.100422 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ae6f3-9e9f-482e-a6f2-33277e2f84d3 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:57.101937 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 527/1046] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:57.106909 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01408af5-8578-45c4-befc-6bc0a2f81fb5 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:57.107277 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01408af5-8578-45c4-befc-6bc0a2f81fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:57.107466 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01408af5-8578-45c4-befc-6bc0a2f81fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:57.125210 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-01408af5-8578-45c4-befc-6bc0a2f81fb5 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:57.126438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-01408af5-8578-45c4-befc-6bc0a2f81fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:57.151170 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c54148-20b1-4310-871c-f8681bfa11cb None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:57.151462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c54148-20b1-4310-871c-f8681bfa11cb None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:57.151746 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c54148-20b1-4310-871c-f8681bfa11cb None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:57.153240 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 528/1047] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:57.157844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856de1c8-5690-4899-ab14-fa349d68bbd6 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:57.158140 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856de1c8-5690-4899-ab14-fa349d68bbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:57.158423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856de1c8-5690-4899-ab14-fa349d68bbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:57.175364 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-856de1c8-5690-4899-ab14-fa349d68bbd6 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:57.176582 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-856de1c8-5690-4899-ab14-fa349d68bbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:57.196582 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 520/1048] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:57.219999 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01408af5-8578-45c4-befc-6bc0a2f81fb5 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:57.247789 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 529/1049] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:15:57.271571 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856de1c8-5690-4899-ab14-fa349d68bbd6 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:57.333128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01408af5-8578-45c4-befc-6bc0a2f81fb5 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:57.363564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:57.370738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aafbed-54bd-44e1-b52f-b557d48c8f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:57.371555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aafbed-54bd-44e1-b52f-b557d48c8f3f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:57.371842 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aafbed-54bd-44e1-b52f-b557d48c8f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:57.372119 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aafbed-54bd-44e1-b52f-b557d48c8f3f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:57.379603 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856de1c8-5690-4899-ab14-fa349d68bbd6 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:57.383490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aafbed-54bd-44e1-b52f-b557d48c8f3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:57.391789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-f5aafbed-54bd-44e1-b52f-b557d48c8f3f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:15:57.391789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:57.391789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:57.391789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:57.391789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:57.391789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:57.391789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:57.391789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:57.391789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:57.391789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:57.391789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:57.391789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:57.391789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:57.391789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:57.391789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:57.391789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:57.392714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:57.392714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:57.392714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:57.392714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:57.392714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:57.392714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:57.392714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:57.392714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:57.392714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:57.392714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:57.392714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:57.392714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:57.392714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:57.392714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:57.392714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:57.392714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:57.393598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:57.393598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:57.393598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:57.393598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:57.393598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:57.393598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:57.393598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:57.393598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:57.393598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:57.393598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:57.393598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:15:57.393598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:57.393598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 521/1050] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Jul 12 18:15:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:57.398917 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aafbed-54bd-44e1-b52f-b557d48c8f3f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:57.413491 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:57.419937 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbce25e-f115-4b44-8f31-be4a709e03fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:57.420731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbce25e-f115-4b44-8f31-be4a709e03fe None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:57.421007 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbce25e-f115-4b44-8f31-be4a709e03fe None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:57.421293 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbce25e-f115-4b44-8f31-be4a709e03fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:57.433200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbce25e-f115-4b44-8f31-be4a709e03fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:15:57.443580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-cfbce25e-f115-4b44-8f31-be4a709e03fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:15:57.443580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:57.443580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:57.443580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:57.443580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:57.443580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:57.443580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:57.443580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:57.443580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:57.443580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:57.443580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:57.443580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:57.443580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:15:57.443580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:15:57.443580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:15:57.443580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:15:57.444754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:15:57.444754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:15:57.444754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:15:57.444754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:15:57.444754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:57.444754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:57.444754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:57.444754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:57.444754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:57.444754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:57.444754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:57.444754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:57.444754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:57.444754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:57.444754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:57.444754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:57.446476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:57.446476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:57.446476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:57.446476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:57.446476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:15:57.446476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:15:57.446476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:15:57.446476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:15:57.446476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:15:57.446476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:15:57.446476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:15:57.446476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:57.450052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 530/1051] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:15:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:57.450768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbce25e-f115-4b44-8f31-be4a709e03fe None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:57.507976 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aafbed-54bd-44e1-b52f-b557d48c8f3f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:57.543765 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517dfd4-70bf-46a5-b98f-b12c3e92c6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:57.544435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517dfd4-70bf-46a5-b98f-b12c3e92c6ba None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:57.544725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517dfd4-70bf-46a5-b98f-b12c3e92c6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:57.545002 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517dfd4-70bf-46a5-b98f-b12c3e92c6ba None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:57.545784 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517dfd4-70bf-46a5-b98f-b12c3e92c6ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:57.546097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517dfd4-70bf-46a5-b98f-b12c3e92c6ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:57.547522 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517dfd4-70bf-46a5-b98f-b12c3e92c6ba None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:57.557137 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 522/1052] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Jul 12 18:15:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:57.558332 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbce25e-f115-4b44-8f31-be4a709e03fe None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:57.562601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517dfd4-70bf-46a5-b98f-b12c3e92c6ba None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:57.599790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd553bf-325b-4a37-a156-ebfb1f190f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:57.600466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd553bf-325b-4a37-a156-ebfb1f190f27 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:57.600747 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd553bf-325b-4a37-a156-ebfb1f190f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:57.601023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd553bf-325b-4a37-a156-ebfb1f190f27 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:57.601801 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd553bf-325b-4a37-a156-ebfb1f190f27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:57.602109 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd553bf-325b-4a37-a156-ebfb1f190f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:57.603490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd553bf-325b-4a37-a156-ebfb1f190f27 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:57.612359 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 531/1053] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:15:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:57.618863 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd553bf-325b-4a37-a156-ebfb1f190f27 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:57.622101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:57.672318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517dfd4-70bf-46a5-b98f-b12c3e92c6ba None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:57.678028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:57.706723 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8690f-79ff-43a8-9020-7e7a0249af90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:57.707545 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8690f-79ff-43a8-9020-7e7a0249af90 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:57.707822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8690f-79ff-43a8-9020-7e7a0249af90 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:57.708091 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8690f-79ff-43a8-9020-7e7a0249af90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:57.718874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8690f-79ff-43a8-9020-7e7a0249af90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:57.720311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8690f-79ff-43a8-9020-7e7a0249af90 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:57.735244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd553bf-325b-4a37-a156-ebfb1f190f27 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:57.737844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-3bc8690f-79ff-43a8-9020-7e7a0249af90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:57.737844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:57.737844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:57.737844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:57.737844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:57.737844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:57.737844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:57.737844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:57.737844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:57.737844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:57.737844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:57.737844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:57.737844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:57.737844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:57.737844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:57.739373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:57.739373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:57.739373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:57.739373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:57.739373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:57.739373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:57.739373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:57.739373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:57.739373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:57.739373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:57.739373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:57.739373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:57.739373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:57.739373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:57.739373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:57.739373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:57.739373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:57.740251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:57.740251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:57.740251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:57.740251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:57.740251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 523/1054] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:57.745180 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8690f-79ff-43a8-9020-7e7a0249af90 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:57.774128 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54292f-5c6c-4bce-8707-ec1fffb2da13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:57.775070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54292f-5c6c-4bce-8707-ec1fffb2da13 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:57.775361 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54292f-5c6c-4bce-8707-ec1fffb2da13 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:57.775638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54292f-5c6c-4bce-8707-ec1fffb2da13 None admin] PATH_INFO: `/v3/users/a8d0f408de2547718fb615bdb6f82045` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:57.789756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54292f-5c6c-4bce-8707-ec1fffb2da13 None admin] RBAC: Authorizing `identity:get_user(user_id=a8d0f408de2547718fb615bdb6f82045)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:57.791200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54292f-5c6c-4bce-8707-ec1fffb2da13 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:57.797517 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 532/1055] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:15:57 2022] GET /identity/v3/users/a8d0f408de2547718fb615bdb6f82045 => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:57.798398 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54292f-5c6c-4bce-8707-ec1fffb2da13 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:57.853940 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8690f-79ff-43a8-9020-7e7a0249af90 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:57.857643 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:57.890449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cd30f-7f3e-4455-908c-f5d928d4cf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:57.891109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cd30f-7f3e-4455-908c-f5d928d4cf46 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:57.891401 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cd30f-7f3e-4455-908c-f5d928d4cf46 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:57.891680 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cd30f-7f3e-4455-908c-f5d928d4cf46 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:57.892404 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8cd30f-7f3e-4455-908c-f5d928d4cf46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:57.892715 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8cd30f-7f3e-4455-908c-f5d928d4cf46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:57.894124 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8cd30f-7f3e-4455-908c-f5d928d4cf46 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:57.901173 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54292f-5c6c-4bce-8707-ec1fffb2da13 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:57.906514 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 524/1056] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:57.907809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b96ca5-09ae-4db4-b2fe-918a5b78902f None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:57.908176 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b96ca5-09ae-4db4-b2fe-918a5b78902f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:57.908441 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b96ca5-09ae-4db4-b2fe-918a5b78902f None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:57.909713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 525/1057] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:57.912559 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b96ca5-09ae-4db4-b2fe-918a5b78902f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:57.913682 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:57.937556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42929887-9c75-483e-8913-225c334b5b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:57.938205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42929887-9c75-483e-8913-225c334b5b4f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:57.938490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42929887-9c75-483e-8913-225c334b5b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:57.938767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42929887-9c75-483e-8913-225c334b5b4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:58.007691 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42929887-9c75-483e-8913-225c334b5b4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:58.009144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42929887-9c75-483e-8913-225c334b5b4f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:58.010517 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b96ca5-09ae-4db4-b2fe-918a5b78902f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:58.043634 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378f0c5-ad04-4e9b-9616-871176f9c666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:58.044415 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378f0c5-ad04-4e9b-9616-871176f9c666 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:58.044699 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378f0c5-ad04-4e9b-9616-871176f9c666 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:58.044970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378f0c5-ad04-4e9b-9616-871176f9c666 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:58.052038 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378f0c5-ad04-4e9b-9616-871176f9c666 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:58.053515 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378f0c5-ad04-4e9b-9616-871176f9c666 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:58.068622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-9378f0c5-ad04-4e9b-9616-871176f9c666 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:15:58.068622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:58.068622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:58.068622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:58.068622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:58.068622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:58.068622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:58.068622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:58.068622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:58.068622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:58.068622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:58.068622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:58.068622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:15:58.068622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:15:58.068622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:15:58.068622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:15:58.069783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:58.069783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:58.069783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:15:58.069783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:58.069783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:15:58.069783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:15:58.069783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:58.069783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:58.069783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:58.069783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:58.069783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:58.069783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:58.069783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:58.069783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:58.069783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:58.069783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:58.069783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:58.069783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:58.070732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:58.070732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:58.070732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:15:58.070732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:15:58.070732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:15:58.070732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:15:58.070732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:15:58.070732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:15:58.070732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:15:58.070732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:58.070732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 526/1058] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Jul 12 18:15:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:58.071383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01685d58-ad38-4798-bfad-abadac7ea29e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:58.071674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01685d58-ad38-4798-bfad-abadac7ea29e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:58.071949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01685d58-ad38-4798-bfad-abadac7ea29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:58.088202 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-01685d58-ad38-4798-bfad-abadac7ea29e None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:58.089414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-01685d58-ad38-4798-bfad-abadac7ea29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:58.107433 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:58.110739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 533/1059] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:15:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 18:15:58.111753 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42929887-9c75-483e-8913-225c334b5b4f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:58.123183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:58.155552 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 527/1060] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:15:58.156304 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01685d58-ad38-4798-bfad-abadac7ea29e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:58.211103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42929887-9c75-483e-8913-225c334b5b4f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:58.244298 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c595c-a401-45a2-88e5-6380d6d751a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:58.244957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c595c-a401-45a2-88e5-6380d6d751a9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:58.245240 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c595c-a401-45a2-88e5-6380d6d751a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:58.245543 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c595c-a401-45a2-88e5-6380d6d751a9 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:58.246371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c595c-a401-45a2-88e5-6380d6d751a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:58.246678 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c595c-a401-45a2-88e5-6380d6d751a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:58.248101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c595c-a401-45a2-88e5-6380d6d751a9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:58.256869 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01685d58-ad38-4798-bfad-abadac7ea29e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:58.266946 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 534/1061] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Jul 12 18:15:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:58.267736 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c595c-a401-45a2-88e5-6380d6d751a9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:58.290651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350efd3-ce75-4f04-86ee-a7a2753e71bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:58.291504 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350efd3-ce75-4f04-86ee-a7a2753e71bf None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:58.291788 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350efd3-ce75-4f04-86ee-a7a2753e71bf None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:58.292062 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350efd3-ce75-4f04-86ee-a7a2753e71bf None admin] PATH_INFO: `/v3/projects/e649f4185e4d430b9117035426084a13` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:58.293235 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350efd3-ce75-4f04-86ee-a7a2753e71bf None admin] RBAC: Authorizing `identity:get_project(project_id=e649f4185e4d430b9117035426084a13)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:58.294694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350efd3-ce75-4f04-86ee-a7a2753e71bf None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:58.296386 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 528/1062] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:15:58 2022] GET /identity/v3/projects/e649f4185e4d430b9117035426084a13 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:58.297185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350efd3-ce75-4f04-86ee-a7a2753e71bf None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:58.320669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:58.334459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:58.370049 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c595c-a401-45a2-88e5-6380d6d751a9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:58.395993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350efd3-ce75-4f04-86ee-a7a2753e71bf None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:58.402036 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badeecb5-041a-4532-a147-f317c954028d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:58.402814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeecb5-041a-4532-a147-f317c954028d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:58.403094 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeecb5-041a-4532-a147-f317c954028d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:58.403363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeecb5-041a-4532-a147-f317c954028d None admin] PATH_INFO: `/v3/services/image` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:58.403996 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badeecb5-041a-4532-a147-f317c954028d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:58.405380 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badeecb5-041a-4532-a147-f317c954028d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:58.417232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-badeecb5-041a-4532-a147-f317c954028d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:15:58.417232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:58.417232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:15:58.417232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:15:58.417232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:15:58.417232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:15:58.417232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:15:58.417232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:58.417232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:15:58.417232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:58.417232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:15:58.417232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:58.417232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:58.417232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:58.417232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:58.417232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:58.417232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:58.418200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:58.418200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:58.418200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:58.418200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:58.418200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:58.418200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:58.418200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:15:58.418200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:15:58.418200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:15:58.418200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:15:58.418200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:58.418200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:58.418200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:58.418200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:58.418200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:58.418200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:58.419551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:58.419551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:58.419551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:58.419551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:58.419551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:58.419551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:58.419551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:58.419551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:58.419551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:58.419551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:58.419551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:15:58.419551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:15:58.419551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:15:58.419551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:58.419551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 535/1063] 10.222.0.57 () {56 vars in 1105 bytes} [Tue Jul 12 18:15:58 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:58.420571 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badeecb5-041a-4532-a147-f317c954028d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:58.432785 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516688e-26db-40a0-a7a2-8bada9187854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:58.433758 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516688e-26db-40a0-a7a2-8bada9187854 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:58.434701 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516688e-26db-40a0-a7a2-8bada9187854 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:58.434701 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516688e-26db-40a0-a7a2-8bada9187854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:58.445097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516688e-26db-40a0-a7a2-8bada9187854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:58.446591 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516688e-26db-40a0-a7a2-8bada9187854 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:58.463868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-0516688e-26db-40a0-a7a2-8bada9187854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:58.463868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:58.463868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:58.463868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:58.463868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:58.463868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:58.463868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:58.463868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:58.463868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:58.463868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:58.463868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:58.463868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:58.463868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:15:58.463868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:15:58.463868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:15:58.464768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:15:58.464768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:58.464768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:58.464768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:58.464768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:58.464768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:58.464768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:58.464768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:58.464768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:58.464768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:58.464768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:58.464768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:58.464768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:58.464768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:58.464768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:58.464768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:58.464768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:58.465693 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:15:58.465693 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:15:58.465693 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:15:58.465693 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:15:58.465693 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 529/1064] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:15:58.465993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516688e-26db-40a0-a7a2-8bada9187854 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:58.524184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badeecb5-041a-4532-a147-f317c954028d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:58.539160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:58.553181 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:58.558411 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d386df2-a8b9-4c39-a846-4a7460f96811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:58.559068 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d386df2-a8b9-4c39-a846-4a7460f96811 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:58.559355 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d386df2-a8b9-4c39-a846-4a7460f96811 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:58.559632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d386df2-a8b9-4c39-a846-4a7460f96811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:58.560455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d386df2-a8b9-4c39-a846-4a7460f96811 None admin] RBAC: Adding query filter params (role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.project.id=e649f4185e4d430b9117035426084a13, user.id=a8d0f408de2547718fb615bdb6f82045) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:58.560767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d386df2-a8b9-4c39-a846-4a7460f96811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:58.562248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d386df2-a8b9-4c39-a846-4a7460f96811 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:58.567823 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 536/1065] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:15:58 2022] GET /identity/v3/role_assignments?user.id=a8d0f408de2547718fb615bdb6f82045&scope.project.id=e649f4185e4d430b9117035426084a13&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:58.568601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d386df2-a8b9-4c39-a846-4a7460f96811 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:58.572068 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516688e-26db-40a0-a7a2-8bada9187854 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:58.610876 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54ec78-7be1-463e-aa6f-688a3fa8db1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:58.611743 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54ec78-7be1-463e-aa6f-688a3fa8db1a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:58.612031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54ec78-7be1-463e-aa6f-688a3fa8db1a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:58.612632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54ec78-7be1-463e-aa6f-688a3fa8db1a None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:58.614315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54ec78-7be1-463e-aa6f-688a3fa8db1a None admin] RBAC: Adding query filter params (name=image) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:58.614644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54ec78-7be1-463e-aa6f-688a3fa8db1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:58.616092 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54ec78-7be1-463e-aa6f-688a3fa8db1a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:58.621929 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 530/1066] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:58.627696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54ec78-7be1-463e-aa6f-688a3fa8db1a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:58.696284 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d386df2-a8b9-4c39-a846-4a7460f96811 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:58.739675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54ec78-7be1-463e-aa6f-688a3fa8db1a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:58.748337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ead66-27fe-4a04-98f2-0c14749d8523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:58.749009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ead66-27fe-4a04-98f2-0c14749d8523 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:58.749378 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ead66-27fe-4a04-98f2-0c14749d8523 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:58.749657 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ead66-27fe-4a04-98f2-0c14749d8523 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:58.750376 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ead66-27fe-4a04-98f2-0c14749d8523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:58.750683 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ead66-27fe-4a04-98f2-0c14749d8523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:58.752050 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ead66-27fe-4a04-98f2-0c14749d8523 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:58.764710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 537/1067] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:15:58.770597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ead66-27fe-4a04-98f2-0c14749d8523 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:58.778384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ee953-2515-4d4a-9536-c7e56e41e1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:58.779425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ee953-2515-4d4a-9536-c7e56e41e1ca None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:58.779729 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ee953-2515-4d4a-9536-c7e56e41e1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:58.780004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ee953-2515-4d4a-9536-c7e56e41e1ca None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:58.780715 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ee953-2515-4d4a-9536-c7e56e41e1ca None admin] RBAC: Adding query filter params (type=image) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:58.781415 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ee953-2515-4d4a-9536-c7e56e41e1ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:58.783128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ee953-2515-4d4a-9536-c7e56e41e1ca None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:58.794106 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 531/1068] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:58.795127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ee953-2515-4d4a-9536-c7e56e41e1ca None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:58.797865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:58.843841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:58.891716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ead66-27fe-4a04-98f2-0c14749d8523 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:58.904257 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ee953-2515-4d4a-9536-c7e56e41e1ca None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:58.931211 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a502968-e1c0-46f5-a0d3-53e2a0544003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:58.932343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a502968-e1c0-46f5-a0d3-53e2a0544003 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:58.932860 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a502968-e1c0-46f5-a0d3-53e2a0544003 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:58.933393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a502968-e1c0-46f5-a0d3-53e2a0544003 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:58.940784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a502968-e1c0-46f5-a0d3-53e2a0544003 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:58.942296 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a502968-e1c0-46f5-a0d3-53e2a0544003 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:58.942408 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e8fc5-2f48-45b8-adc8-18ec5a00a1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:58.943246 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e8fc5-2f48-45b8-adc8-18ec5a00a1ee None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:58.943797 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e8fc5-2f48-45b8-adc8-18ec5a00a1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:58.944373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e8fc5-2f48-45b8-adc8-18ec5a00a1ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:58.945858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e8fc5-2f48-45b8-adc8-18ec5a00a1ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:58.947272 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e8fc5-2f48-45b8-adc8-18ec5a00a1ee None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:58.958012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-4a502968-e1c0-46f5-a0d3-53e2a0544003 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:58.958012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:15:58.958012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:15:58.958012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:15:58.958012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:15:58.958012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:15:58.958012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:15:58.958012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:15:58.958012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:15:58.958012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:15:58.958012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:15:58.958012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:15:58.958012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:15:58.958012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:15:58.958012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:15:58.959088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:15:58.959088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:15:58.959088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:15:58.959088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:15:58.959088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:15:58.959088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:15:58.959088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:15:58.959088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:15:58.959088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:15:58.959088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:15:58.959088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:15:58.959088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:15:58.959088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:15:58.959088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:15:58.959088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:15:58.959088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:15:58.959088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:15:58.960178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:15:58.960178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:15:58.960178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:15:58.960178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:15:58.960178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:15:58.960178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:15:58.960178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:15:58.960178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:15:58.963788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 538/1069] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:15:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:15:58.964908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a502968-e1c0-46f5-a0d3-53e2a0544003 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:58.974037 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 532/1070] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Jul 12 18:15:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:15:59.077102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a502968-e1c0-46f5-a0d3-53e2a0544003 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:59.096467 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:59.123318 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d802bd-248c-4b94-9749-0444ac31fed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:59.123969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d802bd-248c-4b94-9749-0444ac31fed0 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:59.124256 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d802bd-248c-4b94-9749-0444ac31fed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:59.124530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d802bd-248c-4b94-9749-0444ac31fed0 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:59.125354 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d802bd-248c-4b94-9749-0444ac31fed0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:15:59.125665 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d802bd-248c-4b94-9749-0444ac31fed0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:59.127127 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d802bd-248c-4b94-9749-0444ac31fed0 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:59.139733 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 539/1071] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:15:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:15:59.146126 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e8fc5-2f48-45b8-adc8-18ec5a00a1ee None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:59.206320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:59.250284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e8fc5-2f48-45b8-adc8-18ec5a00a1ee None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:59.285400 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bcf1c-31ae-4d3f-9ca4-dd7e3800d82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:59.286291 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bcf1c-31ae-4d3f-9ca4-dd7e3800d82b None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:59.286634 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bcf1c-31ae-4d3f-9ca4-dd7e3800d82b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:59.286917 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bcf1c-31ae-4d3f-9ca4-dd7e3800d82b None admin] PATH_INFO: `/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/a7c1bb51c2b642ffa4708122d826fc67/roles/70c740362c964f449be0b5c279cb35c0` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:59.289099 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65bcf1c-31ae-4d3f-9ca4-dd7e3800d82b None admin] RBAC: Authorizing `identity:create_grant(project_id=5fee99b2e9234f88ac79ff70429b6f20, user_id=a7c1bb51c2b642ffa4708122d826fc67, role_id=70c740362c964f449be0b5c279cb35c0)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:59.290567 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65bcf1c-31ae-4d3f-9ca4-dd7e3800d82b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:59.305711 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 533/1072] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:15:59 2022] PUT /identity/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/a7c1bb51c2b642ffa4708122d826fc67/roles/70c740362c964f449be0b5c279cb35c0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:16:00.574802 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0136862-103e-4252-8530-115ca5b49334 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:00.575268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0136862-103e-4252-8530-115ca5b49334 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:00.575349 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0136862-103e-4252-8530-115ca5b49334 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:00.577015 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 540/1073] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:16:00.582049 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e7bd2-5e1d-440d-a936-5cc7efb355b6 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:00.582465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e7bd2-5e1d-440d-a936-5cc7efb355b6 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:00.582674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e7bd2-5e1d-440d-a936-5cc7efb355b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:00.599439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d12e7bd2-5e1d-440d-a936-5cc7efb355b6 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:00.600605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d12e7bd2-5e1d-440d-a936-5cc7efb355b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:00.670253 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 534/1074] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:16:00.693605 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0136862-103e-4252-8530-115ca5b49334 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:00.793867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0136862-103e-4252-8530-115ca5b49334 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:00.827265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f447f2f-2a54-4531-bb14-1cd0256dd14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:00.827982 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f447f2f-2a54-4531-bb14-1cd0256dd14e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:00.828264 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f447f2f-2a54-4531-bb14-1cd0256dd14e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:00.828538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f447f2f-2a54-4531-bb14-1cd0256dd14e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:00.838606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f447f2f-2a54-4531-bb14-1cd0256dd14e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:16:00.846307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-2f447f2f-2a54-4531-bb14-1cd0256dd14e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:16:00.846307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:16:00.846307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:16:00.846307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:16:00.846307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:16:00.846307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:16:00.846307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:16:00.846307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:16:00.846307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:16:00.846307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:16:00.846307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:16:00.846307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:16:00.846307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:16:00.846307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:16:00.846307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:16:00.846307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:16:00.847253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:16:00.847253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:16:00.847253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:16:00.847253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:16:00.847253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:16:00.847253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:16:00.847253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:16:00.847253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:16:00.847253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:16:00.847253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:16:00.847253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:16:00.847253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:16:00.847253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:16:00.847253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:16:00.847253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:16:00.847253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:16:00.848641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:16:00.848641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:16:00.848641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:16:00.848641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:16:00.848641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:16:00.848641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:16:00.848641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:16:00.848641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:16:00.848641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:16:00.848641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:16:00.848641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:16:00.848641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:16:00.853051 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 541/1075] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:16:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:16:00.854314 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e7bd2-5e1d-440d-a936-5cc7efb355b6 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:00.903092 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:00.955417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e7bd2-5e1d-440d-a936-5cc7efb355b6 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:00.990377 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5cdce-122b-44a7-b8a2-1907a8f7627c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:00.991051 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5cdce-122b-44a7-b8a2-1907a8f7627c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:00.991334 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5cdce-122b-44a7-b8a2-1907a8f7627c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:00.991612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5cdce-122b-44a7-b8a2-1907a8f7627c None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:00.992362 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5cdce-122b-44a7-b8a2-1907a8f7627c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:00.992673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5cdce-122b-44a7-b8a2-1907a8f7627c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:00.994083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5cdce-122b-44a7-b8a2-1907a8f7627c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:01.006864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 535/1076] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:16:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:01.008171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f447f2f-2a54-4531-bb14-1cd0256dd14e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:01.040759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:01.066455 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19896192-75ef-4440-8946-ee13cffd5ef2 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:01.066743 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19896192-75ef-4440-8946-ee13cffd5ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:01.067026 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19896192-75ef-4440-8946-ee13cffd5ef2 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:01.068561 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 536/1077] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:16:01.073661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74186ce-1593-497e-840d-af9d8eebf8ef None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:01.073961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74186ce-1593-497e-840d-af9d8eebf8ef None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:01.074242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74186ce-1593-497e-840d-af9d8eebf8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:01.091340 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e74186ce-1593-497e-840d-af9d8eebf8ef None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:01.092456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e74186ce-1593-497e-840d-af9d8eebf8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:01.115147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f447f2f-2a54-4531-bb14-1cd0256dd14e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:01.150560 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac051c1-5b13-4a87-88f9-276c7bc8e2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:01.152138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac051c1-5b13-4a87-88f9-276c7bc8e2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:01.152852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac051c1-5b13-4a87-88f9-276c7bc8e2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:01.153336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac051c1-5b13-4a87-88f9-276c7bc8e2a1 None admin] PATH_INFO: `/v3/users/a8d0f408de2547718fb615bdb6f82045` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:01.155185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac051c1-5b13-4a87-88f9-276c7bc8e2a1 None admin] RBAC: Authorizing `identity:get_user(user_id=a8d0f408de2547718fb615bdb6f82045)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:01.157242 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac051c1-5b13-4a87-88f9-276c7bc8e2a1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:01.160152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 542/1078] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:16:01 2022] GET /identity/v3/users/a8d0f408de2547718fb615bdb6f82045 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:01.165028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 537/1079] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:16:01.165851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac051c1-5b13-4a87-88f9-276c7bc8e2a1 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:01.189751 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74186ce-1593-497e-840d-af9d8eebf8ef None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:01.234919 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:01.269529 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:01.273087 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac051c1-5b13-4a87-88f9-276c7bc8e2a1 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:01.301885 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74186ce-1593-497e-840d-af9d8eebf8ef None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:01.310771 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51f8d0-08de-4dec-84a8-023fe53ae24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:01.311636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51f8d0-08de-4dec-84a8-023fe53ae24c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:01.311923 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51f8d0-08de-4dec-84a8-023fe53ae24c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:01.312196 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51f8d0-08de-4dec-84a8-023fe53ae24c None admin] PATH_INFO: `/v3/projects/e649f4185e4d430b9117035426084a13` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:01.313554 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51f8d0-08de-4dec-84a8-023fe53ae24c None admin] RBAC: Authorizing `identity:get_project(project_id=e649f4185e4d430b9117035426084a13)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:01.314992 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51f8d0-08de-4dec-84a8-023fe53ae24c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:01.316890 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 543/1080] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:16:01 2022] GET /identity/v3/projects/e649f4185e4d430b9117035426084a13 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:01.322667 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51f8d0-08de-4dec-84a8-023fe53ae24c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:01.339556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0407e-26d6-40ec-a1a7-0d8bd2b64abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:01.340216 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0407e-26d6-40ec-a1a7-0d8bd2b64abe None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:01.340522 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0407e-26d6-40ec-a1a7-0d8bd2b64abe None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:01.340770 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0407e-26d6-40ec-a1a7-0d8bd2b64abe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:01.417896 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0407e-26d6-40ec-a1a7-0d8bd2b64abe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:01.419362 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0407e-26d6-40ec-a1a7-0d8bd2b64abe None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:01.430826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51f8d0-08de-4dec-84a8-023fe53ae24c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:01.462843 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:01.466792 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75748620-d8f2-4de1-9000-e8e6ef2895c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:01.467292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75748620-d8f2-4de1-9000-e8e6ef2895c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:01.467502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75748620-d8f2-4de1-9000-e8e6ef2895c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:01.467778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75748620-d8f2-4de1-9000-e8e6ef2895c6 None admin] PATH_INFO: `/v3/projects/e649f4185e4d430b9117035426084a13/users/a8d0f408de2547718fb615bdb6f82045/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:01.469800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75748620-d8f2-4de1-9000-e8e6ef2895c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e649f4185e4d430b9117035426084a13, user_id=a8d0f408de2547718fb615bdb6f82045, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:01.471231 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75748620-d8f2-4de1-9000-e8e6ef2895c6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:01.484779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 544/1081] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:16:01 2022] PUT /identity/v3/projects/e649f4185e4d430b9117035426084a13/users/a8d0f408de2547718fb615bdb6f82045/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:16:01.486031 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70c93-965a-4627-ac76-2b4d736f1bae None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:01.486314 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70c93-965a-4627-ac76-2b4d736f1bae None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:01.486588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70c93-965a-4627-ac76-2b4d736f1bae None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:01.487855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 545/1082] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:16:01.494282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6471a38-d792-498d-89ef-d3585aa5710e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:01.494637 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6471a38-d792-498d-89ef-d3585aa5710e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:01.494923 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6471a38-d792-498d-89ef-d3585aa5710e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:01.512679 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e6471a38-d792-498d-89ef-d3585aa5710e None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:01.513940 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e6471a38-d792-498d-89ef-d3585aa5710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:01.539985 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:01.542331 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 538/1083] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:16:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 18:16:01.549733 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0407e-26d6-40ec-a1a7-0d8bd2b64abe None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:01.594251 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 546/1084] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:16:01.622322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6471a38-d792-498d-89ef-d3585aa5710e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:01.682089 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0407e-26d6-40ec-a1a7-0d8bd2b64abe None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:01.724449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af3599-9a53-411e-a0a5-d914b992191e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:01.725416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af3599-9a53-411e-a0a5-d914b992191e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:01.726042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af3599-9a53-411e-a0a5-d914b992191e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:01.726553 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af3599-9a53-411e-a0a5-d914b992191e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:01.735642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6471a38-d792-498d-89ef-d3585aa5710e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:01.736116 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:01.738970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af3599-9a53-411e-a0a5-d914b992191e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:01.740006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af3599-9a53-411e-a0a5-d914b992191e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:01.759194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-31af3599-9a53-411e-a0a5-d914b992191e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:16:01.759194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:16:01.759194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:16:01.759194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:16:01.759194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:16:01.759194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:16:01.759194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:16:01.759194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:16:01.759194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:16:01.759194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:16:01.759194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:16:01.759194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:16:01.759194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:16:01.759194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:16:01.759194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:16:01.760170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:16:01.760170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:16:01.760170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:16:01.760170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:16:01.760170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:16:01.760170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:16:01.760170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:16:01.760170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:16:01.760170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:16:01.760170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:16:01.760170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:16:01.760170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:16:01.760170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:16:01.760170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:16:01.760170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:16:01.760170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:16:01.760170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:16:01.761740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:16:01.761740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:16:01.761740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:16:01.761740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:16:01.761740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 539/1085] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:16:01.766569 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af3599-9a53-411e-a0a5-d914b992191e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:01.775651 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403a148-2a5c-4d4a-9259-a789c4a8e01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:01.776475 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403a148-2a5c-4d4a-9259-a789c4a8e01f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:01.776759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403a148-2a5c-4d4a-9259-a789c4a8e01f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:01.777033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403a148-2a5c-4d4a-9259-a789c4a8e01f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:01.790380 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403a148-2a5c-4d4a-9259-a789c4a8e01f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:16:01.799872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-9403a148-2a5c-4d4a-9259-a789c4a8e01f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:16:01.799872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:16:01.799872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:16:01.799872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:16:01.799872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:16:01.799872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:16:01.799872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:16:01.799872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:16:01.799872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:16:01.799872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:16:01.799872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:16:01.799872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:16:01.799872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:16:01.799872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:16:01.799872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:16:01.799872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:16:01.800950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:16:01.800950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:16:01.800950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:16:01.800950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:16:01.800950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:16:01.800950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:16:01.800950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:16:01.800950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:16:01.800950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:16:01.800950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:16:01.800950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:16:01.800950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:16:01.800950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:16:01.800950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:16:01.800950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:16:01.800950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:16:01.801994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:16:01.801994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:16:01.801994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:16:01.801994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:16:01.801994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:16:01.801994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:16:01.801994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:16:01.801994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:16:01.801994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:16:01.801994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:16:01.801994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:16:01.801994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:16:01.801994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 547/1086] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Jul 12 18:16:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:16:01.806879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403a148-2a5c-4d4a-9259-a789c4a8e01f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:01.828705 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:01.878683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af3599-9a53-411e-a0a5-d914b992191e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:01.914654 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f6ba3-4db0-4aa7-8c28-d4b4572f78ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:01.915321 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f6ba3-4db0-4aa7-8c28-d4b4572f78ac None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:01.915603 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f6ba3-4db0-4aa7-8c28-d4b4572f78ac None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:01.915881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f6ba3-4db0-4aa7-8c28-d4b4572f78ac None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:01.916607 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f6ba3-4db0-4aa7-8c28-d4b4572f78ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:01.916903 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f6ba3-4db0-4aa7-8c28-d4b4572f78ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:01.918335 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f6ba3-4db0-4aa7-8c28-d4b4572f78ac None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:01.925661 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403a148-2a5c-4d4a-9259-a789c4a8e01f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:01.930517 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 540/1087] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:16:01.965118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b57038-caaf-4ea1-a49a-4d0a5a859c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:01.965782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b57038-caaf-4ea1-a49a-4d0a5a859c20 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:01.966067 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b57038-caaf-4ea1-a49a-4d0a5a859c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:01.966345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b57038-caaf-4ea1-a49a-4d0a5a859c20 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:01.967117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b57038-caaf-4ea1-a49a-4d0a5a859c20 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:01.967429 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b57038-caaf-4ea1-a49a-4d0a5a859c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:01.968838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b57038-caaf-4ea1-a49a-4d0a5a859c20 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:01.983472 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 548/1088] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Jul 12 18:16:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:16:01.984651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f6ba3-4db0-4aa7-8c28-d4b4572f78ac None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:02.042939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:02.097726 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f6ba3-4db0-4aa7-8c28-d4b4572f78ac None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:02.132428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96af81-6d9c-4cd2-b15f-80611372f4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:02.133086 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96af81-6d9c-4cd2-b15f-80611372f4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:02.133395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96af81-6d9c-4cd2-b15f-80611372f4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:02.133677 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96af81-6d9c-4cd2-b15f-80611372f4b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:02.145395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96af81-6d9c-4cd2-b15f-80611372f4b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:02.146866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96af81-6d9c-4cd2-b15f-80611372f4b7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:02.164353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-bb96af81-6d9c-4cd2-b15f-80611372f4b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:16:02.164353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:16:02.164353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:16:02.164353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:16:02.164353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:16:02.164353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:16:02.164353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:16:02.164353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:16:02.164353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:16:02.164353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:16:02.164353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:16:02.164353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:16:02.164353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:16:02.164353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:16:02.164353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:16:02.165575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:16:02.165575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:16:02.165575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:16:02.165575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:16:02.165575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:16:02.165575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:16:02.165575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:16:02.165575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:16:02.165575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:16:02.165575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:16:02.165575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:16:02.165575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:16:02.165575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:16:02.165575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:16:02.165575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:16:02.165575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:16:02.165575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:16:02.166691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:16:02.166691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:16:02.166691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:16:02.166691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:16:02.166691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 541/1089] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:16:02.171629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b57038-caaf-4ea1-a49a-4d0a5a859c20 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:02.258966 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:02.277770 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b57038-caaf-4ea1-a49a-4d0a5a859c20 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:02.310066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7e059-54f6-45ad-95be-a200eae9809b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:02.310718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7e059-54f6-45ad-95be-a200eae9809b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:02.311003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7e059-54f6-45ad-95be-a200eae9809b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:02.311282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7e059-54f6-45ad-95be-a200eae9809b None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:02.311993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7e059-54f6-45ad-95be-a200eae9809b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:02.312303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7e059-54f6-45ad-95be-a200eae9809b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:02.313706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7e059-54f6-45ad-95be-a200eae9809b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:02.326078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 549/1090] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:02.331585 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96af81-6d9c-4cd2-b15f-80611372f4b7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:02.431988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96af81-6d9c-4cd2-b15f-80611372f4b7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:02.435949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:02.469184 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2139ac9-15a9-419a-8450-7e8bbdd4dadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:02.470006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2139ac9-15a9-419a-8450-7e8bbdd4dadb None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:02.470291 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2139ac9-15a9-419a-8450-7e8bbdd4dadb None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:02.470567 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2139ac9-15a9-419a-8450-7e8bbdd4dadb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:02.478676 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2139ac9-15a9-419a-8450-7e8bbdd4dadb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:02.480260 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2139ac9-15a9-419a-8450-7e8bbdd4dadb None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:02.502273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-b2139ac9-15a9-419a-8450-7e8bbdd4dadb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:16:02.502273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:16:02.502273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:16:02.502273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:16:02.502273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:16:02.502273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:16:02.502273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:16:02.502273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:16:02.502273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:16:02.502273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:16:02.502273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:16:02.502273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:16:02.502273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:16:02.502273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:16:02.502273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:16:02.502273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:16:02.503452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:16:02.503452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:16:02.503452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:16:02.503452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:16:02.503452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:16:02.503452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:16:02.503452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:16:02.503452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:16:02.503452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:16:02.503452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:16:02.503452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:16:02.503452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:16:02.503452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:16:02.503452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:16:02.503452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:16:02.503452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:16:02.503452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:16:02.503452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:16:02.504749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:16:02.504749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:16:02.504749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:16:02.504749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:16:02.504749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:16:02.504749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:16:02.504749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:16:02.504749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:16:02.504749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:16:02.504749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:16:02.504749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 542/1091] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Jul 12 18:16:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:16:02.509198 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7e059-54f6-45ad-95be-a200eae9809b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:02.611148 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7e059-54f6-45ad-95be-a200eae9809b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:02.643826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816fb1b-8794-4a2e-a4d6-b1626fb01371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:02.645017 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816fb1b-8794-4a2e-a4d6-b1626fb01371 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:02.645318 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816fb1b-8794-4a2e-a4d6-b1626fb01371 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:02.645592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816fb1b-8794-4a2e-a4d6-b1626fb01371 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:02.646421 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816fb1b-8794-4a2e-a4d6-b1626fb01371 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:02.646726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816fb1b-8794-4a2e-a4d6-b1626fb01371 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:02.648147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816fb1b-8794-4a2e-a4d6-b1626fb01371 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:02.656731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:02.666694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 550/1092] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Jul 12 18:16:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:02.672284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2139ac9-15a9-419a-8450-7e8bbdd4dadb None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:02.767578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2139ac9-15a9-419a-8450-7e8bbdd4dadb None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:02.799337 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fc30f-6d33-4595-aca9-059da2d6b937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:02.799965 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fc30f-6d33-4595-aca9-059da2d6b937 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:02.800245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fc30f-6d33-4595-aca9-059da2d6b937 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:02.800543 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fc30f-6d33-4595-aca9-059da2d6b937 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:02.829773 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:02.867489 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11fc30f-6d33-4595-aca9-059da2d6b937 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:02.868942 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11fc30f-6d33-4595-aca9-059da2d6b937 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:02.962357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 543/1093] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:16:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:16:02.967770 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816fb1b-8794-4a2e-a4d6-b1626fb01371 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:03.065139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816fb1b-8794-4a2e-a4d6-b1626fb01371 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:03.098570 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd0ed2-6fe2-4d99-b657-64446cbc7c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:03.099356 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd0ed2-6fe2-4d99-b657-64446cbc7c86 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:03.099636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd0ed2-6fe2-4d99-b657-64446cbc7c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:03.099907 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd0ed2-6fe2-4d99-b657-64446cbc7c86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:03.109875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd0ed2-6fe2-4d99-b657-64446cbc7c86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:03.111317 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd0ed2-6fe2-4d99-b657-64446cbc7c86 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:03.129756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-16cd0ed2-6fe2-4d99-b657-64446cbc7c86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:16:03.129756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:16:03.129756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:16:03.129756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:16:03.129756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:16:03.129756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:16:03.129756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:16:03.129756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:16:03.129756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:16:03.129756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:16:03.129756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:16:03.129756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:16:03.129756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:16:03.129756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:16:03.129756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:16:03.130707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:16:03.130707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:16:03.130707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:16:03.130707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:16:03.130707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:16:03.130707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:16:03.130707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:16:03.130707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:16:03.130707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:16:03.130707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:16:03.130707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:16:03.130707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:16:03.130707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:16:03.130707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:16:03.130707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:16:03.130707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:16:03.130707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:16:03.131602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:16:03.131602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:16:03.131602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:16:03.131602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:16:03.131602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 551/1094] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:16:03.136445 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fc30f-6d33-4595-aca9-059da2d6b937 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:03.195640 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:03.233043 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fc30f-6d33-4595-aca9-059da2d6b937 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:03.264850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd88c0-0255-480b-a689-006f5fc6ebc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:03.265538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd88c0-0255-480b-a689-006f5fc6ebc1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:03.265820 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd88c0-0255-480b-a689-006f5fc6ebc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:03.266088 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd88c0-0255-480b-a689-006f5fc6ebc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:03.266796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd88c0-0255-480b-a689-006f5fc6ebc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:03.267100 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd88c0-0255-480b-a689-006f5fc6ebc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:03.268461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd88c0-0255-480b-a689-006f5fc6ebc1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:03.279841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 544/1095] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:03.286006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd0ed2-6fe2-4d99-b657-64446cbc7c86 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:03.334743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:03.385061 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd0ed2-6fe2-4d99-b657-64446cbc7c86 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:03.419767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e4add-a2eb-495b-95b2-794ad8e43f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:03.420557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e4add-a2eb-495b-95b2-794ad8e43f87 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:03.420841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e4add-a2eb-495b-95b2-794ad8e43f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:03.421117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e4add-a2eb-495b-95b2-794ad8e43f87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:03.427860 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e4add-a2eb-495b-95b2-794ad8e43f87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:03.429337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e4add-a2eb-495b-95b2-794ad8e43f87 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:03.443085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-d99e4add-a2eb-495b-95b2-794ad8e43f87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:16:03.443085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:16:03.443085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:16:03.443085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:16:03.443085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:16:03.443085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:16:03.443085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:16:03.443085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:16:03.443085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:16:03.443085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:16:03.443085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:16:03.443085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:16:03.443085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:16:03.443085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:16:03.443085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:16:03.444009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:16:03.444009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:16:03.444009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:16:03.444009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:16:03.444009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:16:03.444009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:16:03.444009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:16:03.444009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:16:03.444009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:16:03.444009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:16:03.444009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:16:03.444009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:16:03.444009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:16:03.444009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:16:03.444009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:16:03.444009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:16:03.444009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:16:03.444895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:16:03.444895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:16:03.444895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:16:03.444895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:16:03.444895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:16:03.444895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:16:03.444895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:16:03.444895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:16:03.444895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 552/1096] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:16:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:16:03.450373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd88c0-0255-480b-a689-006f5fc6ebc1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:03.505659 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574da93-d479-49c2-908f-0819d3289ec7 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:03.505934 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574da93-d479-49c2-908f-0819d3289ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:03.506214 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574da93-d479-49c2-908f-0819d3289ec7 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:03.508143 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 553/1097] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:16:03.512421 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e85641-310d-4917-928c-57fd31ddd7bd None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:03.512701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e85641-310d-4917-928c-57fd31ddd7bd None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:03.512974 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e85641-310d-4917-928c-57fd31ddd7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:03.529119 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-16e85641-310d-4917-928c-57fd31ddd7bd None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:03.530322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-16e85641-310d-4917-928c-57fd31ddd7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:03.551373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd88c0-0255-480b-a689-006f5fc6ebc1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:03.574233 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:03.586319 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafc8c6-d37b-4f4d-8cbd-a7ba5624aba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:03.586911 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafc8c6-d37b-4f4d-8cbd-a7ba5624aba8 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:03.587195 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafc8c6-d37b-4f4d-8cbd-a7ba5624aba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:03.587464 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafc8c6-d37b-4f4d-8cbd-a7ba5624aba8 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:03.588238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafc8c6-d37b-4f4d-8cbd-a7ba5624aba8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:03.588542 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafc8c6-d37b-4f4d-8cbd-a7ba5624aba8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:03.589992 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafc8c6-d37b-4f4d-8cbd-a7ba5624aba8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:03.601127 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 554/1098] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:16:03.607619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 545/1099] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:16:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:03.608715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e85641-310d-4917-928c-57fd31ddd7bd None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:03.624423 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafc8c6-d37b-4f4d-8cbd-a7ba5624aba8 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:03.649881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:03.707127 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e85641-310d-4917-928c-57fd31ddd7bd None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:03.721712 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafc8c6-d37b-4f4d-8cbd-a7ba5624aba8 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:03.741438 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd1957-ceb1-4424-b168-240101252e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:03.742079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd1957-ceb1-4424-b168-240101252e85 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:03.742360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd1957-ceb1-4424-b168-240101252e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:03.742634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd1957-ceb1-4424-b168-240101252e85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:03.743448 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd1957-ceb1-4424-b168-240101252e85 None admin] RBAC: Adding query filter params (role.id=70c740362c964f449be0b5c279cb35c0, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=a7c1bb51c2b642ffa4708122d826fc67) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:03.743754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd1957-ceb1-4424-b168-240101252e85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:03.745165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd1957-ceb1-4424-b168-240101252e85 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:03.750906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 555/1100] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:16:03 2022] GET /identity/v3/role_assignments?user.id=a7c1bb51c2b642ffa4708122d826fc67&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=70c740362c964f449be0b5c279cb35c0 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:16:03.755544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db800d-1005-46a8-9bc6-ecfb6f2a8efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:03.756347 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db800d-1005-46a8-9bc6-ecfb6f2a8efb None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:03.756626 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db800d-1005-46a8-9bc6-ecfb6f2a8efb None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:03.756898 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db800d-1005-46a8-9bc6-ecfb6f2a8efb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:03.768878 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db800d-1005-46a8-9bc6-ecfb6f2a8efb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:16:03.776995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-26db800d-1005-46a8-9bc6-ecfb6f2a8efb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:16:03.776995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:16:03.776995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:16:03.776995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:16:03.776995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:16:03.776995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:16:03.776995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:16:03.776995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:16:03.776995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:16:03.776995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:16:03.776995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:16:03.776995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:16:03.776995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:16:03.776995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:16:03.776995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:16:03.776995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:16:03.778243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:16:03.778243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:16:03.778243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:16:03.778243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:16:03.778243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:16:03.778243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:16:03.778243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:16:03.778243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:16:03.778243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:16:03.778243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:16:03.778243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:16:03.778243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:16:03.778243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:16:03.778243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:16:03.778243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:16:03.778243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:16:03.779207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:16:03.779207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:16:03.779207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:16:03.779207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:16:03.779207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:16:03.779207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:16:03.779207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:16:03.779207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:16:03.779207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:16:03.779207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:16:03.779207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:16:03.779207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:16:03.779207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 546/1101] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:16:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:16:03.784540 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd1957-ceb1-4424-b168-240101252e85 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:03.890801 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd1957-ceb1-4424-b168-240101252e85 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:03.893187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:03.927214 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567f41b-b133-4f0c-8c33-9f5f16482e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:03.927880 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567f41b-b133-4f0c-8c33-9f5f16482e84 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:03.928164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567f41b-b133-4f0c-8c33-9f5f16482e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:03.928441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567f41b-b133-4f0c-8c33-9f5f16482e84 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:03.929188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567f41b-b133-4f0c-8c33-9f5f16482e84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:03.929535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567f41b-b133-4f0c-8c33-9f5f16482e84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:03.930911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567f41b-b133-4f0c-8c33-9f5f16482e84 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:03.939625 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 556/1102] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:16:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:03.945695 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db800d-1005-46a8-9bc6-ecfb6f2a8efb None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:03.993854 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:04.049963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db800d-1005-46a8-9bc6-ecfb6f2a8efb None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:04.083362 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc38dd-862a-436e-bf85-8da5e4572e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:04.084229 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc38dd-862a-436e-bf85-8da5e4572e74 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:04.084505 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc38dd-862a-436e-bf85-8da5e4572e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:04.084774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc38dd-862a-436e-bf85-8da5e4572e74 None admin] PATH_INFO: `/v3/users/a8d0f408de2547718fb615bdb6f82045` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:04.085973 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc38dd-862a-436e-bf85-8da5e4572e74 None admin] RBAC: Authorizing `identity:get_user(user_id=a8d0f408de2547718fb615bdb6f82045)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:04.087404 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc38dd-862a-436e-bf85-8da5e4572e74 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:04.089201 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 547/1103] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:16:03 2022] GET /identity/v3/users/a8d0f408de2547718fb615bdb6f82045 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:04.094838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567f41b-b133-4f0c-8c33-9f5f16482e84 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:04.197555 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567f41b-b133-4f0c-8c33-9f5f16482e84 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:04.232247 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8749d06-aba2-48af-923d-bb90af39603a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:04.232906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8749d06-aba2-48af-923d-bb90af39603a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:04.233191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8749d06-aba2-48af-923d-bb90af39603a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:04.233496 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8749d06-aba2-48af-923d-bb90af39603a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:04.267832 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:04.303936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8749d06-aba2-48af-923d-bb90af39603a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:04.305433 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8749d06-aba2-48af-923d-bb90af39603a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:04.405438 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 557/1104] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:16:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:16:04.412125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc38dd-862a-436e-bf85-8da5e4572e74 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:04.521084 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc38dd-862a-436e-bf85-8da5e4572e74 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:04.540101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:04.570376 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc977c-5a17-48da-b7ff-ca5ccea63228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:04.571251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc977c-5a17-48da-b7ff-ca5ccea63228 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:04.571541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc977c-5a17-48da-b7ff-ca5ccea63228 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:04.571821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc977c-5a17-48da-b7ff-ca5ccea63228 None admin] PATH_INFO: `/v3/projects/e649f4185e4d430b9117035426084a13` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:04.573036 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc977c-5a17-48da-b7ff-ca5ccea63228 None admin] RBAC: Authorizing `identity:get_project(project_id=e649f4185e4d430b9117035426084a13)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:04.574772 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc977c-5a17-48da-b7ff-ca5ccea63228 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:04.576490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 548/1105] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:16:04 2022] GET /identity/v3/projects/e649f4185e4d430b9117035426084a13 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:04.582637 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8749d06-aba2-48af-923d-bb90af39603a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:04.649470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:04.683104 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8749d06-aba2-48af-923d-bb90af39603a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:04.715932 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fc202-bdee-4ffa-892a-fbdda5bfd32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:04.716571 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fc202-bdee-4ffa-892a-fbdda5bfd32a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:04.716852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fc202-bdee-4ffa-892a-fbdda5bfd32a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:04.717122 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fc202-bdee-4ffa-892a-fbdda5bfd32a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:04.717961 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fc202-bdee-4ffa-892a-fbdda5bfd32a None admin] RBAC: Adding query filter params (role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.project.id=e649f4185e4d430b9117035426084a13, user.id=a8d0f408de2547718fb615bdb6f82045) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:04.718270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fc202-bdee-4ffa-892a-fbdda5bfd32a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:04.719683 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fc202-bdee-4ffa-892a-fbdda5bfd32a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:04.725861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 558/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:16:04 2022] GET /identity/v3/role_assignments?user.id=a8d0f408de2547718fb615bdb6f82045&scope.project.id=e649f4185e4d430b9117035426084a13&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:06.731800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bbfd6-e671-4931-b6bf-da80aee281cf None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:06.732336 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bbfd6-e671-4931-b6bf-da80aee281cf None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:06.732336 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bbfd6-e671-4931-b6bf-da80aee281cf None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:06.733739 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 549/1107] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:16:06.739023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefe0e9-290a-40a2-8acf-ef47a69491fe None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:06.739428 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefe0e9-290a-40a2-8acf-ef47a69491fe None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:06.739615 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefe0e9-290a-40a2-8acf-ef47a69491fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:06.756487 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-beefe0e9-290a-40a2-8acf-ef47a69491fe None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:06.757718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-beefe0e9-290a-40a2-8acf-ef47a69491fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:06.822400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 559/1108] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:16:06.847775 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bbfd6-e671-4931-b6bf-da80aee281cf None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:06.945758 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bbfd6-e671-4931-b6bf-da80aee281cf None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:06.978925 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47705b2-6428-4629-a838-08058a2d5fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:06.979689 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47705b2-6428-4629-a838-08058a2d5fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:06.979967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47705b2-6428-4629-a838-08058a2d5fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:06.980236 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47705b2-6428-4629-a838-08058a2d5fd0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:06.981411 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47705b2-6428-4629-a838-08058a2d5fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:06.982833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47705b2-6428-4629-a838-08058a2d5fd0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:06.984379 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 550/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:16:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:06.989873 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefe0e9-290a-40a2-8acf-ef47a69491fe None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:07.046583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:07.086120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefe0e9-290a-40a2-8acf-ef47a69491fe None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:07.118824 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86bf50-1e69-468c-b24d-90a0892a1753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:07.119478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86bf50-1e69-468c-b24d-90a0892a1753 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:07.119770 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86bf50-1e69-468c-b24d-90a0892a1753 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:07.120048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86bf50-1e69-468c-b24d-90a0892a1753 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:07.120742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86bf50-1e69-468c-b24d-90a0892a1753 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:07.122196 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86bf50-1e69-468c-b24d-90a0892a1753 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:07.141739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 560/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Jul 12 18:16:06 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:16:09.176415 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94174d-29ba-4565-9cbf-85421e28e0de None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:09.177061 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94174d-29ba-4565-9cbf-85421e28e0de None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:09.177061 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94174d-29ba-4565-9cbf-85421e28e0de None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:09.178367 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 551/1111] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:16:09.183693 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4147ce8-afab-44f1-80b6-c8a2748f7077 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:09.184139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4147ce8-afab-44f1-80b6-c8a2748f7077 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:09.184252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4147ce8-afab-44f1-80b6-c8a2748f7077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:09.200805 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-f4147ce8-afab-44f1-80b6-c8a2748f7077 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:09.202013 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f4147ce8-afab-44f1-80b6-c8a2748f7077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:09.266512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 561/1112] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:16:09.292403 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94174d-29ba-4565-9cbf-85421e28e0de None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:09.341212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:09.390437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94174d-29ba-4565-9cbf-85421e28e0de None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:09.423881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33932e9a-9862-4f35-afd9-63158371e26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:09.424728 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33932e9a-9862-4f35-afd9-63158371e26c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:09.425008 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33932e9a-9862-4f35-afd9-63158371e26c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:09.425336 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33932e9a-9862-4f35-afd9-63158371e26c None admin] PATH_INFO: `/v3/roles/fb45aabab51d4c698f2da1840ff5920d` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:09.426849 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33932e9a-9862-4f35-afd9-63158371e26c None admin] RBAC: Authorizing `identity:get_role(role_id=fb45aabab51d4c698f2da1840ff5920d)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:09.428170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33932e9a-9862-4f35-afd9-63158371e26c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:09.429551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 552/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:16:09 2022] GET /identity/v3/roles/fb45aabab51d4c698f2da1840ff5920d => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:09.435357 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4147ce8-afab-44f1-80b6-c8a2748f7077 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:09.480041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:09.531805 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4147ce8-afab-44f1-80b6-c8a2748f7077 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:09.565248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e762ad-03b0-41ca-b26e-87dbf407eddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:09.566789 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e762ad-03b0-41ca-b26e-87dbf407eddc None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:09.566983 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e762ad-03b0-41ca-b26e-87dbf407eddc None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:09.567256 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e762ad-03b0-41ca-b26e-87dbf407eddc None admin] PATH_INFO: `/v3/users/5c6c3a972c1a463b984f392b3c60145e` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:09.581285 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e762ad-03b0-41ca-b26e-87dbf407eddc None admin] RBAC: Authorizing `identity:get_user(user_id=5c6c3a972c1a463b984f392b3c60145e)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:09.583310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e762ad-03b0-41ca-b26e-87dbf407eddc None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:09.584963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 562/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:16:09 2022] GET /identity/v3/users/5c6c3a972c1a463b984f392b3c60145e => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:09.590629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33932e9a-9862-4f35-afd9-63158371e26c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:09.684954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33932e9a-9862-4f35-afd9-63158371e26c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:09.701796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:09.719429 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b580524-6aba-433b-b895-1a719a8efa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:09.720056 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b580524-6aba-433b-b895-1a719a8efa84 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:09.720334 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b580524-6aba-433b-b895-1a719a8efa84 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:09.720603 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b580524-6aba-433b-b895-1a719a8efa84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:09.784139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b580524-6aba-433b-b895-1a719a8efa84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:09.785668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b580524-6aba-433b-b895-1a719a8efa84 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:09.879006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 553/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:16:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:16:09.884721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e762ad-03b0-41ca-b26e-87dbf407eddc None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:09.981557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e762ad-03b0-41ca-b26e-87dbf407eddc None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:09.983764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:10.014396 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d240fd-d6f9-41f4-93b9-59d4f8a6f064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:10.015231 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d240fd-d6f9-41f4-93b9-59d4f8a6f064 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:10.015509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d240fd-d6f9-41f4-93b9-59d4f8a6f064 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:10.015780 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d240fd-d6f9-41f4-93b9-59d4f8a6f064 None admin] PATH_INFO: `/v3/projects/e649f4185e4d430b9117035426084a13` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:10.016943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d240fd-d6f9-41f4-93b9-59d4f8a6f064 None admin] RBAC: Authorizing `identity:get_project(project_id=e649f4185e4d430b9117035426084a13)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:10.018398 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d240fd-d6f9-41f4-93b9-59d4f8a6f064 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:10.020552 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 563/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:16:09 2022] GET /identity/v3/projects/e649f4185e4d430b9117035426084a13 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:10.026444 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b580524-6aba-433b-b895-1a719a8efa84 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:10.043920 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:10.122690 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b580524-6aba-433b-b895-1a719a8efa84 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:10.155277 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f26a1-6d5a-4346-9d86-9027a29315bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:10.155920 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f26a1-6d5a-4346-9d86-9027a29315bf None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:10.156205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f26a1-6d5a-4346-9d86-9027a29315bf None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:10.156482 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f26a1-6d5a-4346-9d86-9027a29315bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:10.157369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f26a1-6d5a-4346-9d86-9027a29315bf None admin] RBAC: Adding query filter params (role.id=fb45aabab51d4c698f2da1840ff5920d, scope.project.id=e649f4185e4d430b9117035426084a13, user.id=5c6c3a972c1a463b984f392b3c60145e) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:10.157684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f26a1-6d5a-4346-9d86-9027a29315bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:10.159111 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f26a1-6d5a-4346-9d86-9027a29315bf None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:10.164958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 554/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:16:10 2022] GET /identity/v3/role_assignments?user.id=5c6c3a972c1a463b984f392b3c60145e&scope.project.id=e649f4185e4d430b9117035426084a13&role.id=fb45aabab51d4c698f2da1840ff5920d => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:12.143054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d5345-aec4-4f76-9a29-a73ec09e705a None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:12.143605 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d5345-aec4-4f76-9a29-a73ec09e705a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:12.143605 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d5345-aec4-4f76-9a29-a73ec09e705a None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:12.145494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 564/1118] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:16:12.150588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd53d28-e739-4ec7-b08f-15d6ef210476 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:12.151003 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd53d28-e739-4ec7-b08f-15d6ef210476 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:12.151138 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd53d28-e739-4ec7-b08f-15d6ef210476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:12.167970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-abd53d28-e739-4ec7-b08f-15d6ef210476 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:12.169128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-abd53d28-e739-4ec7-b08f-15d6ef210476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:12.232250 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 555/1119] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:16:12.254068 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d5345-aec4-4f76-9a29-a73ec09e705a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:12.352765 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d5345-aec4-4f76-9a29-a73ec09e705a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:12.385581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01af7da-261f-4371-9f35-4afe0897e242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:12.386422 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01af7da-261f-4371-9f35-4afe0897e242 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:12.386707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01af7da-261f-4371-9f35-4afe0897e242 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:12.386985 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01af7da-261f-4371-9f35-4afe0897e242 None admin] PATH_INFO: `/v3/roles/fb45aabab51d4c698f2da1840ff5920d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:12.388454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01af7da-261f-4371-9f35-4afe0897e242 None admin] RBAC: Authorizing `identity:get_role(role_id=fb45aabab51d4c698f2da1840ff5920d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:12.389856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01af7da-261f-4371-9f35-4afe0897e242 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:12.391201 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 565/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:16:12 2022] GET /identity/v3/roles/fb45aabab51d4c698f2da1840ff5920d => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:12.397431 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd53d28-e739-4ec7-b08f-15d6ef210476 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:12.408528 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:12.492681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd53d28-e739-4ec7-b08f-15d6ef210476 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:12.524786 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86985929-5e2f-4991-9618-d046204382f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:12.525657 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86985929-5e2f-4991-9618-d046204382f7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:12.525938 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86985929-5e2f-4991-9618-d046204382f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:12.526209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86985929-5e2f-4991-9618-d046204382f7 None admin] PATH_INFO: `/v3/users/5c6c3a972c1a463b984f392b3c60145e` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:12.527364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86985929-5e2f-4991-9618-d046204382f7 None admin] RBAC: Authorizing `identity:get_user(user_id=5c6c3a972c1a463b984f392b3c60145e)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:12.528785 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86985929-5e2f-4991-9618-d046204382f7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:12.530390 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 556/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:16:12 2022] GET /identity/v3/users/5c6c3a972c1a463b984f392b3c60145e => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:12.536784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01af7da-261f-4371-9f35-4afe0897e242 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:12.578878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:12.638252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01af7da-261f-4371-9f35-4afe0897e242 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:12.671183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d261e1c-70b8-4c54-9481-1201aaacdaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:12.671980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d261e1c-70b8-4c54-9481-1201aaacdaae None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:12.672279 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d261e1c-70b8-4c54-9481-1201aaacdaae None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:12.672559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d261e1c-70b8-4c54-9481-1201aaacdaae None admin] PATH_INFO: `/v3/projects/e649f4185e4d430b9117035426084a13` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:12.673756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d261e1c-70b8-4c54-9481-1201aaacdaae None admin] RBAC: Authorizing `identity:get_project(project_id=e649f4185e4d430b9117035426084a13)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:12.675759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d261e1c-70b8-4c54-9481-1201aaacdaae None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:12.677461 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 566/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:16:12 2022] GET /identity/v3/projects/e649f4185e4d430b9117035426084a13 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:12.683331 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86985929-5e2f-4991-9618-d046204382f7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:12.757698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:12.778093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86985929-5e2f-4991-9618-d046204382f7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:12.810977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bf0bc-0919-45f6-831b-f3ecac526104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:12.811861 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bf0bc-0919-45f6-831b-f3ecac526104 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:12.812148 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bf0bc-0919-45f6-831b-f3ecac526104 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:12.812425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bf0bc-0919-45f6-831b-f3ecac526104 None admin] PATH_INFO: `/v3/projects/e649f4185e4d430b9117035426084a13/users/5c6c3a972c1a463b984f392b3c60145e/roles/fb45aabab51d4c698f2da1840ff5920d` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:12.814658 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bf0bc-0919-45f6-831b-f3ecac526104 None admin] RBAC: Authorizing `identity:create_grant(project_id=e649f4185e4d430b9117035426084a13, user_id=5c6c3a972c1a463b984f392b3c60145e, role_id=fb45aabab51d4c698f2da1840ff5920d)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:12.816091 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bf0bc-0919-45f6-831b-f3ecac526104 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:12.828442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 557/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:16:12 2022] PUT /identity/v3/projects/e649f4185e4d430b9117035426084a13/users/5c6c3a972c1a463b984f392b3c60145e/roles/fb45aabab51d4c698f2da1840ff5920d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:16:14.805189 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718edd2-92e7-4e00-92b8-759aa355cf43 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:14.805742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718edd2-92e7-4e00-92b8-759aa355cf43 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:14.805926 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718edd2-92e7-4e00-92b8-759aa355cf43 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:14.807294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 567/1124] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:16:14.812324 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7494b-2eeb-490b-b085-348528c774d3 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:14.812697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7494b-2eeb-490b-b085-348528c774d3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:14.812881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7494b-2eeb-490b-b085-348528c774d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:14.830694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ebb7494b-2eeb-490b-b085-348528c774d3 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:14.832421 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ebb7494b-2eeb-490b-b085-348528c774d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:14.898044 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 558/1125] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:16:14.921811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718edd2-92e7-4e00-92b8-759aa355cf43 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:15.018891 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718edd2-92e7-4e00-92b8-759aa355cf43 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:15.027746 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:15.052737 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dd52d-86e5-4b04-84d7-4fa90b446ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:15.053606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dd52d-86e5-4b04-84d7-4fa90b446ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:15.053885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dd52d-86e5-4b04-84d7-4fa90b446ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:15.054156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dd52d-86e5-4b04-84d7-4fa90b446ab3 None admin] PATH_INFO: `/v3/roles/fb45aabab51d4c698f2da1840ff5920d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:15.055591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dd52d-86e5-4b04-84d7-4fa90b446ab3 None admin] RBAC: Authorizing `identity:get_role(role_id=fb45aabab51d4c698f2da1840ff5920d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:15.056942 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dd52d-86e5-4b04-84d7-4fa90b446ab3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:15.058296 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 568/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:16:14 2022] GET /identity/v3/roles/fb45aabab51d4c698f2da1840ff5920d => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:15.063930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7494b-2eeb-490b-b085-348528c774d3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:15.127421 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:15.160452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7494b-2eeb-490b-b085-348528c774d3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:15.192443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0607b-f1f6-46eb-b1ce-5976334607ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:15.193327 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0607b-f1f6-46eb-b1ce-5976334607ae None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:15.193615 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0607b-f1f6-46eb-b1ce-5976334607ae None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:15.193889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0607b-f1f6-46eb-b1ce-5976334607ae None admin] PATH_INFO: `/v3/users/5c6c3a972c1a463b984f392b3c60145e` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:15.195059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0607b-f1f6-46eb-b1ce-5976334607ae None admin] RBAC: Authorizing `identity:get_user(user_id=5c6c3a972c1a463b984f392b3c60145e)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:15.196492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0607b-f1f6-46eb-b1ce-5976334607ae None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:15.198383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 559/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:16:15 2022] GET /identity/v3/users/5c6c3a972c1a463b984f392b3c60145e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:15.204177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dd52d-86e5-4b04-84d7-4fa90b446ab3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:15.299580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dd52d-86e5-4b04-84d7-4fa90b446ab3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:15.333833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500ed11-0e79-4c1a-b2af-f85dbe22aeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:15.334468 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500ed11-0e79-4c1a-b2af-f85dbe22aeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:15.334748 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500ed11-0e79-4c1a-b2af-f85dbe22aeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:15.335023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500ed11-0e79-4c1a-b2af-f85dbe22aeb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:15.379637 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:15.401939 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500ed11-0e79-4c1a-b2af-f85dbe22aeb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:15.403380 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500ed11-0e79-4c1a-b2af-f85dbe22aeb6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:15.497811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 569/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:16:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:16:15.504524 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0607b-f1f6-46eb-b1ce-5976334607ae None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:15.601123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0607b-f1f6-46eb-b1ce-5976334607ae None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:15.633627 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258669e-724f-4d8e-919e-24e685654904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:15.634411 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258669e-724f-4d8e-919e-24e685654904 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:15.634687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258669e-724f-4d8e-919e-24e685654904 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:15.634954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258669e-724f-4d8e-919e-24e685654904 None admin] PATH_INFO: `/v3/projects/e649f4185e4d430b9117035426084a13` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:15.636104 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258669e-724f-4d8e-919e-24e685654904 None admin] RBAC: Authorizing `identity:get_project(project_id=e649f4185e4d430b9117035426084a13)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:15.637565 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258669e-724f-4d8e-919e-24e685654904 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:15.639225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 560/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:16:15 2022] GET /identity/v3/projects/e649f4185e4d430b9117035426084a13 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:15.645368 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500ed11-0e79-4c1a-b2af-f85dbe22aeb6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:15.718169 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:15.741159 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500ed11-0e79-4c1a-b2af-f85dbe22aeb6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:15.773208 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc000f-638e-45c9-97ff-f4f5eaa1f431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:15.773869 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc000f-638e-45c9-97ff-f4f5eaa1f431 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:15.774154 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc000f-638e-45c9-97ff-f4f5eaa1f431 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:15.774429 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc000f-638e-45c9-97ff-f4f5eaa1f431 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:15.775238 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc000f-638e-45c9-97ff-f4f5eaa1f431 None admin] RBAC: Adding query filter params (role.id=fb45aabab51d4c698f2da1840ff5920d, scope.project.id=e649f4185e4d430b9117035426084a13, user.id=5c6c3a972c1a463b984f392b3c60145e) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:15.775549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc000f-638e-45c9-97ff-f4f5eaa1f431 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:15.776967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc000f-638e-45c9-97ff-f4f5eaa1f431 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:15.782600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 570/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:16:15 2022] GET /identity/v3/role_assignments?user.id=5c6c3a972c1a463b984f392b3c60145e&scope.project.id=e649f4185e4d430b9117035426084a13&role.id=fb45aabab51d4c698f2da1840ff5920d => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:17.807523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57aa55-6dc5-4778-b90a-ed371dc0e0d5 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:17.808054 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57aa55-6dc5-4778-b90a-ed371dc0e0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:17.808054 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57aa55-6dc5-4778-b90a-ed371dc0e0d5 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:17.809511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 561/1131] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:16:17.814618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3c454-cfaa-473a-97f6-d2ee49b0ac23 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:17.815041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3c454-cfaa-473a-97f6-d2ee49b0ac23 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:17.815141 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3c454-cfaa-473a-97f6-d2ee49b0ac23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:17.832844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-f3d3c454-cfaa-473a-97f6-d2ee49b0ac23 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:17.834036 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f3d3c454-cfaa-473a-97f6-d2ee49b0ac23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:17.897470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 571/1132] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:16:17.921140 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57aa55-6dc5-4778-b90a-ed371dc0e0d5 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:17.925478 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:18.022250 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57aa55-6dc5-4778-b90a-ed371dc0e0d5 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:18.056780 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7f055-d658-43e4-9088-5cc90069ceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:18.057673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7f055-d658-43e4-9088-5cc90069ceb1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:18.057966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7f055-d658-43e4-9088-5cc90069ceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:18.058245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7f055-d658-43e4-9088-5cc90069ceb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:18.059495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7f055-d658-43e4-9088-5cc90069ceb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:18.061027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7f055-d658-43e4-9088-5cc90069ceb1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:18.062786 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 562/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:16:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:18.068698 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3c454-cfaa-473a-97f6-d2ee49b0ac23 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:18.135451 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:18.166699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3c454-cfaa-473a-97f6-d2ee49b0ac23 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:18.199215 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca41f7-3c72-4ebe-82f1-954647e1afea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:18.199862 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca41f7-3c72-4ebe-82f1-954647e1afea None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:18.200145 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca41f7-3c72-4ebe-82f1-954647e1afea None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:18.200421 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca41f7-3c72-4ebe-82f1-954647e1afea None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:18.201128 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca41f7-3c72-4ebe-82f1-954647e1afea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:18.202591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca41f7-3c72-4ebe-82f1-954647e1afea None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:18.227368 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 572/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Jul 12 18:16:18 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:16:20.276635 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd9920-a161-488a-ac8a-f6c018d70479 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:20.277182 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd9920-a161-488a-ac8a-f6c018d70479 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:20.277316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd9920-a161-488a-ac8a-f6c018d70479 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:20.278620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 563/1135] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:16:20.283865 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e292115-aff8-41f0-aeab-de4bff0708a4 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:20.284799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e292115-aff8-41f0-aeab-de4bff0708a4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:20.284937 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e292115-aff8-41f0-aeab-de4bff0708a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:20.302846 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-7e292115-aff8-41f0-aeab-de4bff0708a4 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:20.304034 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7e292115-aff8-41f0-aeab-de4bff0708a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:20.368726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 573/1136] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:16:20.394038 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd9920-a161-488a-ac8a-f6c018d70479 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:20.463156 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:20.492418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd9920-a161-488a-ac8a-f6c018d70479 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:20.525008 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807aaaaa-26d3-4924-92cb-6c137f0fe192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:20.525816 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807aaaaa-26d3-4924-92cb-6c137f0fe192 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:20.526102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807aaaaa-26d3-4924-92cb-6c137f0fe192 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:20.526405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807aaaaa-26d3-4924-92cb-6c137f0fe192 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:20.527627 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807aaaaa-26d3-4924-92cb-6c137f0fe192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:20.529016 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807aaaaa-26d3-4924-92cb-6c137f0fe192 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:20.530632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 564/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:16:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:20.536923 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e292115-aff8-41f0-aeab-de4bff0708a4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:20.587971 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:20.633820 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e292115-aff8-41f0-aeab-de4bff0708a4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:20.668407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ab407-90ac-4f95-ad05-73c41687409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:20.669069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ab407-90ac-4f95-ad05-73c41687409a None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:20.669380 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ab407-90ac-4f95-ad05-73c41687409a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:20.669659 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ab407-90ac-4f95-ad05-73c41687409a None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:20.670365 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ab407-90ac-4f95-ad05-73c41687409a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:20.671798 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ab407-90ac-4f95-ad05-73c41687409a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:20.691540 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 574/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Jul 12 18:16:20 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:16:22.736854 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a56f1-c2b1-47ee-aa12-3fd27aa91be4 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:22.737429 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a56f1-c2b1-47ee-aa12-3fd27aa91be4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:22.737529 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a56f1-c2b1-47ee-aa12-3fd27aa91be4 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:22.738843 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 565/1139] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:16:22.743906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441b792-82dc-45f5-9c0a-9dfa0cc5db07 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:22.744282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441b792-82dc-45f5-9c0a-9dfa0cc5db07 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:22.744459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441b792-82dc-45f5-9c0a-9dfa0cc5db07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:22.760675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8441b792-82dc-45f5-9c0a-9dfa0cc5db07 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:22.761881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8441b792-82dc-45f5-9c0a-9dfa0cc5db07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:22.825910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 575/1140] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:16:22.848642 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a56f1-c2b1-47ee-aa12-3fd27aa91be4 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:22.947289 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a56f1-c2b1-47ee-aa12-3fd27aa91be4 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:22.979565 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e6642-44f5-412e-a578-85b8a190dcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:22.980345 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e6642-44f5-412e-a578-85b8a190dcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:22.980630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e6642-44f5-412e-a578-85b8a190dcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:22.980909 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e6642-44f5-412e-a578-85b8a190dcb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:22.988871 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:22.992219 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e6642-44f5-412e-a578-85b8a190dcb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:16:23.000011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-270e6642-44f5-412e-a578-85b8a190dcb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:16:23.000011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:16:23.000011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:16:23.000011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:16:23.000011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:16:23.000011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:16:23.000011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:16:23.000011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:16:23.000011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:16:23.000011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:16:23.000011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:16:23.000011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:16:23.000011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:16:23.000011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:16:23.000011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:16:23.000011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:16:23.001170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:16:23.001170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:16:23.001170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:16:23.001170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:16:23.001170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:16:23.001170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:16:23.001170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:16:23.001170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:16:23.001170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:16:23.001170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:16:23.001170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:16:23.001170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:16:23.001170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:16:23.001170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:16:23.001170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:16:23.001170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:16:23.002251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:16:23.002251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:16:23.002251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:16:23.002251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:16:23.002251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:16:23.002251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:16:23.002251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:16:23.002251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:16:23.002251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:16:23.002251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:16:23.002251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:16:23.002251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:16:23.002251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 566/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:16:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:16:23.007536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441b792-82dc-45f5-9c0a-9dfa0cc5db07 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:23.045624 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:23.105115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441b792-82dc-45f5-9c0a-9dfa0cc5db07 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:23.137786 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82517b-e708-46a3-ad46-0f05d2560b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:23.138435 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82517b-e708-46a3-ad46-0f05d2560b9d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:23.138715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82517b-e708-46a3-ad46-0f05d2560b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:23.138988 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82517b-e708-46a3-ad46-0f05d2560b9d None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:23.139718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82517b-e708-46a3-ad46-0f05d2560b9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:23.140023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82517b-e708-46a3-ad46-0f05d2560b9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:23.141402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82517b-e708-46a3-ad46-0f05d2560b9d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:23.149222 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 576/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:16:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:23.154783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e6642-44f5-412e-a578-85b8a190dcb6 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:23.251096 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e6642-44f5-412e-a578-85b8a190dcb6 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:23.282144 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2da30-2549-464c-ab39-c1ed00126800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:23.282984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2da30-2549-464c-ab39-c1ed00126800 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:23.283264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2da30-2549-464c-ab39-c1ed00126800 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:23.283535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2da30-2549-464c-ab39-c1ed00126800 None admin] PATH_INFO: `/v3/users/5ebc0a6f41f94f23a952dbdbdab345d5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:23.296562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2da30-2549-464c-ab39-c1ed00126800 None admin] RBAC: Authorizing `identity:get_user(user_id=5ebc0a6f41f94f23a952dbdbdab345d5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:23.298079 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2da30-2549-464c-ab39-c1ed00126800 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:23.300395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 567/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:16:23 2022] GET /identity/v3/users/5ebc0a6f41f94f23a952dbdbdab345d5 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:23.306943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82517b-e708-46a3-ad46-0f05d2560b9d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:23.400921 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:23.403999 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82517b-e708-46a3-ad46-0f05d2560b9d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:23.437100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42280e2f-42ba-420f-8f34-1ed954cc5111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:23.437769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42280e2f-42ba-420f-8f34-1ed954cc5111 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:23.438055 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42280e2f-42ba-420f-8f34-1ed954cc5111 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:23.438332 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42280e2f-42ba-420f-8f34-1ed954cc5111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:23.503200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42280e2f-42ba-420f-8f34-1ed954cc5111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:23.504633 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42280e2f-42ba-420f-8f34-1ed954cc5111 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:23.596612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:23.600908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 577/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:16:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:16:23.606686 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2da30-2549-464c-ab39-c1ed00126800 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:23.662487 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:23.701805 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2da30-2549-464c-ab39-c1ed00126800 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:23.736351 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf840662-168e-4559-8163-2e58d9720c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:23.737233 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf840662-168e-4559-8163-2e58d9720c62 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:23.737814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf840662-168e-4559-8163-2e58d9720c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:23.737814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf840662-168e-4559-8163-2e58d9720c62 None admin] PATH_INFO: `/v3/projects/5cb4aa8e9a164018ae2c6fc8d092c229` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:23.738945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf840662-168e-4559-8163-2e58d9720c62 None admin] RBAC: Authorizing `identity:get_project(project_id=5cb4aa8e9a164018ae2c6fc8d092c229)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:23.740370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf840662-168e-4559-8163-2e58d9720c62 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:23.742064 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 568/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:16:23 2022] GET /identity/v3/projects/5cb4aa8e9a164018ae2c6fc8d092c229 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:23.748083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42280e2f-42ba-420f-8f34-1ed954cc5111 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:23.844551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42280e2f-42ba-420f-8f34-1ed954cc5111 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:23.878099 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac2d8f-e66f-49e1-a6ce-c7f217029061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:23.878746 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac2d8f-e66f-49e1-a6ce-c7f217029061 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:23.879028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac2d8f-e66f-49e1-a6ce-c7f217029061 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:23.879304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac2d8f-e66f-49e1-a6ce-c7f217029061 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:23.880117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac2d8f-e66f-49e1-a6ce-c7f217029061 None admin] RBAC: Adding query filter params (role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.project.id=5cb4aa8e9a164018ae2c6fc8d092c229, user.id=5ebc0a6f41f94f23a952dbdbdab345d5) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:23.880427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac2d8f-e66f-49e1-a6ce-c7f217029061 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:23.881880 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac2d8f-e66f-49e1-a6ce-c7f217029061 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:23.887156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 578/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:16:23 2022] GET /identity/v3/role_assignments?user.id=5ebc0a6f41f94f23a952dbdbdab345d5&scope.project.id=5cb4aa8e9a164018ae2c6fc8d092c229&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:25.865896 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058c2e4-62e9-445e-9e96-d23042cf6e4c None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:25.866405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058c2e4-62e9-445e-9e96-d23042cf6e4c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:25.866405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058c2e4-62e9-445e-9e96-d23042cf6e4c None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:25.867734 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 569/1147] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:16:25.872991 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129bb22-a2bd-4529-9ca3-385d9055739c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:25.873419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129bb22-a2bd-4529-9ca3-385d9055739c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:25.873569 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129bb22-a2bd-4529-9ca3-385d9055739c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:25.890471 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-7129bb22-a2bd-4529-9ca3-385d9055739c None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:25.891632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7129bb22-a2bd-4529-9ca3-385d9055739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:25.947684 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:25.957081 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 579/1148] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:16:25.979502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058c2e4-62e9-445e-9e96-d23042cf6e4c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:26.075904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058c2e4-62e9-445e-9e96-d23042cf6e4c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:26.100416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:26.109062 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9f93b-97d7-4d09-b393-746f23d78a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:26.109863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9f93b-97d7-4d09-b393-746f23d78a4d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:26.110143 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9f93b-97d7-4d09-b393-746f23d78a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:26.110414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9f93b-97d7-4d09-b393-746f23d78a4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:26.120078 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9f93b-97d7-4d09-b393-746f23d78a4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:16:26.127510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-c9a9f93b-97d7-4d09-b393-746f23d78a4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:16:26.127510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:16:26.127510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:16:26.127510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:16:26.127510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:16:26.127510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:16:26.127510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:16:26.127510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:16:26.127510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:16:26.127510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:16:26.127510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:16:26.127510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:16:26.127510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:16:26.127510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:16:26.127510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:16:26.127510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:16:26.129109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:16:26.129109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:16:26.129109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:16:26.129109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:16:26.129109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:16:26.129109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:16:26.129109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:16:26.129109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:16:26.129109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:16:26.129109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:16:26.129109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:16:26.129109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:16:26.129109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:16:26.129109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:16:26.129109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:16:26.129109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:16:26.130206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:16:26.130206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:16:26.130206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:16:26.130206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:16:26.130206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:16:26.130206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:16:26.130206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:16:26.130206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:16:26.130206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:16:26.130206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:16:26.130206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:16:26.130206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:16:26.130206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 570/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:16:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:16:26.135183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129bb22-a2bd-4529-9ca3-385d9055739c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:26.229892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129bb22-a2bd-4529-9ca3-385d9055739c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:26.262245 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1fe52-a37f-4f47-85b9-d7ceabb9dda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:26.262893 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1fe52-a37f-4f47-85b9-d7ceabb9dda5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:26.263175 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1fe52-a37f-4f47-85b9-d7ceabb9dda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:26.263448 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1fe52-a37f-4f47-85b9-d7ceabb9dda5 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:26.264184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1fe52-a37f-4f47-85b9-d7ceabb9dda5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:26.264490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1fe52-a37f-4f47-85b9-d7ceabb9dda5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:26.265877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1fe52-a37f-4f47-85b9-d7ceabb9dda5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:26.274291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 580/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:16:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:26.279785 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9f93b-97d7-4d09-b393-746f23d78a4d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:26.376207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9f93b-97d7-4d09-b393-746f23d78a4d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:26.408237 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7cbec-432d-4f49-88be-2a3aae09ac71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:26.409694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7cbec-432d-4f49-88be-2a3aae09ac71 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:26.409978 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7cbec-432d-4f49-88be-2a3aae09ac71 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:26.410248 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7cbec-432d-4f49-88be-2a3aae09ac71 None admin] PATH_INFO: `/v3/users/5ebc0a6f41f94f23a952dbdbdab345d5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:26.411405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7cbec-432d-4f49-88be-2a3aae09ac71 None admin] RBAC: Authorizing `identity:get_user(user_id=5ebc0a6f41f94f23a952dbdbdab345d5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:26.412826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7cbec-432d-4f49-88be-2a3aae09ac71 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:26.414417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 571/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:16:26 2022] GET /identity/v3/users/5ebc0a6f41f94f23a952dbdbdab345d5 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:26.420406 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1fe52-a37f-4f47-85b9-d7ceabb9dda5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:26.479323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:26.522050 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1fe52-a37f-4f47-85b9-d7ceabb9dda5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:26.554319 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262076d-d2e3-4df0-a3f0-45443412a0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:26.555167 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262076d-d2e3-4df0-a3f0-45443412a0af None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:26.555447 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262076d-d2e3-4df0-a3f0-45443412a0af None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:26.555722 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262076d-d2e3-4df0-a3f0-45443412a0af None admin] PATH_INFO: `/v3/projects/5cb4aa8e9a164018ae2c6fc8d092c229` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:26.556888 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262076d-d2e3-4df0-a3f0-45443412a0af None admin] RBAC: Authorizing `identity:get_project(project_id=5cb4aa8e9a164018ae2c6fc8d092c229)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:26.558358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262076d-d2e3-4df0-a3f0-45443412a0af None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:26.560063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 581/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:16:26 2022] GET /identity/v3/projects/5cb4aa8e9a164018ae2c6fc8d092c229 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:26.566573 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7cbec-432d-4f49-88be-2a3aae09ac71 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:26.623991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:26.667485 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7cbec-432d-4f49-88be-2a3aae09ac71 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:26.701594 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f12d02-4dec-4551-8e88-f24f37e666b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:26.702475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f12d02-4dec-4551-8e88-f24f37e666b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:26.702794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f12d02-4dec-4551-8e88-f24f37e666b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:26.703073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f12d02-4dec-4551-8e88-f24f37e666b4 None admin] PATH_INFO: `/v3/projects/5cb4aa8e9a164018ae2c6fc8d092c229/users/5ebc0a6f41f94f23a952dbdbdab345d5/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:26.705033 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f12d02-4dec-4551-8e88-f24f37e666b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cb4aa8e9a164018ae2c6fc8d092c229, user_id=5ebc0a6f41f94f23a952dbdbdab345d5, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:26.706541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f12d02-4dec-4551-8e88-f24f37e666b4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:26.719248 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 572/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:16:26 2022] PUT /identity/v3/projects/5cb4aa8e9a164018ae2c6fc8d092c229/users/5ebc0a6f41f94f23a952dbdbdab345d5/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:16:28.711298 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab041535-80b4-49b2-a0ad-06d0aec6a27c None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:28.711836 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab041535-80b4-49b2-a0ad-06d0aec6a27c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:28.711836 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab041535-80b4-49b2-a0ad-06d0aec6a27c None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:28.713194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 582/1154] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:16:28.718457 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a4c25-1af0-4cea-affc-bd0ada2adb5a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:28.718848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a4c25-1af0-4cea-affc-bd0ada2adb5a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:28.719031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a4c25-1af0-4cea-affc-bd0ada2adb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:28.736814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-294a4c25-1af0-4cea-affc-bd0ada2adb5a None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:28.738428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-294a4c25-1af0-4cea-affc-bd0ada2adb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:28.803777 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 573/1155] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:16:28.827271 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab041535-80b4-49b2-a0ad-06d0aec6a27c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:28.926191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab041535-80b4-49b2-a0ad-06d0aec6a27c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:28.948625 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:28.959701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327e9dc-334d-42b0-a6bd-4004922b0265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:28.960483 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327e9dc-334d-42b0-a6bd-4004922b0265 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:28.960768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327e9dc-334d-42b0-a6bd-4004922b0265 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:28.961046 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327e9dc-334d-42b0-a6bd-4004922b0265 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:28.970999 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327e9dc-334d-42b0-a6bd-4004922b0265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:16:28.979327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-a327e9dc-334d-42b0-a6bd-4004922b0265 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:16:28.979327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:16:28.979327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:16:28.979327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:16:28.979327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:16:28.979327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:16:28.979327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:16:28.979327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:16:28.979327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:16:28.979327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:16:28.979327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:16:28.979327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:16:28.979327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:16:28.979327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:16:28.979327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:16:28.979327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:16:28.980446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:16:28.980446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:16:28.980446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:16:28.980446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:16:28.980446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:16:28.980446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:16:28.980446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:16:28.980446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:16:28.980446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:16:28.980446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:16:28.980446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:16:28.980446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:16:28.980446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:16:28.980446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:16:28.980446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:16:28.980446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:16:28.981536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:16:28.981536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:16:28.981536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:16:28.981536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:16:28.981536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:16:28.981536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:16:28.981536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:16:28.981536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:16:28.981536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:16:28.981536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:16:28.981536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:16:28.981536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:16:28.981536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 583/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:16:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:16:28.988228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a4c25-1af0-4cea-affc-bd0ada2adb5a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:29.033114 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:29.087285 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a4c25-1af0-4cea-affc-bd0ada2adb5a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:29.120512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e72e3-2a09-4161-80f7-4366463f35d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:29.121174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e72e3-2a09-4161-80f7-4366463f35d1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:29.121499 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e72e3-2a09-4161-80f7-4366463f35d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:29.121778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e72e3-2a09-4161-80f7-4366463f35d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:29.122520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e72e3-2a09-4161-80f7-4366463f35d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:29.122829 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e72e3-2a09-4161-80f7-4366463f35d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:29.124202 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e72e3-2a09-4161-80f7-4366463f35d1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:29.132063 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 574/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:16:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:29.137832 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327e9dc-334d-42b0-a6bd-4004922b0265 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:29.234744 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327e9dc-334d-42b0-a6bd-4004922b0265 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:29.267131 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92f0c5-244d-4c29-aca9-e0c24ab598c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:29.267986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92f0c5-244d-4c29-aca9-e0c24ab598c5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:29.268270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92f0c5-244d-4c29-aca9-e0c24ab598c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:29.268545 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92f0c5-244d-4c29-aca9-e0c24ab598c5 None admin] PATH_INFO: `/v3/users/5ebc0a6f41f94f23a952dbdbdab345d5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:29.269749 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92f0c5-244d-4c29-aca9-e0c24ab598c5 None admin] RBAC: Authorizing `identity:get_user(user_id=5ebc0a6f41f94f23a952dbdbdab345d5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:29.271182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92f0c5-244d-4c29-aca9-e0c24ab598c5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:29.272769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 584/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:16:29 2022] GET /identity/v3/users/5ebc0a6f41f94f23a952dbdbdab345d5 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:29.278185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e72e3-2a09-4161-80f7-4366463f35d1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:29.381860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e72e3-2a09-4161-80f7-4366463f35d1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:29.388992 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:29.416748 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4985eb-ccfb-4cee-ac18-81d0bdc94853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:29.417421 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4985eb-ccfb-4cee-ac18-81d0bdc94853 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:29.417709 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4985eb-ccfb-4cee-ac18-81d0bdc94853 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:29.417985 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4985eb-ccfb-4cee-ac18-81d0bdc94853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:29.482370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4985eb-ccfb-4cee-ac18-81d0bdc94853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:29.483815 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4985eb-ccfb-4cee-ac18-81d0bdc94853 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:29.580156 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 575/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:16:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:16:29.586120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92f0c5-244d-4c29-aca9-e0c24ab598c5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:29.638132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:29.685300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92f0c5-244d-4c29-aca9-e0c24ab598c5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:29.718633 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93fb19-b383-46c2-a3d2-ed206b1d1d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:29.719475 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93fb19-b383-46c2-a3d2-ed206b1d1d59 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:29.719760 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93fb19-b383-46c2-a3d2-ed206b1d1d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:29.720036 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93fb19-b383-46c2-a3d2-ed206b1d1d59 None admin] PATH_INFO: `/v3/projects/5cb4aa8e9a164018ae2c6fc8d092c229` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:29.721205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93fb19-b383-46c2-a3d2-ed206b1d1d59 None admin] RBAC: Authorizing `identity:get_project(project_id=5cb4aa8e9a164018ae2c6fc8d092c229)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:29.722727 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93fb19-b383-46c2-a3d2-ed206b1d1d59 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:29.724926 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 585/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:16:29 2022] GET /identity/v3/projects/5cb4aa8e9a164018ae2c6fc8d092c229 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:29.731016 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4985eb-ccfb-4cee-ac18-81d0bdc94853 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:29.739487 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:29.825815 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4985eb-ccfb-4cee-ac18-81d0bdc94853 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:29.858296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db528401-6c7d-4065-9066-fe1d67077c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:29.858933 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db528401-6c7d-4065-9066-fe1d67077c31 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:29.859219 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db528401-6c7d-4065-9066-fe1d67077c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:29.859497 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db528401-6c7d-4065-9066-fe1d67077c31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:29.860316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db528401-6c7d-4065-9066-fe1d67077c31 None admin] RBAC: Adding query filter params (role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.project.id=5cb4aa8e9a164018ae2c6fc8d092c229, user.id=5ebc0a6f41f94f23a952dbdbdab345d5) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:29.860628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db528401-6c7d-4065-9066-fe1d67077c31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:29.862089 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db528401-6c7d-4065-9066-fe1d67077c31 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:29.868333 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 576/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:16:29 2022] GET /identity/v3/role_assignments?user.id=5ebc0a6f41f94f23a952dbdbdab345d5&scope.project.id=5cb4aa8e9a164018ae2c6fc8d092c229&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:31.883923 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4749107-abdc-42bc-8870-34ae278534e3 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:31.884426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4749107-abdc-42bc-8870-34ae278534e3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:31.884516 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4749107-abdc-42bc-8870-34ae278534e3 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:31.886242 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 586/1162] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:16:31.891268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e9c2d-f3b2-4da4-8b5c-0b986daf8ea6 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:31.891629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e9c2d-f3b2-4da4-8b5c-0b986daf8ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:31.891822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e9c2d-f3b2-4da4-8b5c-0b986daf8ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:31.908623 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-267e9c2d-f3b2-4da4-8b5c-0b986daf8ea6 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:31.909835 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-267e9c2d-f3b2-4da4-8b5c-0b986daf8ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:31.969651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:31.975148 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 577/1163] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:16:31.997190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4749107-abdc-42bc-8870-34ae278534e3 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:32.095868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4749107-abdc-42bc-8870-34ae278534e3 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:32.118364 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:32.132978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a9df0-7aef-4a99-931a-5f15ddf2f26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:32.133655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a9df0-7aef-4a99-931a-5f15ddf2f26b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:32.133986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a9df0-7aef-4a99-931a-5f15ddf2f26b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:32.134217 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a9df0-7aef-4a99-931a-5f15ddf2f26b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:32.199273 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a9df0-7aef-4a99-931a-5f15ddf2f26b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:32.200707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a9df0-7aef-4a99-931a-5f15ddf2f26b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:32.294588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 587/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:16:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:16:32.300959 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e9c2d-f3b2-4da4-8b5c-0b986daf8ea6 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:32.396546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e9c2d-f3b2-4da4-8b5c-0b986daf8ea6 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:32.429483 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee788f40-5294-49f0-b84d-4b118ff1843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:32.430287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee788f40-5294-49f0-b84d-4b118ff1843d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:32.430568 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee788f40-5294-49f0-b84d-4b118ff1843d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:32.430840 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee788f40-5294-49f0-b84d-4b118ff1843d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:32.437605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee788f40-5294-49f0-b84d-4b118ff1843d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:32.439048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee788f40-5294-49f0-b84d-4b118ff1843d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:32.453787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-ee788f40-5294-49f0-b84d-4b118ff1843d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 18:16:32.453787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:16:32.453787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 12 18:16:32.453787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 12 18:16:32.453787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:16:32.453787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:16:32.453787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:16:32.453787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:16:32.453787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 12 18:16:32.453787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:16:32.453787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:16:32.453787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:16:32.453787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:16:32.453787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:16:32.453787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:16:32.453787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:16:32.453787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:16:32.454941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:16:32.454941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:16:32.454941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:16:32.454941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:16:32.454941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:16:32.454941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:16:32.454941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:16:32.454941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:16:32.454941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:16:32.454941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:16:32.454941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:16:32.454941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:16:32.454941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:16:32.454941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:16:32.454941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:16:32.454941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:16:32.455809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:16:32.455809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:16:32.455809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:16:32.455809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:16:32.455809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:16:32.455809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:16:32.455809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:16:32.455809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:16:32.455809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:16:32.455809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:16:32.455809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 12 18:16:32.455809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:16:32.455809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 18:16:32.455809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:16:32.455809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 578/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Jul 12 18:16:32 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:16:32.461152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a9df0-7aef-4a99-931a-5f15ddf2f26b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:32.483527 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:32.560427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a9df0-7aef-4a99-931a-5f15ddf2f26b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:32.594476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4972d-00b8-4e44-bb65-5625a1266b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:32.595131 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4972d-00b8-4e44-bb65-5625a1266b9d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:32.595417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4972d-00b8-4e44-bb65-5625a1266b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:32.595695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4972d-00b8-4e44-bb65-5625a1266b9d None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:32.596409 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4972d-00b8-4e44-bb65-5625a1266b9d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:32.596718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4972d-00b8-4e44-bb65-5625a1266b9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:32.598139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4972d-00b8-4e44-bb65-5625a1266b9d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:32.605176 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 588/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Jul 12 18:16:32 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:34.590790 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d329f-8949-4c72-994b-782b0e876563 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:34.591211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d329f-8949-4c72-994b-782b0e876563 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:34.591328 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d329f-8949-4c72-994b-782b0e876563 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:34.592705 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 579/1167] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:16:34.597747 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b7805-6fed-4749-9ef1-4a5d9de2e6b1 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:34.598154 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b7805-6fed-4749-9ef1-4a5d9de2e6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:34.598308 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b7805-6fed-4749-9ef1-4a5d9de2e6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:34.615275 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c41b7805-6fed-4749-9ef1-4a5d9de2e6b1 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:34.616464 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c41b7805-6fed-4749-9ef1-4a5d9de2e6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:34.681265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 589/1168] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:16:34.704485 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d329f-8949-4c72-994b-782b0e876563 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:34.763323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:34.806638 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d329f-8949-4c72-994b-782b0e876563 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:34.851839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d6782-90cc-4d33-b599-5dbd416b2d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:34.852416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d6782-90cc-4d33-b599-5dbd416b2d11 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:34.852696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d6782-90cc-4d33-b599-5dbd416b2d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:34.852967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d6782-90cc-4d33-b599-5dbd416b2d11 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:34.853737 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d6782-90cc-4d33-b599-5dbd416b2d11 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:34.855110 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d6782-90cc-4d33-b599-5dbd416b2d11 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:34.870406 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 580/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Tue Jul 12 18:16:34 2022] POST /identity/v3/domains => generated 267 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:16:36.892109 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d4eb4-0871-4224-ace4-042e45daf270 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:36.892618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d4eb4-0871-4224-ace4-042e45daf270 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:36.892732 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d4eb4-0871-4224-ace4-042e45daf270 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:36.894049 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 590/1170] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:16:36.899645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173530b-8dd5-4a2f-93fe-a5ee91c027dc None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:36.900043 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173530b-8dd5-4a2f-93fe-a5ee91c027dc None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:36.900212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173530b-8dd5-4a2f-93fe-a5ee91c027dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:36.917313 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e173530b-8dd5-4a2f-93fe-a5ee91c027dc None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:36.918491 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e173530b-8dd5-4a2f-93fe-a5ee91c027dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:36.982833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 581/1171] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:16:37.005769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d4eb4-0871-4224-ace4-042e45daf270 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:37.021537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:37.105401 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d4eb4-0871-4224-ace4-042e45daf270 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:37.138285 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad9669-97a9-419c-96bd-a0a90f454421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:37.139128 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad9669-97a9-419c-96bd-a0a90f454421 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:37.139413 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad9669-97a9-419c-96bd-a0a90f454421 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:37.139691 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad9669-97a9-419c-96bd-a0a90f454421 None admin] PATH_INFO: `/v3/domains/32502d2a01ab4a359f15dea35a22c769` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:37.150430 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad9669-97a9-419c-96bd-a0a90f454421 None admin] RBAC: Authorizing `identity:get_domain(domain_id=32502d2a01ab4a359f15dea35a22c769)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:37.151817 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad9669-97a9-419c-96bd-a0a90f454421 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:37.153466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 591/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Tue Jul 12 18:16:37 2022] GET /identity/v3/domains/32502d2a01ab4a359f15dea35a22c769 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:37.159337 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173530b-8dd5-4a2f-93fe-a5ee91c027dc None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:37.208087 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:37.257089 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173530b-8dd5-4a2f-93fe-a5ee91c027dc None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:37.289802 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8eb717-8195-474c-bfb8-d45de389407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:37.290446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8eb717-8195-474c-bfb8-d45de389407d None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:37.290731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8eb717-8195-474c-bfb8-d45de389407d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:37.291010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8eb717-8195-474c-bfb8-d45de389407d None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:37.291721 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8eb717-8195-474c-bfb8-d45de389407d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:37.293154 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8eb717-8195-474c-bfb8-d45de389407d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:37.317799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 582/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Jul 12 18:16:37 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:16:39.343660 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cff42-afd4-41bb-95a6-8fce58c993a6 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:39.344223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cff42-afd4-41bb-95a6-8fce58c993a6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:39.344223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cff42-afd4-41bb-95a6-8fce58c993a6 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:39.345655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 592/1174] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:16:39.351335 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbbf44-4fff-4fbc-b841-23c93dcde9f6 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:39.351766 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbbf44-4fff-4fbc-b841-23c93dcde9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:39.351900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbbf44-4fff-4fbc-b841-23c93dcde9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:39.368468 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-dbfbbf44-4fff-4fbc-b841-23c93dcde9f6 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:39.369679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-dbfbbf44-4fff-4fbc-b841-23c93dcde9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:39.433542 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 583/1175] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:16:39.458243 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cff42-afd4-41bb-95a6-8fce58c993a6 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:39.532711 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:39.557609 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cff42-afd4-41bb-95a6-8fce58c993a6 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:39.591896 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a80989-74c4-4280-8e8c-abe6f9a01e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:39.592747 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a80989-74c4-4280-8e8c-abe6f9a01e12 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:39.593032 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a80989-74c4-4280-8e8c-abe6f9a01e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:39.593342 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a80989-74c4-4280-8e8c-abe6f9a01e12 None admin] PATH_INFO: `/v3/domains/32502d2a01ab4a359f15dea35a22c769` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:39.594568 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a80989-74c4-4280-8e8c-abe6f9a01e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=32502d2a01ab4a359f15dea35a22c769)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:39.595963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a80989-74c4-4280-8e8c-abe6f9a01e12 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:39.597629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 593/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Tue Jul 12 18:16:39 2022] GET /identity/v3/domains/32502d2a01ab4a359f15dea35a22c769 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:39.603320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbbf44-4fff-4fbc-b841-23c93dcde9f6 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:39.634215 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:39.700953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbbf44-4fff-4fbc-b841-23c93dcde9f6 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:39.733587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e113b3b-d75d-4b5b-8e61-8fc584809f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:39.734248 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e113b3b-d75d-4b5b-8e61-8fc584809f96 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:39.734530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e113b3b-d75d-4b5b-8e61-8fc584809f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:39.734803 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e113b3b-d75d-4b5b-8e61-8fc584809f96 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:39.735513 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e113b3b-d75d-4b5b-8e61-8fc584809f96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:39.736944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e113b3b-d75d-4b5b-8e61-8fc584809f96 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:39.756639 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 584/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Jul 12 18:16:39 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:16:41.836154 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3e3b3-a99c-4aa7-b2b0-89d50f1ca0fe None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:41.836675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3e3b3-a99c-4aa7-b2b0-89d50f1ca0fe None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:41.836675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3e3b3-a99c-4aa7-b2b0-89d50f1ca0fe None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:41.838034 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 594/1178] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:16:41.843170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2064dc-ad9d-4c3f-84e5-2b60fa5dd43c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:41.843620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2064dc-ad9d-4c3f-84e5-2b60fa5dd43c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:41.843721 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2064dc-ad9d-4c3f-84e5-2b60fa5dd43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:41.860501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-cc2064dc-ad9d-4c3f-84e5-2b60fa5dd43c None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:41.861709 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-cc2064dc-ad9d-4c3f-84e5-2b60fa5dd43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:41.926985 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 585/1179] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:16:41.952363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3e3b3-a99c-4aa7-b2b0-89d50f1ca0fe None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:42.051339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3e3b3-a99c-4aa7-b2b0-89d50f1ca0fe None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:42.083766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856a186-4416-454d-8238-68e570d211e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:42.084546 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856a186-4416-454d-8238-68e570d211e3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:42.084828 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856a186-4416-454d-8238-68e570d211e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:42.085102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856a186-4416-454d-8238-68e570d211e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:42.095066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856a186-4416-454d-8238-68e570d211e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:16:42.103331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-e856a186-4416-454d-8238-68e570d211e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:16:42.103331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:16:42.103331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:16:42.103331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:16:42.103331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:16:42.103331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:16:42.103331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:16:42.103331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:16:42.103331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:16:42.103331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:16:42.103331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:16:42.103331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:16:42.103331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:16:42.103331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:16:42.103331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:16:42.103331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:16:42.104497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:16:42.104497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:16:42.104497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:16:42.104497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:16:42.104497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:16:42.104497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:16:42.104497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:16:42.104497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:16:42.104497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:16:42.104497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:16:42.104497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:16:42.104497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:16:42.104497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:16:42.104497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:16:42.104497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:16:42.104497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:16:42.105478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:16:42.105478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:16:42.105478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:16:42.105478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:16:42.105478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:16:42.105478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:16:42.105478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:16:42.105478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:16:42.105478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:16:42.105478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:16:42.105478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:16:42.105478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:16:42.105478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 595/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:16:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:16:42.110107 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2064dc-ad9d-4c3f-84e5-2b60fa5dd43c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:42.128155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:42.206643 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2064dc-ad9d-4c3f-84e5-2b60fa5dd43c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:42.240637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1520ba7-7ccd-4595-8286-76c3f837b0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:42.241316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1520ba7-7ccd-4595-8286-76c3f837b0fd None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:42.241600 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1520ba7-7ccd-4595-8286-76c3f837b0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:42.241873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1520ba7-7ccd-4595-8286-76c3f837b0fd None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:42.242612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1520ba7-7ccd-4595-8286-76c3f837b0fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:42.242916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1520ba7-7ccd-4595-8286-76c3f837b0fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:42.244283 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1520ba7-7ccd-4595-8286-76c3f837b0fd None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:42.252050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 586/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:16:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:16:42.258375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856a186-4416-454d-8238-68e570d211e3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:42.261183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:42.357092 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856a186-4416-454d-8238-68e570d211e3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:42.389957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6092f6-d8b2-4438-b728-8615e7d16997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:42.390804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6092f6-d8b2-4438-b728-8615e7d16997 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:42.391087 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6092f6-d8b2-4438-b728-8615e7d16997 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:42.391364 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6092f6-d8b2-4438-b728-8615e7d16997 None admin] PATH_INFO: `/v3/users/a6dcc1a223a740f7ae6a188b2398a440` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:42.404060 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6092f6-d8b2-4438-b728-8615e7d16997 None admin] RBAC: Authorizing `identity:get_user(user_id=a6dcc1a223a740f7ae6a188b2398a440)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:42.405570 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6092f6-d8b2-4438-b728-8615e7d16997 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:42.407190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 596/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:16:42 2022] GET /identity/v3/users/a6dcc1a223a740f7ae6a188b2398a440 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:42.412843 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1520ba7-7ccd-4595-8286-76c3f837b0fd None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:42.491952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:42.510500 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1520ba7-7ccd-4595-8286-76c3f837b0fd None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:42.542742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cf203-a2ab-476b-922b-55ddcead5bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:42.543369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cf203-a2ab-476b-922b-55ddcead5bee None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:42.543652 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cf203-a2ab-476b-922b-55ddcead5bee None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:42.543925 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cf203-a2ab-476b-922b-55ddcead5bee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:42.608908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cf203-a2ab-476b-922b-55ddcead5bee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:42.610333 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cf203-a2ab-476b-922b-55ddcead5bee None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:42.684996 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:42.704838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 587/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:16:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:16:42.711341 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6092f6-d8b2-4438-b728-8615e7d16997 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:42.769064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:42.808149 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6092f6-d8b2-4438-b728-8615e7d16997 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:42.841742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b2979-0263-4359-be94-0aa822533a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:42.842593 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b2979-0263-4359-be94-0aa822533a58 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:42.842875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b2979-0263-4359-be94-0aa822533a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:42.843153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b2979-0263-4359-be94-0aa822533a58 None admin] PATH_INFO: `/v3/projects/c83dca7314f44760ae32ae6e0cab91a3` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:42.844343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b2979-0263-4359-be94-0aa822533a58 None admin] RBAC: Authorizing `identity:get_project(project_id=c83dca7314f44760ae32ae6e0cab91a3)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:42.845810 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b2979-0263-4359-be94-0aa822533a58 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:42.848419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 597/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:16:42 2022] GET /identity/v3/projects/c83dca7314f44760ae32ae6e0cab91a3 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:42.854422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cf203-a2ab-476b-922b-55ddcead5bee None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:42.949744 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cf203-a2ab-476b-922b-55ddcead5bee None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:42.983319 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f5d6e-e423-45f0-b42b-f96b4420befd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:42.983952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f5d6e-e423-45f0-b42b-f96b4420befd None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:42.984231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f5d6e-e423-45f0-b42b-f96b4420befd None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:42.984504 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f5d6e-e423-45f0-b42b-f96b4420befd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:42.985347 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f5d6e-e423-45f0-b42b-f96b4420befd None admin] RBAC: Adding query filter params (role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.project.id=c83dca7314f44760ae32ae6e0cab91a3, user.id=a6dcc1a223a740f7ae6a188b2398a440) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:42.985661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f5d6e-e423-45f0-b42b-f96b4420befd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:42.987079 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f5d6e-e423-45f0-b42b-f96b4420befd None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:42.992343 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 588/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:16:42 2022] GET /identity/v3/role_assignments?user.id=a6dcc1a223a740f7ae6a188b2398a440&scope.project.id=c83dca7314f44760ae32ae6e0cab91a3&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:16:44.985304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecf8bc-bd0b-4163-9e38-1a90a98fe572 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:44.985852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecf8bc-bd0b-4163-9e38-1a90a98fe572 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:44.985852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecf8bc-bd0b-4163-9e38-1a90a98fe572 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:44.987221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 598/1186] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:16:44.992404 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb937ea-1343-4eea-bac1-64eba6e0ee61 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:44.992819 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb937ea-1343-4eea-bac1-64eba6e0ee61 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:44.992967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb937ea-1343-4eea-bac1-64eba6e0ee61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:45.009813 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1bb937ea-1343-4eea-bac1-64eba6e0ee61 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:45.010993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1bb937ea-1343-4eea-bac1-64eba6e0ee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:45.049890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:45.076141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 589/1187] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:16:45.098358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecf8bc-bd0b-4163-9e38-1a90a98fe572 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:45.196884 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecf8bc-bd0b-4163-9e38-1a90a98fe572 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:45.222854 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:45.230651 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ece43-b5d8-40f6-b963-f1ec7399210b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:45.231425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ece43-b5d8-40f6-b963-f1ec7399210b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:45.231709 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ece43-b5d8-40f6-b963-f1ec7399210b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:45.231985 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ece43-b5d8-40f6-b963-f1ec7399210b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:45.242487 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ece43-b5d8-40f6-b963-f1ec7399210b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:16:45.250112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-ba9ece43-b5d8-40f6-b963-f1ec7399210b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:16:45.250112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:16:45.250112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:16:45.250112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:16:45.250112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:16:45.250112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:16:45.250112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:16:45.250112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:16:45.250112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:16:45.250112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:16:45.250112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:16:45.250112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:16:45.250112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:16:45.250112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:16:45.250112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:16:45.250112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:16:45.251180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:16:45.251180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:16:45.251180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:16:45.251180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:16:45.251180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:16:45.251180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:16:45.251180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:16:45.251180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:16:45.251180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:16:45.251180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:16:45.251180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:16:45.251180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:16:45.251180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:16:45.251180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:16:45.251180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:16:45.251180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:16:45.252144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:16:45.252144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:16:45.252144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:16:45.252144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:16:45.252144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:16:45.252144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:16:45.252144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:16:45.252144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:16:45.252144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:16:45.252144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:16:45.252144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:16:45.252144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:16:45.252144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 599/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:16:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:16:45.257958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb937ea-1343-4eea-bac1-64eba6e0ee61 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:45.352417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb937ea-1343-4eea-bac1-64eba6e0ee61 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:45.386180 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13722c3a-5122-457f-9d5e-ed266cc3dacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:45.386834 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13722c3a-5122-457f-9d5e-ed266cc3dacd None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:45.387124 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13722c3a-5122-457f-9d5e-ed266cc3dacd None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:45.387404 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13722c3a-5122-457f-9d5e-ed266cc3dacd None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:45.388144 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13722c3a-5122-457f-9d5e-ed266cc3dacd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:45.388456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13722c3a-5122-457f-9d5e-ed266cc3dacd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:45.389869 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13722c3a-5122-457f-9d5e-ed266cc3dacd None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:45.397729 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 590/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:16:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:45.403221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ece43-b5d8-40f6-b963-f1ec7399210b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:45.500819 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ece43-b5d8-40f6-b963-f1ec7399210b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:45.532204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69767ed-20b3-4a11-b76d-256a44c739b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:45.533041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69767ed-20b3-4a11-b76d-256a44c739b1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:45.533347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69767ed-20b3-4a11-b76d-256a44c739b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:45.533622 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69767ed-20b3-4a11-b76d-256a44c739b1 None admin] PATH_INFO: `/v3/users/a6dcc1a223a740f7ae6a188b2398a440` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:45.535286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69767ed-20b3-4a11-b76d-256a44c739b1 None admin] RBAC: Authorizing `identity:get_user(user_id=a6dcc1a223a740f7ae6a188b2398a440)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:45.536696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69767ed-20b3-4a11-b76d-256a44c739b1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:45.538285 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 600/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:16:45 2022] GET /identity/v3/users/a6dcc1a223a740f7ae6a188b2398a440 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:45.543815 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13722c3a-5122-457f-9d5e-ed266cc3dacd None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:45.578679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:45.640119 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13722c3a-5122-457f-9d5e-ed266cc3dacd None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:45.672033 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63135dd4-bb9d-4e0c-9e60-4df046bd7303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:45.672889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63135dd4-bb9d-4e0c-9e60-4df046bd7303 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:45.673168 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63135dd4-bb9d-4e0c-9e60-4df046bd7303 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:45.673651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63135dd4-bb9d-4e0c-9e60-4df046bd7303 None admin] PATH_INFO: `/v3/projects/c83dca7314f44760ae32ae6e0cab91a3` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:45.674805 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63135dd4-bb9d-4e0c-9e60-4df046bd7303 None admin] RBAC: Authorizing `identity:get_project(project_id=c83dca7314f44760ae32ae6e0cab91a3)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:45.676821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63135dd4-bb9d-4e0c-9e60-4df046bd7303 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:45.678510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 591/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:16:45 2022] GET /identity/v3/projects/c83dca7314f44760ae32ae6e0cab91a3 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:45.684447 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69767ed-20b3-4a11-b76d-256a44c739b1 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:45.738841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:45.780825 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69767ed-20b3-4a11-b76d-256a44c739b1 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:45.813504 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a06769-ed14-467e-b00d-c35d175d6680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:45.814368 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a06769-ed14-467e-b00d-c35d175d6680 None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:45.814643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a06769-ed14-467e-b00d-c35d175d6680 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:45.814912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a06769-ed14-467e-b00d-c35d175d6680 None admin] PATH_INFO: `/v3/projects/c83dca7314f44760ae32ae6e0cab91a3/users/a6dcc1a223a740f7ae6a188b2398a440/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:45.816860 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a06769-ed14-467e-b00d-c35d175d6680 None admin] RBAC: Authorizing `identity:create_grant(project_id=c83dca7314f44760ae32ae6e0cab91a3, user_id=a6dcc1a223a740f7ae6a188b2398a440, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:45.818303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a06769-ed14-467e-b00d-c35d175d6680 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:45.830540 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 601/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:16:45 2022] PUT /identity/v3/projects/c83dca7314f44760ae32ae6e0cab91a3/users/a6dcc1a223a740f7ae6a188b2398a440/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:16:47.826025 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0b436-e20d-42a6-989a-b6007a427e8b None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:47.826521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0b436-e20d-42a6-989a-b6007a427e8b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:47.826521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0b436-e20d-42a6-989a-b6007a427e8b None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:47.827946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 592/1193] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:16:47.833952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa965b-d9c2-4a19-9659-1e95d13c2c8e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:47.835376 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa965b-d9c2-4a19-9659-1e95d13c2c8e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:47.835376 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa965b-d9c2-4a19-9659-1e95d13c2c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:47.852626 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-24fa965b-d9c2-4a19-9659-1e95d13c2c8e None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:16:47.853852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-24fa965b-d9c2-4a19-9659-1e95d13c2c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:16:47.919614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 602/1194] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:16:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:16:47.943701 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0b436-e20d-42a6-989a-b6007a427e8b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:48.040164 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0b436-e20d-42a6-989a-b6007a427e8b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:48.042393 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:48.073161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b3972-485f-4d40-be0c-d59e6d60617b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:48.073958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b3972-485f-4d40-be0c-d59e6d60617b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:48.074236 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b3972-485f-4d40-be0c-d59e6d60617b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:48.074505 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b3972-485f-4d40-be0c-d59e6d60617b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:48.084227 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b3972-485f-4d40-be0c-d59e6d60617b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:16:48.091781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-8b9b3972-485f-4d40-be0c-d59e6d60617b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:16:48.091781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:16:48.091781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:16:48.091781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:16:48.091781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:16:48.091781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:16:48.091781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:16:48.091781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:16:48.091781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:16:48.091781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:16:48.091781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:16:48.091781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:16:48.091781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:16:48.091781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:16:48.091781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:16:48.091781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:16:48.092893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:16:48.092893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:16:48.092893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:16:48.092893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:16:48.092893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:16:48.092893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:16:48.092893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:16:48.092893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:16:48.092893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:16:48.092893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:16:48.092893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:16:48.092893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:16:48.092893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:16:48.092893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:16:48.092893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:16:48.092893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:16:48.094102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:16:48.094102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:16:48.094102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:16:48.094102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:16:48.094102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:16:48.094102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:16:48.094102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:16:48.094102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:16:48.094102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:16:48.094102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:16:48.094102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:16:48.094102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:16:48.094102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 593/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:16:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:16:48.099413 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa965b-d9c2-4a19-9659-1e95d13c2c8e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:48.143126 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:48.194893 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa965b-d9c2-4a19-9659-1e95d13c2c8e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:48.227902 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4269e04-d2be-4937-9d6d-705f14c34a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:48.228548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4269e04-d2be-4937-9d6d-705f14c34a07 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:48.228826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4269e04-d2be-4937-9d6d-705f14c34a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:48.229095 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4269e04-d2be-4937-9d6d-705f14c34a07 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:48.229851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4269e04-d2be-4937-9d6d-705f14c34a07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:48.230158 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4269e04-d2be-4937-9d6d-705f14c34a07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:48.231509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4269e04-d2be-4937-9d6d-705f14c34a07 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:48.239306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 603/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:16:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:48.244951 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b3972-485f-4d40-be0c-d59e6d60617b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:48.343519 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b3972-485f-4d40-be0c-d59e6d60617b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:48.375916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb45647-c1c0-4ad9-bb22-2fce05cecede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:48.376765 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb45647-c1c0-4ad9-bb22-2fce05cecede None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:48.377049 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb45647-c1c0-4ad9-bb22-2fce05cecede None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:48.377349 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb45647-c1c0-4ad9-bb22-2fce05cecede None admin] PATH_INFO: `/v3/users/a6dcc1a223a740f7ae6a188b2398a440` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:48.379154 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb45647-c1c0-4ad9-bb22-2fce05cecede None admin] RBAC: Authorizing `identity:get_user(user_id=a6dcc1a223a740f7ae6a188b2398a440)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:48.380629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb45647-c1c0-4ad9-bb22-2fce05cecede None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:48.382252 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 594/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Jul 12 18:16:48 2022] GET /identity/v3/users/a6dcc1a223a740f7ae6a188b2398a440 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:48.387994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4269e04-d2be-4937-9d6d-705f14c34a07 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:48.483658 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4269e04-d2be-4937-9d6d-705f14c34a07 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:48.492667 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:48.517248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4370bb4-af5f-4264-bf8b-3baeda4cd26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:48.517905 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4370bb4-af5f-4264-bf8b-3baeda4cd26f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:48.518187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4370bb4-af5f-4264-bf8b-3baeda4cd26f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:48.518477 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4370bb4-af5f-4264-bf8b-3baeda4cd26f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:48.584027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4370bb4-af5f-4264-bf8b-3baeda4cd26f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:48.585509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4370bb4-af5f-4264-bf8b-3baeda4cd26f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:48.699374 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 604/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:16:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:16:48.705337 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb45647-c1c0-4ad9-bb22-2fce05cecede None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:48.736783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:48.802225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb45647-c1c0-4ad9-bb22-2fce05cecede None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:48.834792 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffecdda-33fd-4bd7-ae8e-3e243029dca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:48.835632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffecdda-33fd-4bd7-ae8e-3e243029dca1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:48.835905 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffecdda-33fd-4bd7-ae8e-3e243029dca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:48.836173 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffecdda-33fd-4bd7-ae8e-3e243029dca1 None admin] PATH_INFO: `/v3/projects/c83dca7314f44760ae32ae6e0cab91a3` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:48.837342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffecdda-33fd-4bd7-ae8e-3e243029dca1 None admin] RBAC: Authorizing `identity:get_project(project_id=c83dca7314f44760ae32ae6e0cab91a3)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:48.838766 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffecdda-33fd-4bd7-ae8e-3e243029dca1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:48.840422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 595/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Jul 12 18:16:48 2022] GET /identity/v3/projects/c83dca7314f44760ae32ae6e0cab91a3 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:48.846534 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4370bb4-af5f-4264-bf8b-3baeda4cd26f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:16:48.856954 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:48.950256 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4370bb4-af5f-4264-bf8b-3baeda4cd26f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:16:48.983874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824b9b8-dd1f-4123-a7f9-3ffd51dc1588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:16:48.984528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b9b8-dd1f-4123-a7f9-3ffd51dc1588 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:16:48.984808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b9b8-dd1f-4123-a7f9-3ffd51dc1588 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:16:48.985081 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b9b8-dd1f-4123-a7f9-3ffd51dc1588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:16:48.985939 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824b9b8-dd1f-4123-a7f9-3ffd51dc1588 None admin] RBAC: Adding query filter params (role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.project.id=c83dca7314f44760ae32ae6e0cab91a3, user.id=a6dcc1a223a740f7ae6a188b2398a440) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:16:48.986254 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824b9b8-dd1f-4123-a7f9-3ffd51dc1588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:16:48.987690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824b9b8-dd1f-4123-a7f9-3ffd51dc1588 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:16:48.993893 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 605/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:16:48 2022] GET /identity/v3/role_assignments?user.id=a6dcc1a223a740f7ae6a188b2398a440&scope.project.id=c83dca7314f44760ae32ae6e0cab91a3&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:16:58.830325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=50 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:16:58.991078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=64 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:44.216604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1efb6-8f0c-4d15-86ec-275c04fa5e39 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:44.217278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1efb6-8f0c-4d15-86ec-275c04fa5e39 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:44.217387 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1efb6-8f0c-4d15-86ec-275c04fa5e39 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:44.218983 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 596/1201] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:17:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:17:44.225082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb5494-c3d4-422b-b555-6687e5d53f8d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:44.225597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb5494-c3d4-422b-b555-6687e5d53f8d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:44.225697 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb5494-c3d4-422b-b555-6687e5d53f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:44.244883 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5fdb5494-c3d4-422b-b555-6687e5d53f8d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:17:44.246675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5fdb5494-c3d4-422b-b555-6687e5d53f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:44.342462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 606/1202] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:17:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:17:44.371833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1efb6-8f0c-4d15-86ec-275c04fa5e39 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:44.503150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1efb6-8f0c-4d15-86ec-275c04fa5e39 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:44.545883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5252a55-9cb0-41f0-aa33-3a27934e4294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:44.546697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5252a55-9cb0-41f0-aa33-3a27934e4294 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:44.546976 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5252a55-9cb0-41f0-aa33-3a27934e4294 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:44.547244 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5252a55-9cb0-41f0-aa33-3a27934e4294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:44.562458 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5252a55-9cb0-41f0-aa33-3a27934e4294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:44.564179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5252a55-9cb0-41f0-aa33-3a27934e4294 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:44.587944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-a5252a55-9cb0-41f0-aa33-3a27934e4294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:17:44.587944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:17:44.587944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:17:44.587944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:17:44.587944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:17:44.587944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:17:44.587944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:17:44.587944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:17:44.587944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:17:44.587944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:17:44.587944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:17:44.587944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:17:44.587944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:17:44.587944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:17:44.587944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:17:44.588966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:17:44.588966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:17:44.588966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:17:44.588966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:17:44.588966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:17:44.588966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:17:44.588966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:17:44.588966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:17:44.588966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:17:44.588966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:17:44.588966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:17:44.588966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:17:44.588966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:17:44.588966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:17:44.588966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:17:44.588966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:17:44.588966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:17:44.590024 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:17:44.590024 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:17:44.590024 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:17:44.590024 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:17:44.590024 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 597/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:17:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:17:44.597054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb5494-c3d4-422b-b555-6687e5d53f8d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:44.720773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb5494-c3d4-422b-b555-6687e5d53f8d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:44.754710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:44.761451 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeccd6-2b80-4a69-a2f8-f7c3c9ecbac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:44.762046 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeccd6-2b80-4a69-a2f8-f7c3c9ecbac1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:44.762329 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeccd6-2b80-4a69-a2f8-f7c3c9ecbac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:44.762587 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeccd6-2b80-4a69-a2f8-f7c3c9ecbac1 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:44.763351 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeccd6-2b80-4a69-a2f8-f7c3c9ecbac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:44.763705 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeccd6-2b80-4a69-a2f8-f7c3c9ecbac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:44.765328 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeccd6-2b80-4a69-a2f8-f7c3c9ecbac1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:44.778808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 607/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:17:44.784258 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5252a55-9cb0-41f0-aa33-3a27934e4294 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:44.847521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:44.928841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5252a55-9cb0-41f0-aa33-3a27934e4294 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:44.980129 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043ae22-4471-46f4-8bca-b2e07fba34c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:44.980973 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043ae22-4471-46f4-8bca-b2e07fba34c4 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:44.981326 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043ae22-4471-46f4-8bca-b2e07fba34c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:44.981640 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043ae22-4471-46f4-8bca-b2e07fba34c4 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:44.982450 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043ae22-4471-46f4-8bca-b2e07fba34c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:44.983899 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043ae22-4471-46f4-8bca-b2e07fba34c4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:45.008883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 598/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Jul 12 18:17:44 2022] POST /identity/v3/users => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:17:47.270855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227cd6b-5d9e-4f07-89a6-3f39f645a654 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:47.271408 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227cd6b-5d9e-4f07-89a6-3f39f645a654 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:47.271592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227cd6b-5d9e-4f07-89a6-3f39f645a654 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:47.273128 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 608/1206] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:17:47.280437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae2810-4912-430a-9818-bf0b77a6c805 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:47.280437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae2810-4912-430a-9818-bf0b77a6c805 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:47.280437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae2810-4912-430a-9818-bf0b77a6c805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:47.298874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6aae2810-4912-430a-9818-bf0b77a6c805 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:17:47.300148 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6aae2810-4912-430a-9818-bf0b77a6c805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:47.385809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 599/1207] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:17:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:17:47.413746 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227cd6b-5d9e-4f07-89a6-3f39f645a654 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:47.541795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227cd6b-5d9e-4f07-89a6-3f39f645a654 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:47.589872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d16aec-e10c-416c-b646-8c2448309eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:47.590683 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d16aec-e10c-416c-b646-8c2448309eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:47.590972 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d16aec-e10c-416c-b646-8c2448309eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:47.591269 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d16aec-e10c-416c-b646-8c2448309eb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:47.605425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d16aec-e10c-416c-b646-8c2448309eb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:17:47.615044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-d5d16aec-e10c-416c-b646-8c2448309eb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:17:47.615044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:17:47.615044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:17:47.615044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:17:47.615044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:17:47.615044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:17:47.615044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:17:47.615044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:17:47.615044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:17:47.615044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:17:47.615044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:17:47.615044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:17:47.615044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:17:47.615044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:17:47.615044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:17:47.615044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:17:47.616106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:17:47.616106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:17:47.616106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:17:47.616106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:17:47.616106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:17:47.616106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:17:47.616106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:17:47.616106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:17:47.616106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:17:47.616106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:17:47.616106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:17:47.616106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:17:47.616106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:17:47.616106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:17:47.616106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:17:47.616106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:17:47.616965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:17:47.616965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:17:47.616965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:17:47.616965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:17:47.616965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:17:47.616965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:17:47.616965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:17:47.616965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:17:47.616965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:17:47.616965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:17:47.616965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:17:47.616965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:17:47.616965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 609/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:17:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:17:47.623428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae2810-4912-430a-9818-bf0b77a6c805 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:47.674135 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:47.748792 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae2810-4912-430a-9818-bf0b77a6c805 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:47.789161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab949b9-095c-459a-ae33-69bbd2526e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:47.789931 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab949b9-095c-459a-ae33-69bbd2526e86 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:47.790247 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab949b9-095c-459a-ae33-69bbd2526e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:47.790514 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab949b9-095c-459a-ae33-69bbd2526e86 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:47.791466 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab949b9-095c-459a-ae33-69bbd2526e86 None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:47.791842 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab949b9-095c-459a-ae33-69bbd2526e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:47.793458 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab949b9-095c-459a-ae33-69bbd2526e86 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:47.805183 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 600/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:17:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:17:47.809133 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d16aec-e10c-416c-b646-8c2448309eb1 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:47.881117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:47.952397 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d16aec-e10c-416c-b646-8c2448309eb1 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:47.997688 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1908827-4620-4508-ba64-3960a01bd36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:47.998531 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1908827-4620-4508-ba64-3960a01bd36d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:47.998531 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1908827-4620-4508-ba64-3960a01bd36d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:47.998531 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1908827-4620-4508-ba64-3960a01bd36d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:48.010930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1908827-4620-4508-ba64-3960a01bd36d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:48.012396 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1908827-4620-4508-ba64-3960a01bd36d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:48.034194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-e1908827-4620-4508-ba64-3960a01bd36d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:17:48.034194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:17:48.034194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:17:48.034194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:17:48.034194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:17:48.034194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:17:48.034194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:17:48.034194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:17:48.034194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:17:48.034194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:17:48.034194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:17:48.034194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:17:48.034194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:17:48.034194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:17:48.034194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:17:48.035370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:17:48.035370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:17:48.035370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:17:48.035370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:17:48.035370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:17:48.035370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:17:48.035370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:17:48.035370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:17:48.035370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:17:48.035370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:17:48.035370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:17:48.035370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:17:48.035370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:17:48.035370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:17:48.035370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:17:48.035370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:17:48.035370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:17:48.036437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:17:48.036437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:17:48.036437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:17:48.036437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:17:48.036437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 610/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:17:48.041753 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab949b9-095c-459a-ae33-69bbd2526e86 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:48.159878 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:48.163447 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab949b9-095c-459a-ae33-69bbd2526e86 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:48.208868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2081b5c-4e2c-46c1-828c-8be6a26eb223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:48.209591 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2081b5c-4e2c-46c1-828c-8be6a26eb223 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:48.209895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2081b5c-4e2c-46c1-828c-8be6a26eb223 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:48.210189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2081b5c-4e2c-46c1-828c-8be6a26eb223 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:48.211034 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2081b5c-4e2c-46c1-828c-8be6a26eb223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:48.211348 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2081b5c-4e2c-46c1-828c-8be6a26eb223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:48.212815 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2081b5c-4e2c-46c1-828c-8be6a26eb223 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:48.225978 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 601/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:17:48.231761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1908827-4620-4508-ba64-3960a01bd36d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:48.356729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1908827-4620-4508-ba64-3960a01bd36d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:48.359309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:48.401687 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53445c1-1756-4365-9209-3aeaf24a04b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:48.402741 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53445c1-1756-4365-9209-3aeaf24a04b5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:48.403185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53445c1-1756-4365-9209-3aeaf24a04b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:48.403534 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53445c1-1756-4365-9209-3aeaf24a04b5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:48.412430 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53445c1-1756-4365-9209-3aeaf24a04b5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:48.414668 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53445c1-1756-4365-9209-3aeaf24a04b5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:48.432191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-a53445c1-1756-4365-9209-3aeaf24a04b5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:17:48.432191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:17:48.432191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:17:48.432191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:17:48.432191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:17:48.432191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:17:48.432191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:17:48.432191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:17:48.432191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:17:48.432191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:17:48.432191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:17:48.432191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:17:48.432191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:17:48.432191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:17:48.432191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:17:48.432191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:17:48.433418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:17:48.433418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:17:48.433418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:17:48.433418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:17:48.433418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:17:48.433418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:17:48.433418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:17:48.433418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:17:48.433418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:17:48.433418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:17:48.433418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:17:48.433418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:17:48.433418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:17:48.433418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:17:48.433418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:17:48.433418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:17:48.433418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:17:48.433418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:17:48.434556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:17:48.434556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:17:48.434556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:17:48.434556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:17:48.434556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:17:48.434556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:17:48.434556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:17:48.434556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:17:48.434556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:17:48.434556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:17:48.434556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 611/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:17:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:17:48.442042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2081b5c-4e2c-46c1-828c-8be6a26eb223 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:48.558456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2081b5c-4e2c-46c1-828c-8be6a26eb223 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:48.601082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a5146-67a9-43aa-a009-9f14993d66f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:48.601795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a5146-67a9-43aa-a009-9f14993d66f2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:48.602097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a5146-67a9-43aa-a009-9f14993d66f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:48.602417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a5146-67a9-43aa-a009-9f14993d66f2 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:48.603263 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a5146-67a9-43aa-a009-9f14993d66f2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:48.603579 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a5146-67a9-43aa-a009-9f14993d66f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:48.605247 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a5146-67a9-43aa-a009-9f14993d66f2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:48.625149 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 602/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Jul 12 18:17:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:17:48.631633 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53445c1-1756-4365-9209-3aeaf24a04b5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:48.766307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53445c1-1756-4365-9209-3aeaf24a04b5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:48.805479 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5324d10-1ff3-49ab-9abd-8c47aea5e81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:48.806380 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5324d10-1ff3-49ab-9abd-8c47aea5e81f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:48.806674 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5324d10-1ff3-49ab-9abd-8c47aea5e81f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:48.806961 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5324d10-1ff3-49ab-9abd-8c47aea5e81f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:48.841981 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:48.883488 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5324d10-1ff3-49ab-9abd-8c47aea5e81f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:48.884944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5324d10-1ff3-49ab-9abd-8c47aea5e81f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:48.997620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 612/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:17:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:17:49.003839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a5146-67a9-43aa-a009-9f14993d66f2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:49.024784 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:49.126002 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a5146-67a9-43aa-a009-9f14993d66f2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:49.170828 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bf336-b39d-421c-afd0-f69edf18bcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:49.171649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bf336-b39d-421c-afd0-f69edf18bcd0 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:49.171934 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bf336-b39d-421c-afd0-f69edf18bcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:49.172207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bf336-b39d-421c-afd0-f69edf18bcd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:49.185025 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64bf336-b39d-421c-afd0-f69edf18bcd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:49.186540 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64bf336-b39d-421c-afd0-f69edf18bcd0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:49.211595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-f64bf336-b39d-421c-afd0-f69edf18bcd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:17:49.211595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:17:49.211595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:17:49.211595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:17:49.211595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:17:49.211595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:17:49.211595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:17:49.211595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:17:49.211595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:17:49.211595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:17:49.211595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:17:49.211595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:17:49.211595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:17:49.211595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:17:49.211595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:17:49.212731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:17:49.212731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:17:49.212731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:17:49.212731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:17:49.212731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:17:49.212731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:17:49.212731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:17:49.212731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:17:49.212731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:17:49.212731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:17:49.212731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:17:49.212731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:17:49.212731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:17:49.212731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:17:49.212731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:17:49.212731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:17:49.212731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:17:49.218399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:17:49.218399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:17:49.218399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:17:49.218399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:17:49.218399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 603/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:17:49.218746 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5324d10-1ff3-49ab-9abd-8c47aea5e81f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:49.287072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:49.334682 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5324d10-1ff3-49ab-9abd-8c47aea5e81f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:49.376384 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201336e6-65e1-4d0f-aa7d-7b402664b44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:49.377982 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201336e6-65e1-4d0f-aa7d-7b402664b44e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:49.378473 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201336e6-65e1-4d0f-aa7d-7b402664b44e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:49.378960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201336e6-65e1-4d0f-aa7d-7b402664b44e None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:49.379874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201336e6-65e1-4d0f-aa7d-7b402664b44e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:49.380364 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201336e6-65e1-4d0f-aa7d-7b402664b44e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:49.381928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201336e6-65e1-4d0f-aa7d-7b402664b44e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:49.401462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 613/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:17:49.402244 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bf336-b39d-421c-afd0-f69edf18bcd0 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:49.486961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:49.523182 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bf336-b39d-421c-afd0-f69edf18bcd0 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:49.572502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825b2b9-2c71-4ddb-91c5-566c77c955ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:49.573383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825b2b9-2c71-4ddb-91c5-566c77c955ef None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:49.573660 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825b2b9-2c71-4ddb-91c5-566c77c955ef None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:49.573932 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825b2b9-2c71-4ddb-91c5-566c77c955ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:49.582360 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825b2b9-2c71-4ddb-91c5-566c77c955ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:49.584014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825b2b9-2c71-4ddb-91c5-566c77c955ef None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:49.601508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-d825b2b9-2c71-4ddb-91c5-566c77c955ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:17:49.601508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:17:49.601508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:17:49.601508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:17:49.601508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:17:49.601508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:17:49.601508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:17:49.601508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:17:49.601508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:17:49.601508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:17:49.601508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:17:49.601508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:17:49.601508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:17:49.601508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:17:49.601508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:17:49.602498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:17:49.602498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:17:49.602498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:17:49.602498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:17:49.602498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:17:49.602498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:17:49.602498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:17:49.602498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:17:49.602498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:17:49.602498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:17:49.602498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:17:49.602498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:17:49.602498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:17:49.602498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:17:49.602498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:17:49.602498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:17:49.602498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:17:49.603417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:17:49.603417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:17:49.603417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:17:49.603417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:17:49.603417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:17:49.603417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:17:49.603417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:17:49.603417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:17:49.603417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 604/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:17:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:17:49.608791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201336e6-65e1-4d0f-aa7d-7b402664b44e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:49.729400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201336e6-65e1-4d0f-aa7d-7b402664b44e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:49.754197 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:49.772178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f1046-e6ca-4d81-aced-9c6e6d401cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:49.773173 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f1046-e6ca-4d81-aced-9c6e6d401cee None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:49.773634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f1046-e6ca-4d81-aced-9c6e6d401cee None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:49.774018 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f1046-e6ca-4d81-aced-9c6e6d401cee None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:49.775147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f1046-e6ca-4d81-aced-9c6e6d401cee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:49.775623 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f1046-e6ca-4d81-aced-9c6e6d401cee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:49.777394 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f1046-e6ca-4d81-aced-9c6e6d401cee None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:49.794135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 614/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:17:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:17:49.800276 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825b2b9-2c71-4ddb-91c5-566c77c955ef None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:49.922789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825b2b9-2c71-4ddb-91c5-566c77c955ef None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:49.958535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:49.966113 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6b591-97a0-4cf3-98ca-7e7f8ee03f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:49.966759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6b591-97a0-4cf3-98ca-7e7f8ee03f93 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:49.967041 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6b591-97a0-4cf3-98ca-7e7f8ee03f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:49.967313 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6b591-97a0-4cf3-98ca-7e7f8ee03f93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:49.968429 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6b591-97a0-4cf3-98ca-7e7f8ee03f93 None admin] RBAC: Adding query filter params (role.id=82fa784b33dd4fe19c62367f39ac45b2, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=206242c775be40c7b96af6de635e2065) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:49.968759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6b591-97a0-4cf3-98ca-7e7f8ee03f93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:49.971099 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6b591-97a0-4cf3-98ca-7e7f8ee03f93 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:49.981310 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 605/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:17:49 2022] GET /identity/v3/role_assignments?user.id=206242c775be40c7b96af6de635e2065&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=82fa784b33dd4fe19c62367f39ac45b2 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:17:52.134686 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300372a-9bb7-409b-ac76-663cba886867 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:52.135262 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300372a-9bb7-409b-ac76-663cba886867 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:52.135262 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300372a-9bb7-409b-ac76-663cba886867 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:52.136614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 615/1220] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:17:52.142338 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb5729-d67b-414e-8f77-faded159618a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:52.142734 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb5729-d67b-414e-8f77-faded159618a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:52.142898 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb5729-d67b-414e-8f77-faded159618a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:52.160309 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b0fb5729-d67b-414e-8f77-faded159618a None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:17:52.161556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b0fb5729-d67b-414e-8f77-faded159618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:52.231227 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 606/1221] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:17:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:17:52.254350 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300372a-9bb7-409b-ac76-663cba886867 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:52.371525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300372a-9bb7-409b-ac76-663cba886867 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:52.409011 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6450853-8892-42a5-9968-69fef37706d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:52.411310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6450853-8892-42a5-9968-69fef37706d6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:52.411634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6450853-8892-42a5-9968-69fef37706d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:52.411912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6450853-8892-42a5-9968-69fef37706d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:52.422258 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6450853-8892-42a5-9968-69fef37706d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:17:52.430788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-c6450853-8892-42a5-9968-69fef37706d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:17:52.430788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:17:52.430788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:17:52.430788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:17:52.430788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:17:52.430788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:17:52.430788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:17:52.430788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:17:52.430788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:17:52.430788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:17:52.430788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:17:52.430788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:17:52.430788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:17:52.430788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:17:52.430788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:17:52.430788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:17:52.431841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:17:52.431841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:17:52.431841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:17:52.431841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:17:52.431841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:17:52.431841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:17:52.431841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:17:52.431841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:17:52.431841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:17:52.431841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:17:52.431841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:17:52.431841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:17:52.431841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:17:52.431841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:17:52.431841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:17:52.431841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:17:52.432696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:17:52.432696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:17:52.432696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:17:52.432696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:17:52.432696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:17:52.432696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:17:52.432696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:17:52.432696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:17:52.432696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:17:52.432696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:17:52.432696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:17:52.432696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:17:52.432696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 616/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:17:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:17:52.438099 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb5729-d67b-414e-8f77-faded159618a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:52.545493 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb5729-d67b-414e-8f77-faded159618a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:52.574344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:52.585764 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90682d05-5be6-43da-bbe3-db6cc5c3c2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:52.586434 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682d05-5be6-43da-bbe3-db6cc5c3c2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:52.586716 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682d05-5be6-43da-bbe3-db6cc5c3c2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:52.586989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682d05-5be6-43da-bbe3-db6cc5c3c2c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:52.587742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90682d05-5be6-43da-bbe3-db6cc5c3c2c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:52.588062 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90682d05-5be6-43da-bbe3-db6cc5c3c2c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:52.589457 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90682d05-5be6-43da-bbe3-db6cc5c3c2c4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:52.598171 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 607/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:17:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:17:52.604218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6450853-8892-42a5-9968-69fef37706d6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:52.650056 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:52.715297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6450853-8892-42a5-9968-69fef37706d6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:52.750936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47bb26-fd5f-4756-810b-91e3b0520f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:52.751721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47bb26-fd5f-4756-810b-91e3b0520f91 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:52.752003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47bb26-fd5f-4756-810b-91e3b0520f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:52.752273 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47bb26-fd5f-4756-810b-91e3b0520f91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:52.763062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47bb26-fd5f-4756-810b-91e3b0520f91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:52.764524 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47bb26-fd5f-4756-810b-91e3b0520f91 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:52.784455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-eb47bb26-fd5f-4756-810b-91e3b0520f91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:17:52.784455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:17:52.784455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:17:52.784455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:17:52.784455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:17:52.784455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:17:52.784455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:17:52.784455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:17:52.784455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:17:52.784455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:17:52.784455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:17:52.784455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:17:52.784455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:17:52.784455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:17:52.784455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:17:52.785526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:17:52.785526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:17:52.785526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:17:52.785526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:17:52.785526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:17:52.785526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:17:52.785526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:17:52.785526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:17:52.785526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:17:52.785526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:17:52.785526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:17:52.785526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:17:52.785526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:17:52.785526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:17:52.785526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:17:52.785526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:17:52.785526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:17:52.791412 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:17:52.791412 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:17:52.791412 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:17:52.791412 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:17:52.791412 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 617/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:17:52.792089 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90682d05-5be6-43da-bbe3-db6cc5c3c2c4 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:52.912183 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90682d05-5be6-43da-bbe3-db6cc5c3c2c4 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:52.951911 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0a2a1-1d15-45f2-a16f-894833a9b01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:52.952807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0a2a1-1d15-45f2-a16f-894833a9b01d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:52.953280 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0a2a1-1d15-45f2-a16f-894833a9b01d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:52.953584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0a2a1-1d15-45f2-a16f-894833a9b01d None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:52.954977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0a2a1-1d15-45f2-a16f-894833a9b01d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:52.955518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0a2a1-1d15-45f2-a16f-894833a9b01d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:52.957654 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0a2a1-1d15-45f2-a16f-894833a9b01d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:52.970470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 608/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:17:52.976395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47bb26-fd5f-4756-810b-91e3b0520f91 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:53.083821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:53.090794 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47bb26-fd5f-4756-810b-91e3b0520f91 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:53.129659 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edac0ac-d72d-47c5-89c2-13c83d51f5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:53.130527 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edac0ac-d72d-47c5-89c2-13c83d51f5bd None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:53.130838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edac0ac-d72d-47c5-89c2-13c83d51f5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:53.131129 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edac0ac-d72d-47c5-89c2-13c83d51f5bd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:53.139171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edac0ac-d72d-47c5-89c2-13c83d51f5bd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:53.140624 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edac0ac-d72d-47c5-89c2-13c83d51f5bd None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:53.160716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-7edac0ac-d72d-47c5-89c2-13c83d51f5bd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:17:53.160716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:17:53.160716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:17:53.160716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:17:53.160716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:17:53.160716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:17:53.160716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:17:53.160716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:17:53.160716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:17:53.160716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:17:53.160716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:17:53.160716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:17:53.160716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:17:53.160716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:17:53.160716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:17:53.160716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:17:53.161816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:17:53.161816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:17:53.161816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:17:53.161816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:17:53.161816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:17:53.161816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:17:53.161816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:17:53.161816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:17:53.161816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:17:53.161816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:17:53.161816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:17:53.161816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:17:53.161816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:17:53.161816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:17:53.161816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:17:53.161816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:17:53.161816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:17:53.161816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:17:53.162955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:17:53.162955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:17:53.162955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:17:53.162955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:17:53.162955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:17:53.162955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:17:53.162955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:17:53.162955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:17:53.162955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:17:53.162955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:17:53.162955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 618/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:17:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:17:53.167901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0a2a1-1d15-45f2-a16f-894833a9b01d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:53.219412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:53.282109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0a2a1-1d15-45f2-a16f-894833a9b01d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:53.327792 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93475eec-7567-4ce4-9bbe-5b2e39a4166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:53.328461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93475eec-7567-4ce4-9bbe-5b2e39a4166b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:53.328742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93475eec-7567-4ce4-9bbe-5b2e39a4166b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:53.329550 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93475eec-7567-4ce4-9bbe-5b2e39a4166b None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:53.330422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93475eec-7567-4ce4-9bbe-5b2e39a4166b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:53.330740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93475eec-7567-4ce4-9bbe-5b2e39a4166b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:53.332178 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93475eec-7567-4ce4-9bbe-5b2e39a4166b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:53.354289 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 609/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Jul 12 18:17:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:17:53.360619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edac0ac-d72d-47c5-89c2-13c83d51f5bd None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:53.484012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edac0ac-d72d-47c5-89c2-13c83d51f5bd None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:53.519755 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1dbc9-188b-43f7-a8e9-a1c78ebecf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:53.520548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1dbc9-188b-43f7-a8e9-a1c78ebecf30 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:53.520829 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1dbc9-188b-43f7-a8e9-a1c78ebecf30 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:53.521100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1dbc9-188b-43f7-a8e9-a1c78ebecf30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:53.534260 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1dbc9-188b-43f7-a8e9-a1c78ebecf30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:53.535903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1dbc9-188b-43f7-a8e9-a1c78ebecf30 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:53.557808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-e2d1dbc9-188b-43f7-a8e9-a1c78ebecf30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:17:53.557808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:17:53.557808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:17:53.557808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:17:53.557808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:17:53.557808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:17:53.557808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:17:53.557808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:17:53.557808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:17:53.557808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:17:53.557808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:17:53.557808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:17:53.557808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:17:53.557808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:17:53.557808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:17:53.558957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:17:53.558957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:17:53.558957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:17:53.558957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:17:53.558957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:17:53.558957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:17:53.558957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:17:53.558957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:17:53.558957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:17:53.558957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:17:53.558957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:17:53.558957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:17:53.558957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:17:53.558957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:17:53.558957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:17:53.558957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:17:53.558957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:17:53.559962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:17:53.559962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:17:53.559962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:17:53.559962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:17:53.559962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 619/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:17:53.565156 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93475eec-7567-4ce4-9bbe-5b2e39a4166b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:53.670991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93475eec-7567-4ce4-9bbe-5b2e39a4166b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:53.674874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:53.717877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b784a27-34f7-45d8-9f68-e85f1552196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:53.718550 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b784a27-34f7-45d8-9f68-e85f1552196a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:53.718829 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b784a27-34f7-45d8-9f68-e85f1552196a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:53.719095 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b784a27-34f7-45d8-9f68-e85f1552196a None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:53.720366 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b784a27-34f7-45d8-9f68-e85f1552196a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:53.720674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b784a27-34f7-45d8-9f68-e85f1552196a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:53.722095 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b784a27-34f7-45d8-9f68-e85f1552196a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:53.734723 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 610/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:17:53.740756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1dbc9-188b-43f7-a8e9-a1c78ebecf30 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:53.750516 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:53.851973 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1dbc9-188b-43f7-a8e9-a1c78ebecf30 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:53.890858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23475c-a72e-4e26-a203-794e3ff2f650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:53.891784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23475c-a72e-4e26-a203-794e3ff2f650 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:53.892074 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23475c-a72e-4e26-a203-794e3ff2f650 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:53.892356 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23475c-a72e-4e26-a203-794e3ff2f650 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:53.899862 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23475c-a72e-4e26-a203-794e3ff2f650 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:53.901390 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23475c-a72e-4e26-a203-794e3ff2f650 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:53.917417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-8b23475c-a72e-4e26-a203-794e3ff2f650 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:17:53.917417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:17:53.917417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:17:53.917417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:17:53.917417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:17:53.917417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:17:53.917417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:17:53.917417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:17:53.917417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:17:53.917417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:17:53.917417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:17:53.917417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:17:53.917417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:17:53.917417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:17:53.917417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:17:53.918557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:17:53.918557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:17:53.918557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:17:53.918557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:17:53.918557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:17:53.918557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:17:53.918557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:17:53.918557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:17:53.918557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:17:53.918557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:17:53.918557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:17:53.918557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:17:53.918557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:17:53.918557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:17:53.918557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:17:53.918557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:17:53.918557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:17:53.919655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:17:53.919655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:17:53.919655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:17:53.919655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:17:53.919655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:17:53.919655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:17:53.919655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:17:53.919655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:17:53.919655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 620/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:17:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:17:53.925245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b784a27-34f7-45d8-9f68-e85f1552196a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:54.032369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b784a27-34f7-45d8-9f68-e85f1552196a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:54.069732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce370a-9eea-436a-9987-362798ea3827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:54.070468 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce370a-9eea-436a-9987-362798ea3827 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:54.070793 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce370a-9eea-436a-9987-362798ea3827 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:54.071084 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce370a-9eea-436a-9987-362798ea3827 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:54.071874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce370a-9eea-436a-9987-362798ea3827 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:54.072436 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce370a-9eea-436a-9987-362798ea3827 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:54.074004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce370a-9eea-436a-9987-362798ea3827 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:54.086680 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 611/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:17:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:17:54.092951 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23475c-a72e-4e26-a203-794e3ff2f650 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:54.161563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:54.203461 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23475c-a72e-4e26-a203-794e3ff2f650 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:54.243692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523e8e1-9612-48db-9b93-34a546aaa03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:54.244888 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523e8e1-9612-48db-9b93-34a546aaa03f None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:54.245291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523e8e1-9612-48db-9b93-34a546aaa03f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:54.245795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523e8e1-9612-48db-9b93-34a546aaa03f None admin] PATH_INFO: `/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/206242c775be40c7b96af6de635e2065/roles/82fa784b33dd4fe19c62367f39ac45b2` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:54.262719 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523e8e1-9612-48db-9b93-34a546aaa03f None admin] RBAC: Authorizing `identity:create_grant(project_id=5fee99b2e9234f88ac79ff70429b6f20, user_id=206242c775be40c7b96af6de635e2065, role_id=82fa784b33dd4fe19c62367f39ac45b2)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:54.264179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523e8e1-9612-48db-9b93-34a546aaa03f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:54.277095 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 621/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:17:54 2022] PUT /identity/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/206242c775be40c7b96af6de635e2065/roles/82fa784b33dd4fe19c62367f39ac45b2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:17:56.303802 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234f66a-4952-4ba3-a15b-15801d56cc01 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:56.304357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234f66a-4952-4ba3-a15b-15801d56cc01 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:56.304357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234f66a-4952-4ba3-a15b-15801d56cc01 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:56.305876 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 612/1233] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:17:56.311557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20635326-63ba-4b50-86ac-2c2c90feab6d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:56.312022 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20635326-63ba-4b50-86ac-2c2c90feab6d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:56.312149 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20635326-63ba-4b50-86ac-2c2c90feab6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:56.335133 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-20635326-63ba-4b50-86ac-2c2c90feab6d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:17:56.336769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-20635326-63ba-4b50-86ac-2c2c90feab6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:56.419255 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 622/1234] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:17:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:17:56.441991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234f66a-4952-4ba3-a15b-15801d56cc01 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:56.468056 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:56.552081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234f66a-4952-4ba3-a15b-15801d56cc01 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:56.591319 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b98a8-1d37-412b-b2d7-c02bb39041b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:56.592116 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b98a8-1d37-412b-b2d7-c02bb39041b7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:56.592396 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b98a8-1d37-412b-b2d7-c02bb39041b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:56.592673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b98a8-1d37-412b-b2d7-c02bb39041b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:56.607724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b98a8-1d37-412b-b2d7-c02bb39041b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:17:56.616886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-ae4b98a8-1d37-412b-b2d7-c02bb39041b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:17:56.616886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:17:56.616886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:17:56.616886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:17:56.616886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:17:56.616886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:17:56.616886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:17:56.616886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:17:56.616886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:17:56.616886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:17:56.616886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:17:56.616886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:17:56.616886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:17:56.616886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:17:56.616886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:17:56.616886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:17:56.618082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:17:56.618082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:17:56.618082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:17:56.618082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:17:56.618082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:17:56.618082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:17:56.618082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:17:56.618082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:17:56.618082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:17:56.618082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:17:56.618082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:17:56.618082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:17:56.618082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:17:56.618082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:17:56.618082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:17:56.618082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:17:56.618991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:17:56.618991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:17:56.618991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:17:56.618991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:17:56.618991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:17:56.618991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:17:56.618991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:17:56.618991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:17:56.618991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:17:56.618991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:17:56.618991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:17:56.618991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:17:56.618991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 613/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Jul 12 18:17:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:17:56.624932 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20635326-63ba-4b50-86ac-2c2c90feab6d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:56.676369 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:56.737624 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20635326-63ba-4b50-86ac-2c2c90feab6d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:56.776586 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29e64c-9e46-4915-8969-28e0a19fa4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:56.777277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29e64c-9e46-4915-8969-28e0a19fa4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:56.777565 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29e64c-9e46-4915-8969-28e0a19fa4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:56.777845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29e64c-9e46-4915-8969-28e0a19fa4c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:56.778593 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29e64c-9e46-4915-8969-28e0a19fa4c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:56.778898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29e64c-9e46-4915-8969-28e0a19fa4c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:56.780263 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29e64c-9e46-4915-8969-28e0a19fa4c7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:56.789227 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 623/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Jul 12 18:17:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:17:56.795285 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b98a8-1d37-412b-b2d7-c02bb39041b7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:56.895872 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:56.917923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b98a8-1d37-412b-b2d7-c02bb39041b7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:56.957189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0a502-1eb7-417b-a49f-e16da77760ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:56.958168 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0a502-1eb7-417b-a49f-e16da77760ab None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:56.958477 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0a502-1eb7-417b-a49f-e16da77760ab None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:56.958725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0a502-1eb7-417b-a49f-e16da77760ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:56.971962 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0a502-1eb7-417b-a49f-e16da77760ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:56.973443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0a502-1eb7-417b-a49f-e16da77760ab None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:56.995073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-a4b0a502-1eb7-417b-a49f-e16da77760ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:17:56.995073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:17:56.995073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:17:56.995073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:17:56.995073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:17:56.995073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:17:56.995073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:17:56.995073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:17:56.995073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:17:56.995073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:17:56.995073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:17:56.995073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:17:56.995073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:17:56.995073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:17:56.995073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:17:56.996238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:17:56.996238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:17:56.996238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:17:56.996238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:17:56.996238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:17:56.996238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:17:56.996238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:17:56.996238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:17:56.996238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:17:56.996238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:17:56.996238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:17:56.996238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:17:56.996238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:17:56.996238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:17:56.996238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:17:56.996238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:17:56.996238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:17:56.997440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:17:56.997440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:17:56.997440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:17:56.997440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:17:57.003010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 614/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:17:57.003128 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29e64c-9e46-4915-8969-28e0a19fa4c7 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:57.120856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29e64c-9e46-4915-8969-28e0a19fa4c7 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:57.132122 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:57.164375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3068eb-8f6b-4d74-85b3-40243bbd0094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:57.164973 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3068eb-8f6b-4d74-85b3-40243bbd0094 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:57.165334 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3068eb-8f6b-4d74-85b3-40243bbd0094 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:57.165565 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3068eb-8f6b-4d74-85b3-40243bbd0094 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:57.166282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3068eb-8f6b-4d74-85b3-40243bbd0094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:57.166588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3068eb-8f6b-4d74-85b3-40243bbd0094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:57.167950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3068eb-8f6b-4d74-85b3-40243bbd0094 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:57.180304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 624/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:17:57.186352 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0a502-1eb7-417b-a49f-e16da77760ab None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:57.303819 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0a502-1eb7-417b-a49f-e16da77760ab None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:57.349784 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ac45b-e766-44c4-b28a-d1f95c9473e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:57.350753 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ac45b-e766-44c4-b28a-d1f95c9473e6 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:57.351054 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ac45b-e766-44c4-b28a-d1f95c9473e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:57.351364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ac45b-e766-44c4-b28a-d1f95c9473e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:57.354986 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:57.361831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ac45b-e766-44c4-b28a-d1f95c9473e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:57.363752 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ac45b-e766-44c4-b28a-d1f95c9473e6 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:57.381009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-2c8ac45b-e766-44c4-b28a-d1f95c9473e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:17:57.381009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:17:57.381009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:17:57.381009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:17:57.381009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:17:57.381009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:17:57.381009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:17:57.381009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:17:57.381009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:17:57.381009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:17:57.381009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:17:57.381009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:17:57.381009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:17:57.381009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:17:57.381009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:17:57.381009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:17:57.383150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:17:57.383150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:17:57.383150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:17:57.383150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:17:57.383150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:17:57.383150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:17:57.383150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:17:57.383150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:17:57.383150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:17:57.383150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:17:57.383150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:17:57.383150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:17:57.383150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:17:57.383150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:17:57.383150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:17:57.383150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:17:57.383150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:17:57.383150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:17:57.385052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:17:57.385052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:17:57.385052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:17:57.385052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:17:57.385052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:17:57.385052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:17:57.385052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:17:57.385052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:17:57.385052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:17:57.385052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:17:57.385052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 615/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:17:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:17:57.388096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3068eb-8f6b-4d74-85b3-40243bbd0094 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:57.491628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3068eb-8f6b-4d74-85b3-40243bbd0094 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:57.529277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadc59c-fe26-4672-a9fa-a0c91a244ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:57.529996 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadc59c-fe26-4672-a9fa-a0c91a244ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:57.530284 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadc59c-fe26-4672-a9fa-a0c91a244ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:57.530554 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadc59c-fe26-4672-a9fa-a0c91a244ec0 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:57.531384 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadc59c-fe26-4672-a9fa-a0c91a244ec0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:57.531729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadc59c-fe26-4672-a9fa-a0c91a244ec0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:57.533166 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadc59c-fe26-4672-a9fa-a0c91a244ec0 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:57.551408 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 625/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Jul 12 18:17:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:17:57.558123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ac45b-e766-44c4-b28a-d1f95c9473e6 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:57.666378 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ac45b-e766-44c4-b28a-d1f95c9473e6 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:57.709223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d0ec8-4bde-4b5a-aec1-a56c9457fb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:57.709915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d0ec8-4bde-4b5a-aec1-a56c9457fb80 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:57.710198 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d0ec8-4bde-4b5a-aec1-a56c9457fb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:57.710460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d0ec8-4bde-4b5a-aec1-a56c9457fb80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:57.780128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:57.787582 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d0ec8-4bde-4b5a-aec1-a56c9457fb80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:57.789050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d0ec8-4bde-4b5a-aec1-a56c9457fb80 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:57.896950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 616/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:17:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 18:17:57.898178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadc59c-fe26-4672-a9fa-a0c91a244ec0 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:57.928805 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:58.012781 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadc59c-fe26-4672-a9fa-a0c91a244ec0 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:58.053192 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4660e7-ee86-4f49-ba30-acd1bcddd6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:58.053938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4660e7-ee86-4f49-ba30-acd1bcddd6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:58.054216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4660e7-ee86-4f49-ba30-acd1bcddd6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:58.054488 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4660e7-ee86-4f49-ba30-acd1bcddd6b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:58.064954 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4660e7-ee86-4f49-ba30-acd1bcddd6b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:58.066432 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4660e7-ee86-4f49-ba30-acd1bcddd6b3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:58.084838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-4e4660e7-ee86-4f49-ba30-acd1bcddd6b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:17:58.084838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:17:58.084838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:17:58.084838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:17:58.084838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:17:58.084838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:17:58.084838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:17:58.084838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:17:58.084838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:17:58.084838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:17:58.084838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:17:58.084838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:17:58.084838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:17:58.084838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:17:58.084838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:17:58.086002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:17:58.086002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:17:58.086002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:17:58.086002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:17:58.086002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:17:58.086002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:17:58.086002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:17:58.086002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:17:58.086002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:17:58.086002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:17:58.086002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:17:58.086002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:17:58.086002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:17:58.086002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:17:58.086002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:17:58.086002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:17:58.086002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:17:58.087013 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:17:58.087013 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:17:58.087013 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:17:58.087013 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:17:58.087013 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 626/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:17:58.091764 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d0ec8-4bde-4b5a-aec1-a56c9457fb80 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:58.192979 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:58.200104 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d0ec8-4bde-4b5a-aec1-a56c9457fb80 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:58.235766 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce74a01-7554-43b0-9477-e21e169a4bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:58.236431 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce74a01-7554-43b0-9477-e21e169a4bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:58.236707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce74a01-7554-43b0-9477-e21e169a4bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:58.236992 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce74a01-7554-43b0-9477-e21e169a4bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:58.237740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce74a01-7554-43b0-9477-e21e169a4bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:58.238045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce74a01-7554-43b0-9477-e21e169a4bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:58.239421 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce74a01-7554-43b0-9477-e21e169a4bf2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:58.251451 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 617/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:17:58.256983 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4660e7-ee86-4f49-ba30-acd1bcddd6b3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:58.346169 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:58.374082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4660e7-ee86-4f49-ba30-acd1bcddd6b3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:58.411698 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0f0db-0cc7-4957-8a0d-ad05bbd3398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:58.412490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0f0db-0cc7-4957-8a0d-ad05bbd3398f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:58.412767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0f0db-0cc7-4957-8a0d-ad05bbd3398f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:58.413037 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0f0db-0cc7-4957-8a0d-ad05bbd3398f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:58.420005 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0f0db-0cc7-4957-8a0d-ad05bbd3398f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:58.421466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0f0db-0cc7-4957-8a0d-ad05bbd3398f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:58.436003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-78c0f0db-0cc7-4957-8a0d-ad05bbd3398f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:17:58.436003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:17:58.436003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:17:58.436003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:17:58.436003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:17:58.436003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:17:58.436003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:17:58.436003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:17:58.436003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:17:58.436003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:17:58.436003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:17:58.436003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:17:58.436003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:17:58.436003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:17:58.436003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:17:58.437096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:17:58.437096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:17:58.437096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:17:58.437096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:17:58.437096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:17:58.437096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:17:58.437096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:17:58.437096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:17:58.437096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:17:58.437096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:17:58.437096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:17:58.437096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:17:58.437096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:17:58.437096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:17:58.437096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:17:58.437096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:17:58.437096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:17:58.438286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:17:58.438286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:17:58.438286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:17:58.438286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:17:58.438286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:17:58.438286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:17:58.438286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:17:58.438286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:17:58.438286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 627/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:17:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:17:58.443566 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce74a01-7554-43b0-9477-e21e169a4bf2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:58.548365 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce74a01-7554-43b0-9477-e21e169a4bf2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:58.585479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67534c-f9a8-4fc8-acb3-c49be917d727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:58.586141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67534c-f9a8-4fc8-acb3-c49be917d727 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:58.586425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67534c-f9a8-4fc8-acb3-c49be917d727 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:58.586701 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67534c-f9a8-4fc8-acb3-c49be917d727 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:58.587484 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67534c-f9a8-4fc8-acb3-c49be917d727 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:58.587793 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67534c-f9a8-4fc8-acb3-c49be917d727 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:58.589236 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67534c-f9a8-4fc8-acb3-c49be917d727 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:58.602736 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 618/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:17:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:17:58.608971 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0f0db-0cc7-4957-8a0d-ad05bbd3398f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:58.722083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0f0db-0cc7-4957-8a0d-ad05bbd3398f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:58.755894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954a85a-a13c-44fb-91a3-a0658be4460a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:58.756623 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954a85a-a13c-44fb-91a3-a0658be4460a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:58.756909 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954a85a-a13c-44fb-91a3-a0658be4460a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:58.757230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954a85a-a13c-44fb-91a3-a0658be4460a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:58.758165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954a85a-a13c-44fb-91a3-a0658be4460a None admin] RBAC: Adding query filter params (role.id=82fa784b33dd4fe19c62367f39ac45b2, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=206242c775be40c7b96af6de635e2065) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:58.758482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954a85a-a13c-44fb-91a3-a0658be4460a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:58.759962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954a85a-a13c-44fb-91a3-a0658be4460a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:58.766592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 628/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:17:58 2022] GET /identity/v3/role_assignments?user.id=206242c775be40c7b96af6de635e2065&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=82fa784b33dd4fe19c62367f39ac45b2 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:00.816678 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2308a-8c38-4b33-ba03-63bc58e80c09 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:00.817229 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2308a-8c38-4b33-ba03-63bc58e80c09 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:00.817229 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2308a-8c38-4b33-ba03-63bc58e80c09 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:00.818489 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 619/1247] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:18:00.824179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb3ce3-f471-4597-abb2-8b1b1ab6c109 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:00.824599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb3ce3-f471-4597-abb2-8b1b1ab6c109 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:00.824806 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb3ce3-f471-4597-abb2-8b1b1ab6c109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:00.831484 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:00.846317 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-3aeb3ce3-f471-4597-abb2-8b1b1ab6c109 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:18:00.847486 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3aeb3ce3-f471-4597-abb2-8b1b1ab6c109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:18:00.922565 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 629/1248] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:18:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:18:00.945566 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2308a-8c38-4b33-ba03-63bc58e80c09 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:00.965659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:01.058103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2308a-8c38-4b33-ba03-63bc58e80c09 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:01.095191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0b486-75db-4437-9ad6-4190f0bb58bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:01.095900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0b486-75db-4437-9ad6-4190f0bb58bf None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:01.096178 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0b486-75db-4437-9ad6-4190f0bb58bf None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:01.096446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0b486-75db-4437-9ad6-4190f0bb58bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:01.107443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0b486-75db-4437-9ad6-4190f0bb58bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:18:01.117052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-20c0b486-75db-4437-9ad6-4190f0bb58bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:18:01.117052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:01.117052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:18:01.117052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:18:01.117052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:18:01.117052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:18:01.117052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:18:01.117052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:18:01.117052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:18:01.117052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:18:01.117052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:18:01.117052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:18:01.117052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:18:01.117052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:18:01.117052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:18:01.117052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:18:01.118251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:18:01.118251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:18:01.118251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:18:01.118251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:18:01.118251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:18:01.118251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:18:01.118251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:18:01.118251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:18:01.118251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:18:01.118251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:18:01.118251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:18:01.118251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:18:01.118251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:18:01.118251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:18:01.118251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:18:01.118251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:18:01.122419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:18:01.122419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:18:01.122419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:18:01.122419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:18:01.122419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:18:01.122419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:18:01.122419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:18:01.122419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:18:01.122419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:18:01.122419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:18:01.122419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:18:01.122419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:18:01.122419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 620/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:18:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:18:01.124216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb3ce3-f471-4597-abb2-8b1b1ab6c109 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:01.234224 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb3ce3-f471-4597-abb2-8b1b1ab6c109 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:01.265694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:01.271278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4dc70-cb9d-4951-9fdd-a90e9f636c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:01.272080 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4dc70-cb9d-4951-9fdd-a90e9f636c95 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:01.272466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4dc70-cb9d-4951-9fdd-a90e9f636c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:01.272844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4dc70-cb9d-4951-9fdd-a90e9f636c95 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:01.273730 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4dc70-cb9d-4951-9fdd-a90e9f636c95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:01.274141 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4dc70-cb9d-4951-9fdd-a90e9f636c95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:01.275995 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4dc70-cb9d-4951-9fdd-a90e9f636c95 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:01.285413 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 630/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:18:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:01.291402 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0b486-75db-4437-9ad6-4190f0bb58bf None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:01.382048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:01.407376 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0b486-75db-4437-9ad6-4190f0bb58bf None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:01.444167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee277c1-6632-4d0a-8fb6-25b5be82ee3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:01.444940 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee277c1-6632-4d0a-8fb6-25b5be82ee3b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:01.445222 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee277c1-6632-4d0a-8fb6-25b5be82ee3b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:01.445519 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee277c1-6632-4d0a-8fb6-25b5be82ee3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:01.457106 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee277c1-6632-4d0a-8fb6-25b5be82ee3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:01.458612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee277c1-6632-4d0a-8fb6-25b5be82ee3b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:01.476669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-2ee277c1-6632-4d0a-8fb6-25b5be82ee3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:18:01.476669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:01.476669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:18:01.476669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:18:01.476669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:18:01.476669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:18:01.476669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:18:01.476669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:18:01.476669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:18:01.476669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:18:01.476669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:18:01.476669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:18:01.476669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:18:01.476669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:18:01.476669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:18:01.477838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:18:01.477838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:18:01.477838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:18:01.477838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:18:01.477838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:18:01.477838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:18:01.477838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:18:01.477838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:18:01.477838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:18:01.477838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:18:01.477838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:18:01.477838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:18:01.477838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:18:01.477838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:18:01.477838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:18:01.477838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:18:01.477838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:18:01.478962 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:18:01.478962 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:18:01.478962 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:18:01.478962 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:18:01.483912 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 621/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:18:01.484060 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4dc70-cb9d-4951-9fdd-a90e9f636c95 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:01.596334 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4dc70-cb9d-4951-9fdd-a90e9f636c95 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:01.632847 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6c517-e5fc-4584-a621-f8b5cd1cea70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:01.633453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6c517-e5fc-4584-a621-f8b5cd1cea70 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:01.633738 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6c517-e5fc-4584-a621-f8b5cd1cea70 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:01.634016 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6c517-e5fc-4584-a621-f8b5cd1cea70 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:01.634734 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6c517-e5fc-4584-a621-f8b5cd1cea70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:01.635044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6c517-e5fc-4584-a621-f8b5cd1cea70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:01.636418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6c517-e5fc-4584-a621-f8b5cd1cea70 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:01.650332 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 631/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:01.656188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee277c1-6632-4d0a-8fb6-25b5be82ee3b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:01.779012 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee277c1-6632-4d0a-8fb6-25b5be82ee3b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:01.808307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:01.818373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1aa77f-f511-4823-81a9-a45c8b98e8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:01.819521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1aa77f-f511-4823-81a9-a45c8b98e8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:01.819944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1aa77f-f511-4823-81a9-a45c8b98e8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:01.820260 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1aa77f-f511-4823-81a9-a45c8b98e8f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:01.829721 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1aa77f-f511-4823-81a9-a45c8b98e8f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:01.831387 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1aa77f-f511-4823-81a9-a45c8b98e8f1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:01.849346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-db1aa77f-f511-4823-81a9-a45c8b98e8f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:18:01.849346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:01.849346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:18:01.849346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:18:01.849346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:18:01.849346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:18:01.849346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:18:01.849346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:18:01.849346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:18:01.849346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:18:01.849346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:18:01.849346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:18:01.849346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:18:01.849346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:18:01.849346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:18:01.849346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:18:01.850492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:18:01.850492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:18:01.850492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:18:01.850492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:18:01.850492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:18:01.850492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:18:01.850492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:18:01.850492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:18:01.850492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:18:01.850492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:18:01.850492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:18:01.850492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:18:01.850492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:18:01.850492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:18:01.850492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:18:01.850492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:18:01.850492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:18:01.850492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:18:01.851644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:18:01.851644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:18:01.851644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:18:01.851644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:18:01.851644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:18:01.851644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:18:01.851644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:18:01.851644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:18:01.851644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:18:01.851644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:18:01.851644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 622/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:18:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:18:01.860008 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6c517-e5fc-4584-a621-f8b5cd1cea70 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:01.922481 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:01.972594 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6c517-e5fc-4584-a621-f8b5cd1cea70 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:02.010620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ab348-074f-428a-b394-07f3fc43cd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:02.011327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ab348-074f-428a-b394-07f3fc43cd72 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:02.011610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ab348-074f-428a-b394-07f3fc43cd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:02.011865 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ab348-074f-428a-b394-07f3fc43cd72 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:02.012699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ab348-074f-428a-b394-07f3fc43cd72 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:02.013003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ab348-074f-428a-b394-07f3fc43cd72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:02.014498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ab348-074f-428a-b394-07f3fc43cd72 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:02.034221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 632/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Jul 12 18:18:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:02.040094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1aa77f-f511-4823-81a9-a45c8b98e8f1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:02.149442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1aa77f-f511-4823-81a9-a45c8b98e8f1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:02.189274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9cd7b-bf21-461d-8f2c-69c841aff29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:02.189868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9cd7b-bf21-461d-8f2c-69c841aff29d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:02.190154 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9cd7b-bf21-461d-8f2c-69c841aff29d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:02.190454 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9cd7b-bf21-461d-8f2c-69c841aff29d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:02.254210 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:02.271828 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9cd7b-bf21-461d-8f2c-69c841aff29d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:02.273566 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9cd7b-bf21-461d-8f2c-69c841aff29d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:02.387055 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 623/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:18:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 18:18:02.393439 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ab348-074f-428a-b394-07f3fc43cd72 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:02.504031 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ab348-074f-428a-b394-07f3fc43cd72 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:02.518634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:02.541752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab4af1-5fc9-4beb-80f4-94d855baf0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:02.542607 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab4af1-5fc9-4beb-80f4-94d855baf0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:02.542912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab4af1-5fc9-4beb-80f4-94d855baf0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:02.543210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab4af1-5fc9-4beb-80f4-94d855baf0d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:02.554325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab4af1-5fc9-4beb-80f4-94d855baf0d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:02.555813 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab4af1-5fc9-4beb-80f4-94d855baf0d9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:02.574729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-4eab4af1-5fc9-4beb-80f4-94d855baf0d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:18:02.574729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:02.574729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:18:02.574729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:18:02.574729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:18:02.574729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:18:02.574729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:18:02.574729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:18:02.574729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:18:02.574729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:18:02.574729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:18:02.574729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:18:02.574729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:18:02.574729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:18:02.574729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:18:02.576054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:18:02.576054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:18:02.576054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:18:02.576054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:18:02.576054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:18:02.576054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:18:02.576054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:18:02.576054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:18:02.576054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:18:02.576054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:18:02.576054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:18:02.576054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:18:02.576054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:18:02.576054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:18:02.576054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:18:02.576054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:18:02.576054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:18:02.577341 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:18:02.577341 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:18:02.577341 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:18:02.577341 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:18:02.577341 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 633/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:18:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:18:02.582220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9cd7b-bf21-461d-8f2c-69c841aff29d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:02.677248 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:02.690880 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9cd7b-bf21-461d-8f2c-69c841aff29d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:02.728687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f650697-c127-4f58-a1f7-b5f40486bb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:02.729390 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f650697-c127-4f58-a1f7-b5f40486bb55 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:02.729676 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f650697-c127-4f58-a1f7-b5f40486bb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:02.729952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f650697-c127-4f58-a1f7-b5f40486bb55 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:02.730864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f650697-c127-4f58-a1f7-b5f40486bb55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:02.731241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f650697-c127-4f58-a1f7-b5f40486bb55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:02.732829 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f650697-c127-4f58-a1f7-b5f40486bb55 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:02.745822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 624/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:02.751977 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab4af1-5fc9-4beb-80f4-94d855baf0d9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:02.863206 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab4af1-5fc9-4beb-80f4-94d855baf0d9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:02.898143 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae216b-f204-490a-92ed-7ac598474b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:02.898914 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae216b-f204-490a-92ed-7ac598474b3e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:02.899191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae216b-f204-490a-92ed-7ac598474b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:02.899469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae216b-f204-490a-92ed-7ac598474b3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:02.907045 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae216b-f204-490a-92ed-7ac598474b3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:02.908437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae216b-f204-490a-92ed-7ac598474b3e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:02.924063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-deae216b-f204-490a-92ed-7ac598474b3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:18:02.924063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:02.924063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:18:02.924063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:18:02.924063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:18:02.924063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:18:02.924063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:18:02.924063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:18:02.924063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:18:02.924063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:18:02.924063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:18:02.924063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:18:02.924063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:18:02.924063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:18:02.924063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:18:02.925138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:18:02.925138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:18:02.925138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:18:02.925138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:18:02.925138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:18:02.925138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:18:02.925138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:18:02.925138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:18:02.925138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:18:02.925138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:18:02.925138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:18:02.925138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:18:02.925138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:18:02.925138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:18:02.925138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:18:02.925138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:18:02.925138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:18:02.926234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:18:02.926234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:18:02.926234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:18:02.926234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:18:02.926234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:18:02.926234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:18:02.926234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:18:02.926234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:18:02.926234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 634/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:18:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:18:02.931662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f650697-c127-4f58-a1f7-b5f40486bb55 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:03.051931 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f650697-c127-4f58-a1f7-b5f40486bb55 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:03.087926 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f11995-92c5-4924-b1b9-854b60c61c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:03.088596 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f11995-92c5-4924-b1b9-854b60c61c09 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:03.088879 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f11995-92c5-4924-b1b9-854b60c61c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:03.089152 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f11995-92c5-4924-b1b9-854b60c61c09 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:03.089978 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f11995-92c5-4924-b1b9-854b60c61c09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:03.090289 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f11995-92c5-4924-b1b9-854b60c61c09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:03.091770 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f11995-92c5-4924-b1b9-854b60c61c09 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:03.105625 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 625/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:18:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:03.112463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae216b-f204-490a-92ed-7ac598474b3e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:03.139216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:03.219905 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae216b-f204-490a-92ed-7ac598474b3e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:03.256055 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076af9a-b441-4fd0-ab68-82861ba95af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:03.256734 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076af9a-b441-4fd0-ab68-82861ba95af7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:03.257017 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076af9a-b441-4fd0-ab68-82861ba95af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:03.257326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076af9a-b441-4fd0-ab68-82861ba95af7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:03.258181 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076af9a-b441-4fd0-ab68-82861ba95af7 None admin] RBAC: Adding query filter params (role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=206242c775be40c7b96af6de635e2065) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:03.258494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076af9a-b441-4fd0-ab68-82861ba95af7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:03.259968 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076af9a-b441-4fd0-ab68-82861ba95af7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:03.266824 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 635/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:18:03 2022] GET /identity/v3/role_assignments?user.id=206242c775be40c7b96af6de635e2065&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:05.271372 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305c8e9-415b-4985-9837-cd9f6431efe8 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:05.271917 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305c8e9-415b-4985-9837-cd9f6431efe8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:05.271917 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305c8e9-415b-4985-9837-cd9f6431efe8 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:05.273315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 626/1261] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:18:05.278492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ed4cf-1d38-4e11-b43a-4da65a4b340b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:05.278929 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ed4cf-1d38-4e11-b43a-4da65a4b340b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:05.279048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ed4cf-1d38-4e11-b43a-4da65a4b340b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:05.295731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b78ed4cf-1d38-4e11-b43a-4da65a4b340b None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:18:05.296898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b78ed4cf-1d38-4e11-b43a-4da65a4b340b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:18:05.367509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 636/1262] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:18:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:18:05.393364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305c8e9-415b-4985-9837-cd9f6431efe8 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:05.404162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:05.492716 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305c8e9-415b-4985-9837-cd9f6431efe8 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:05.525022 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179f7e8-d67e-4e77-b64d-524b7c17df23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:05.525769 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179f7e8-d67e-4e77-b64d-524b7c17df23 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:05.526051 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179f7e8-d67e-4e77-b64d-524b7c17df23 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:05.526325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179f7e8-d67e-4e77-b64d-524b7c17df23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:05.536801 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179f7e8-d67e-4e77-b64d-524b7c17df23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:18:05.544437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-5179f7e8-d67e-4e77-b64d-524b7c17df23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:18:05.544437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:05.544437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:18:05.544437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:18:05.544437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:18:05.544437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:18:05.544437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:18:05.544437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:18:05.544437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:18:05.544437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:18:05.544437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:18:05.544437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:18:05.544437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:18:05.544437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:18:05.544437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:18:05.544437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:18:05.545576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:18:05.545576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:18:05.545576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:18:05.545576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:18:05.545576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:18:05.545576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:18:05.545576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:18:05.545576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:18:05.545576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:18:05.545576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:18:05.545576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:18:05.545576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:18:05.545576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:18:05.545576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:18:05.545576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:18:05.545576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:18:05.546853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:18:05.546853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:18:05.546853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:18:05.546853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:18:05.546853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:18:05.546853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:18:05.546853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:18:05.546853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:18:05.546853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:18:05.546853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:18:05.546853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:18:05.546853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:18:05.546853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 627/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:18:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:18:05.551687 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ed4cf-1d38-4e11-b43a-4da65a4b340b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:05.569954 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:05.651436 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ed4cf-1d38-4e11-b43a-4da65a4b340b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:05.684517 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bf220-8da9-4cb8-9b3c-bc96025ac36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:05.685175 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bf220-8da9-4cb8-9b3c-bc96025ac36b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:05.685490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bf220-8da9-4cb8-9b3c-bc96025ac36b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:05.685766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bf220-8da9-4cb8-9b3c-bc96025ac36b None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:05.686504 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bf220-8da9-4cb8-9b3c-bc96025ac36b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:05.686813 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bf220-8da9-4cb8-9b3c-bc96025ac36b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:05.688939 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bf220-8da9-4cb8-9b3c-bc96025ac36b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:05.697199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 637/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:18:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:05.702838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179f7e8-d67e-4e77-b64d-524b7c17df23 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:05.768793 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:05.802309 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179f7e8-d67e-4e77-b64d-524b7c17df23 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:05.834525 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f10c6f-abdc-41e7-9d61-86fdd4272ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:05.835304 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f10c6f-abdc-41e7-9d61-86fdd4272ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:05.835581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f10c6f-abdc-41e7-9d61-86fdd4272ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:05.835850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f10c6f-abdc-41e7-9d61-86fdd4272ed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:05.846506 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f10c6f-abdc-41e7-9d61-86fdd4272ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:05.847943 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f10c6f-abdc-41e7-9d61-86fdd4272ed4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:05.864846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-f2f10c6f-abdc-41e7-9d61-86fdd4272ed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:18:05.864846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:05.864846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:18:05.864846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:18:05.864846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:18:05.864846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:18:05.864846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:18:05.864846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:18:05.864846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:18:05.864846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:18:05.864846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:18:05.864846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:18:05.864846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:18:05.864846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:18:05.864846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:18:05.865901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:18:05.865901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:18:05.865901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:18:05.865901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:18:05.865901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:18:05.865901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:18:05.865901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:18:05.865901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:18:05.865901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:18:05.865901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:18:05.865901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:18:05.865901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:18:05.865901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:18:05.865901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:18:05.865901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:18:05.865901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:18:05.865901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:18:05.867014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:18:05.867014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:18:05.867014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:18:05.867014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:18:05.867014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 628/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:18:05.871840 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bf220-8da9-4cb8-9b3c-bc96025ac36b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:05.950148 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:05.968507 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bf220-8da9-4cb8-9b3c-bc96025ac36b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:06.001325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86085b-e456-4613-905c-ad1773ba9847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:06.001969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86085b-e456-4613-905c-ad1773ba9847 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:06.002250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86085b-e456-4613-905c-ad1773ba9847 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:06.002520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86085b-e456-4613-905c-ad1773ba9847 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:06.003224 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86085b-e456-4613-905c-ad1773ba9847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:06.003528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86085b-e456-4613-905c-ad1773ba9847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:06.004879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86085b-e456-4613-905c-ad1773ba9847 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:06.016223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 638/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:06.022247 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f10c6f-abdc-41e7-9d61-86fdd4272ed4 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:06.122024 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f10c6f-abdc-41e7-9d61-86fdd4272ed4 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:06.140488 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:06.154433 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4c562-56bd-481e-ba5c-df18b8ebd38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:06.155220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c562-56bd-481e-ba5c-df18b8ebd38d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:06.155502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c562-56bd-481e-ba5c-df18b8ebd38d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:06.155774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c562-56bd-481e-ba5c-df18b8ebd38d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:06.163577 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4c562-56bd-481e-ba5c-df18b8ebd38d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:06.165010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4c562-56bd-481e-ba5c-df18b8ebd38d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:06.178825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-e1f4c562-56bd-481e-ba5c-df18b8ebd38d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:18:06.178825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:06.178825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:18:06.178825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:18:06.178825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:18:06.178825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:18:06.178825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:18:06.178825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:18:06.178825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:18:06.178825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:18:06.178825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:18:06.178825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:18:06.178825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:18:06.178825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:18:06.178825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:18:06.178825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:18:06.179754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:18:06.179754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:18:06.179754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:18:06.179754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:18:06.179754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:18:06.179754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:18:06.179754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:18:06.179754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:18:06.179754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:18:06.179754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:18:06.179754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:18:06.179754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:18:06.179754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:18:06.179754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:18:06.179754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:18:06.179754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:18:06.179754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:18:06.179754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:18:06.180767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:18:06.180767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:18:06.180767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:18:06.180767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:18:06.180767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:18:06.180767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:18:06.180767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:18:06.180767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:18:06.180767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:18:06.180767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:18:06.180767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 629/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:18:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:18:06.185822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86085b-e456-4613-905c-ad1773ba9847 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:06.281081 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86085b-e456-4613-905c-ad1773ba9847 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:06.313821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bba6f-e011-4019-9275-daf2bbb1d9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:06.314473 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bba6f-e011-4019-9275-daf2bbb1d9cb None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:06.314751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bba6f-e011-4019-9275-daf2bbb1d9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:06.315022 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bba6f-e011-4019-9275-daf2bbb1d9cb None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:06.315836 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bba6f-e011-4019-9275-daf2bbb1d9cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:06.316142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bba6f-e011-4019-9275-daf2bbb1d9cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:06.317597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bba6f-e011-4019-9275-daf2bbb1d9cb None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:06.327425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:06.336851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 639/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Jul 12 18:18:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:06.343255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4c562-56bd-481e-ba5c-df18b8ebd38d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:06.445862 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4c562-56bd-481e-ba5c-df18b8ebd38d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:06.482632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b9515-59c0-4703-9e9c-2886bbfe935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:06.483409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b9515-59c0-4703-9e9c-2886bbfe935e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:06.483686 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b9515-59c0-4703-9e9c-2886bbfe935e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:06.483957 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b9515-59c0-4703-9e9c-2886bbfe935e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:06.494049 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b9515-59c0-4703-9e9c-2886bbfe935e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:06.495481 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b9515-59c0-4703-9e9c-2886bbfe935e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:06.512194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-242b9515-59c0-4703-9e9c-2886bbfe935e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:18:06.512194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:06.512194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:18:06.512194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:18:06.512194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:18:06.512194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:18:06.512194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:18:06.512194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:18:06.512194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:18:06.512194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:18:06.512194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:18:06.512194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:18:06.512194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:18:06.512194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:18:06.512194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:18:06.513330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:18:06.513330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:18:06.513330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:18:06.513330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:18:06.513330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:18:06.513330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:18:06.513330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:18:06.513330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:18:06.513330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:18:06.513330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:18:06.513330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:18:06.513330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:18:06.513330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:18:06.513330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:18:06.513330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:18:06.513330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:18:06.513330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:18:06.514551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:18:06.514551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:18:06.514551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:18:06.514551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:18:06.514551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 630/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:18:06.519681 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bba6f-e011-4019-9275-daf2bbb1d9cb None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:06.615939 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bba6f-e011-4019-9275-daf2bbb1d9cb None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:06.649568 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cd083-af51-42cd-ac7e-da44b31faacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:06.650742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cd083-af51-42cd-ac7e-da44b31faacf None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:06.650742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cd083-af51-42cd-ac7e-da44b31faacf None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:06.650742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cd083-af51-42cd-ac7e-da44b31faacf None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:06.651465 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cd083-af51-42cd-ac7e-da44b31faacf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:06.651769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cd083-af51-42cd-ac7e-da44b31faacf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:06.653133 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cd083-af51-42cd-ac7e-da44b31faacf None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:06.664095 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 640/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:06.669755 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b9515-59c0-4703-9e9c-2886bbfe935e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:06.700999 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:06.773554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b9515-59c0-4703-9e9c-2886bbfe935e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:06.806456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e0054-5a3a-45b1-8c0d-218ef7cc23ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:06.807299 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e0054-5a3a-45b1-8c0d-218ef7cc23ca None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:06.807639 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e0054-5a3a-45b1-8c0d-218ef7cc23ca None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:06.807920 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e0054-5a3a-45b1-8c0d-218ef7cc23ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:06.815930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e0054-5a3a-45b1-8c0d-218ef7cc23ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:06.817405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e0054-5a3a-45b1-8c0d-218ef7cc23ca None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:06.832245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-e33e0054-5a3a-45b1-8c0d-218ef7cc23ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:18:06.832245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:06.832245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:18:06.832245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:18:06.832245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:18:06.832245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:18:06.832245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:18:06.832245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:18:06.832245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:18:06.832245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:18:06.832245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:18:06.832245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:18:06.832245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:18:06.832245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:18:06.832245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:18:06.833281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:18:06.833281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:18:06.833281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:18:06.833281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:18:06.833281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:18:06.833281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:18:06.833281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:18:06.833281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:18:06.833281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:18:06.833281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:18:06.833281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:18:06.833281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:18:06.833281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:18:06.833281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:18:06.833281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:18:06.833281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:18:06.833281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:18:06.834339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:18:06.834339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:18:06.834339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:18:06.834339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:18:06.834339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:18:06.834339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:18:06.834339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:18:06.834339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:18:06.834339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 631/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:18:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:18:06.839258 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cd083-af51-42cd-ac7e-da44b31faacf None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:06.896717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:06.936764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cd083-af51-42cd-ac7e-da44b31faacf None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:06.969744 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dea848-234f-4a48-bfb2-8886256522f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:06.970326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dea848-234f-4a48-bfb2-8886256522f7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:06.970606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dea848-234f-4a48-bfb2-8886256522f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:06.970881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dea848-234f-4a48-bfb2-8886256522f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:06.971647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dea848-234f-4a48-bfb2-8886256522f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:06.971954 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dea848-234f-4a48-bfb2-8886256522f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:06.973404 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dea848-234f-4a48-bfb2-8886256522f7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:06.984970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 641/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:18:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:06.990874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e0054-5a3a-45b1-8c0d-218ef7cc23ca None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:07.077829 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:07.087362 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e0054-5a3a-45b1-8c0d-218ef7cc23ca None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:07.121278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82dbcb-8283-4e4b-80cd-2ad5ef14515b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:07.122168 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82dbcb-8283-4e4b-80cd-2ad5ef14515b None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:07.122448 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82dbcb-8283-4e4b-80cd-2ad5ef14515b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:07.122719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82dbcb-8283-4e4b-80cd-2ad5ef14515b None admin] PATH_INFO: `/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/206242c775be40c7b96af6de635e2065/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:07.124645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82dbcb-8283-4e4b-80cd-2ad5ef14515b None admin] RBAC: Authorizing `identity:create_grant(project_id=5fee99b2e9234f88ac79ff70429b6f20, user_id=206242c775be40c7b96af6de635e2065, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:07.126142 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82dbcb-8283-4e4b-80cd-2ad5ef14515b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:07.138274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 632/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Jul 12 18:18:06 2022] PUT /identity/v3/projects/5fee99b2e9234f88ac79ff70429b6f20/users/206242c775be40c7b96af6de635e2065/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:18:09.114578 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772234c9-c823-4d5e-829c-752fef2f80b2 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:09.115095 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772234c9-c823-4d5e-829c-752fef2f80b2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:09.115187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772234c9-c823-4d5e-829c-752fef2f80b2 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:09.116490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 642/1274] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:18:09.121518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc715a5-b262-4613-8ca8-a07afb7498d8 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:09.121953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc715a5-b262-4613-8ca8-a07afb7498d8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:09.122066 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc715a5-b262-4613-8ca8-a07afb7498d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:09.138109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2fc715a5-b262-4613-8ca8-a07afb7498d8 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:18:09.139274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2fc715a5-b262-4613-8ca8-a07afb7498d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:18:09.205945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 633/1275] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:18:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:18:09.229655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772234c9-c823-4d5e-829c-752fef2f80b2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:09.327479 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772234c9-c823-4d5e-829c-752fef2f80b2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:09.345297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:09.361904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59df69-db56-4666-a4f6-5dd7055aa0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:09.362691 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59df69-db56-4666-a4f6-5dd7055aa0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:09.362975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59df69-db56-4666-a4f6-5dd7055aa0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:09.363251 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59df69-db56-4666-a4f6-5dd7055aa0d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:09.373288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59df69-db56-4666-a4f6-5dd7055aa0d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:18:09.381003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-5d59df69-db56-4666-a4f6-5dd7055aa0d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:18:09.381003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:09.381003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:18:09.381003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:18:09.381003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:18:09.381003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:18:09.381003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:18:09.381003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:18:09.381003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:18:09.381003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:18:09.381003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:18:09.381003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:18:09.381003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:18:09.381003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:18:09.381003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:18:09.381003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:18:09.382111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:18:09.382111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:18:09.382111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:18:09.382111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:18:09.382111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:18:09.382111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:18:09.382111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:18:09.382111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:18:09.382111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:18:09.382111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:18:09.382111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:18:09.382111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:18:09.382111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:18:09.382111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:18:09.382111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:18:09.382111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:18:09.382962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:18:09.382962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:18:09.382962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:18:09.382962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:18:09.382962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:18:09.382962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:18:09.382962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:18:09.382962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:18:09.382962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:18:09.382962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:18:09.382962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:18:09.382962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:18:09.382962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 643/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Jul 12 18:18:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:18:09.387994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc715a5-b262-4613-8ca8-a07afb7498d8 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:09.466646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:09.486155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc715a5-b262-4613-8ca8-a07afb7498d8 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:09.519078 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b00da-8c35-4107-adfe-58459e665988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:09.519734 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b00da-8c35-4107-adfe-58459e665988 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:09.520016 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b00da-8c35-4107-adfe-58459e665988 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:09.520289 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b00da-8c35-4107-adfe-58459e665988 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:09.521027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b00da-8c35-4107-adfe-58459e665988 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:09.521366 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b00da-8c35-4107-adfe-58459e665988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:09.522741 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b00da-8c35-4107-adfe-58459e665988 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:09.530552 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 634/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Jul 12 18:18:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:09.536160 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59df69-db56-4666-a4f6-5dd7055aa0d4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:09.635290 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59df69-db56-4666-a4f6-5dd7055aa0d4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:09.667695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1579cc-8447-4572-bf7a-d693b59bc792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:09.668470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1579cc-8447-4572-bf7a-d693b59bc792 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:09.668751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1579cc-8447-4572-bf7a-d693b59bc792 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:09.669025 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1579cc-8447-4572-bf7a-d693b59bc792 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:09.679252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1579cc-8447-4572-bf7a-d693b59bc792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:09.680686 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1579cc-8447-4572-bf7a-d693b59bc792 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:09.698163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-6c1579cc-8447-4572-bf7a-d693b59bc792 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:18:09.698163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:09.698163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:18:09.698163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:18:09.698163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:18:09.698163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:18:09.698163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:18:09.698163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:18:09.698163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:18:09.698163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:18:09.698163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:18:09.698163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:18:09.698163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:18:09.698163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:18:09.698163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:18:09.699199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:18:09.699199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:18:09.699199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:18:09.699199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:18:09.699199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:18:09.699199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:18:09.699199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:18:09.699199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:18:09.699199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:18:09.699199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:18:09.699199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:18:09.699199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:18:09.699199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:18:09.699199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:18:09.699199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:18:09.699199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:18:09.699199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:18:09.700104 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:18:09.700104 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:18:09.700104 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:18:09.700104 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:18:09.700104 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 644/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:18:09.705721 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b00da-8c35-4107-adfe-58459e665988 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:09.802819 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b00da-8c35-4107-adfe-58459e665988 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:09.836075 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f0404-7901-4c91-937a-d959d21f26ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:09.836720 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f0404-7901-4c91-937a-d959d21f26ac None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:09.837005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f0404-7901-4c91-937a-d959d21f26ac None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:09.837301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f0404-7901-4c91-937a-d959d21f26ac None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:09.838017 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f0404-7901-4c91-937a-d959d21f26ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:09.838323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f0404-7901-4c91-937a-d959d21f26ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:09.839685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f0404-7901-4c91-937a-d959d21f26ac None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:09.851618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 635/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:09.857026 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1579cc-8447-4572-bf7a-d693b59bc792 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:09.892077 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:09.963816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1579cc-8447-4572-bf7a-d693b59bc792 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:09.996900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706a03d-fb13-4951-a64b-4d033f686355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:09.997716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706a03d-fb13-4951-a64b-4d033f686355 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:09.998002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706a03d-fb13-4951-a64b-4d033f686355 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:09.998277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706a03d-fb13-4951-a64b-4d033f686355 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:10.005540 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706a03d-fb13-4951-a64b-4d033f686355 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:10.006972 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706a03d-fb13-4951-a64b-4d033f686355 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:10.021783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-d706a03d-fb13-4951-a64b-4d033f686355 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:18:10.021783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:10.021783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:18:10.021783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:18:10.021783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:18:10.021783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:18:10.021783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:18:10.021783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:18:10.021783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:18:10.021783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:18:10.021783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:18:10.021783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:18:10.021783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:18:10.021783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:18:10.021783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:18:10.021783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:18:10.022881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:18:10.022881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:18:10.022881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:18:10.022881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:18:10.022881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:18:10.022881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:18:10.022881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:18:10.022881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:18:10.022881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:18:10.022881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:18:10.022881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:18:10.022881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:18:10.022881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:18:10.022881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:18:10.022881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:18:10.022881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:18:10.022881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:18:10.022881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:18:10.024219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:18:10.024219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:18:10.024219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:18:10.024219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:18:10.024219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:18:10.024219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:18:10.024219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:18:10.024219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:18:10.024219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:18:10.024219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:18:10.024219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 645/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:18:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:18:10.028620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f0404-7901-4c91-937a-d959d21f26ac None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:10.033116 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:10.125921 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f0404-7901-4c91-937a-d959d21f26ac None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:10.159568 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87bec3-c1a8-414c-a661-1213bf4aa0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:10.160163 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87bec3-c1a8-414c-a661-1213bf4aa0ad None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:10.160443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87bec3-c1a8-414c-a661-1213bf4aa0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:10.160725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87bec3-c1a8-414c-a661-1213bf4aa0ad None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:10.161585 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87bec3-c1a8-414c-a661-1213bf4aa0ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:10.161894 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87bec3-c1a8-414c-a661-1213bf4aa0ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:10.163322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87bec3-c1a8-414c-a661-1213bf4aa0ad None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:10.179947 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 636/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Jul 12 18:18:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:10.185550 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706a03d-fb13-4951-a64b-4d033f686355 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:10.272741 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:10.282114 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706a03d-fb13-4951-a64b-4d033f686355 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:10.313833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934d811-5865-4495-a44c-ea8b3476e77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:10.314452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934d811-5865-4495-a44c-ea8b3476e77b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:10.314732 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934d811-5865-4495-a44c-ea8b3476e77b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:10.315004 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934d811-5865-4495-a44c-ea8b3476e77b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:10.380966 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934d811-5865-4495-a44c-ea8b3476e77b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:10.382440 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934d811-5865-4495-a44c-ea8b3476e77b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:10.467366 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:10.478089 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 646/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Jul 12 18:18:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:18:10.483694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87bec3-c1a8-414c-a661-1213bf4aa0ad None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:10.543758 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:10.581551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87bec3-c1a8-414c-a661-1213bf4aa0ad None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:10.614811 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c81119-a9c8-490e-9e26-a4cf1bf5a147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:10.615589 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c81119-a9c8-490e-9e26-a4cf1bf5a147 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:10.615871 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c81119-a9c8-490e-9e26-a4cf1bf5a147 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:10.616147 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c81119-a9c8-490e-9e26-a4cf1bf5a147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:10.625849 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c81119-a9c8-490e-9e26-a4cf1bf5a147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:10.627280 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c81119-a9c8-490e-9e26-a4cf1bf5a147 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:10.644645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-71c81119-a9c8-490e-9e26-a4cf1bf5a147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:18:10.644645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:10.644645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:18:10.644645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:18:10.644645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:18:10.644645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:18:10.644645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:18:10.644645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:18:10.644645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:18:10.644645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:18:10.644645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:18:10.644645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:18:10.644645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:18:10.644645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:18:10.644645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:18:10.645776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:18:10.645776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:18:10.645776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:18:10.645776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:18:10.645776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:18:10.645776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:18:10.645776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:18:10.645776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:18:10.645776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:18:10.645776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:18:10.645776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:18:10.645776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:18:10.645776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:18:10.645776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:18:10.645776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:18:10.645776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:18:10.645776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:18:10.646938 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:18:10.646938 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:18:10.646938 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:18:10.646938 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:18:10.646938 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 637/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:18:10.651482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934d811-5865-4495-a44c-ea8b3476e77b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:10.748169 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934d811-5865-4495-a44c-ea8b3476e77b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:10.782452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1a3a5-852c-490d-9c1d-a97f052cfde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:10.783103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1a3a5-852c-490d-9c1d-a97f052cfde4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:10.783384 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1a3a5-852c-490d-9c1d-a97f052cfde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:10.783657 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1a3a5-852c-490d-9c1d-a97f052cfde4 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:10.784365 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1a3a5-852c-490d-9c1d-a97f052cfde4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:10.784672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1a3a5-852c-490d-9c1d-a97f052cfde4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:10.786057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1a3a5-852c-490d-9c1d-a97f052cfde4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:10.796968 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 647/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Jul 12 18:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:10.802389 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c81119-a9c8-490e-9e26-a4cf1bf5a147 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:10.898495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c81119-a9c8-490e-9e26-a4cf1bf5a147 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:10.912349 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:10.931535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76e97e-480f-46d8-b83c-ff3e6e0589b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:10.932327 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76e97e-480f-46d8-b83c-ff3e6e0589b8 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:10.932606 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76e97e-480f-46d8-b83c-ff3e6e0589b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:10.932878 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76e97e-480f-46d8-b83c-ff3e6e0589b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:10.939321 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76e97e-480f-46d8-b83c-ff3e6e0589b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:10.940742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76e97e-480f-46d8-b83c-ff3e6e0589b8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:10.954628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application [None req-2a76e97e-480f-46d8-b83c-ff3e6e0589b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:18:10.954628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:10.954628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:18:10.954628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:18:10.954628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:18:10.954628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:18:10.954628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:18:10.954628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:18:10.954628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:18:10.954628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:18:10.954628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:18:10.954628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:18:10.954628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:18:10.954628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:18:10.954628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:18:10.955610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:18:10.955610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:18:10.955610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:18:10.955610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:18:10.955610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:18:10.955610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:18:10.955610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:18:10.955610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:18:10.955610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application with Lock( Jul 12 18:18:10.955610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:18:10.955610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:18:10.955610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:18:10.955610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:18:10.955610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:18:10.955610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:18:10.955610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:18:10.955610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:18:10.956486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:18:10.956486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:18:10.956486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:18:10.956486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:18:10.956486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:18:10.956486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:18:10.956486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:18:10.956486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: ERROR keystone.server.flask.application Jul 12 18:18:10.956486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 638/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Jul 12 18:18:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:18:10.961775 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1a3a5-852c-490d-9c1d-a97f052cfde4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:11.010526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:11.059337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1a3a5-852c-490d-9c1d-a97f052cfde4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:11.092353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afd59a-06b1-467e-a954-93e4641d0aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:11.092997 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afd59a-06b1-467e-a954-93e4641d0aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:11.093301 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afd59a-06b1-467e-a954-93e4641d0aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:11.093582 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afd59a-06b1-467e-a954-93e4641d0aa1 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:11.094352 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afd59a-06b1-467e-a954-93e4641d0aa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:11.094659 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afd59a-06b1-467e-a954-93e4641d0aa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:11.096075 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afd59a-06b1-467e-a954-93e4641d0aa1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:11.107784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 648/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Jul 12 18:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:11.113617 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76e97e-480f-46d8-b83c-ff3e6e0589b8 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:11.211532 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76e97e-480f-46d8-b83c-ff3e6e0589b8 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:11.242939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f96101-6909-4951-9c98-5f844160f3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:11.243565 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f96101-6909-4951-9c98-5f844160f3ab None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:11.243848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f96101-6909-4951-9c98-5f844160f3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:11.244125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f96101-6909-4951-9c98-5f844160f3ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:11.244934 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f96101-6909-4951-9c98-5f844160f3ab None admin] RBAC: Adding query filter params (role.id=b32328bbd4d0434c8735a7edf46c81c5, scope.project.id=5fee99b2e9234f88ac79ff70429b6f20, user.id=206242c775be40c7b96af6de635e2065) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:11.245244 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f96101-6909-4951-9c98-5f844160f3ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:11.246681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f96101-6909-4951-9c98-5f844160f3ab None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:11.252790 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 639/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Jul 12 18:18:11 2022] GET /identity/v3/role_assignments?user.id=206242c775be40c7b96af6de635e2065&scope.project.id=5fee99b2e9234f88ac79ff70429b6f20&role.id=b32328bbd4d0434c8735a7edf46c81c5 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:13.259477 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7c18a-7b2c-45eb-a839-fb344d123c81 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:13.260052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7c18a-7b2c-45eb-a839-fb344d123c81 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:13.260052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7c18a-7b2c-45eb-a839-fb344d123c81 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:13.261425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 649/1288] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:18:13.266384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50278d22-1267-40c4-9c8b-c52f2c2dc312 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:13.266815 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50278d22-1267-40c4-9c8b-c52f2c2dc312 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:13.266943 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50278d22-1267-40c4-9c8b-c52f2c2dc312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:13.284443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-50278d22-1267-40c4-9c8b-c52f2c2dc312 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:18:13.285722 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-50278d22-1267-40c4-9c8b-c52f2c2dc312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:18:13.315712 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:13.362779 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 640/1289] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:18:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:18:13.387077 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7c18a-7b2c-45eb-a839-fb344d123c81 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:13.486055 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7c18a-7b2c-45eb-a839-fb344d123c81 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:13.496243 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:13.518761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a8bba-6666-4c78-ade7-f74c6a89fda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:13.519515 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a8bba-6666-4c78-ade7-f74c6a89fda9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:13.519793 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a8bba-6666-4c78-ade7-f74c6a89fda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:13.520088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a8bba-6666-4c78-ade7-f74c6a89fda9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:13.520739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a8bba-6666-4c78-ade7-f74c6a89fda9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:13.522117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a8bba-6666-4c78-ade7-f74c6a89fda9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:13.534330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-5e1a8bba-6666-4c78-ade7-f74c6a89fda9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:18:13.534330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:13.534330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:18:13.534330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:18:13.534330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:18:13.534330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:18:13.534330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:18:13.534330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:18:13.534330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:18:13.534330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:18:13.534330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:18:13.534330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:18:13.534330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:13.534330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:18:13.534330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:18:13.534330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:18:13.534330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:18:13.535601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:18:13.535601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:18:13.535601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:18:13.535601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:18:13.535601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:18:13.535601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:18:13.535601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:18:13.535601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:18:13.535601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:18:13.535601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:18:13.535601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:18:13.535601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:18:13.535601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:18:13.535601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:18:13.535601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:18:13.535601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:18:13.536573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:18:13.536573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:18:13.536573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:18:13.536573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:18:13.536573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:18:13.536573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:18:13.536573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:18:13.536573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:18:13.536573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:18:13.536573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:18:13.536573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:18:13.536573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:18:13.536573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:18:13.536573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:18:13.536573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 650/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Jul 12 18:18:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:18:13.541649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50278d22-1267-40c4-9c8b-c52f2c2dc312 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:13.641390 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50278d22-1267-40c4-9c8b-c52f2c2dc312 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:13.674524 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe760d-9f40-4767-86f9-de1f7415e6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:13.675220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe760d-9f40-4767-86f9-de1f7415e6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:13.675508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe760d-9f40-4767-86f9-de1f7415e6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:13.675788 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe760d-9f40-4767-86f9-de1f7415e6f0 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:13.676537 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe760d-9f40-4767-86f9-de1f7415e6f0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:13.676847 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe760d-9f40-4767-86f9-de1f7415e6f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:13.678323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe760d-9f40-4767-86f9-de1f7415e6f0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:13.683237 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 641/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Jul 12 18:18:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:13.689127 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a8bba-6666-4c78-ade7-f74c6a89fda9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:13.785222 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a8bba-6666-4c78-ade7-f74c6a89fda9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:13.816479 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c582e1-5e2c-4fb9-9d22-824b5027e1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:13.817111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c582e1-5e2c-4fb9-9d22-824b5027e1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:13.817421 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c582e1-5e2c-4fb9-9d22-824b5027e1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:13.817697 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c582e1-5e2c-4fb9-9d22-824b5027e1b4 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:13.818384 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c582e1-5e2c-4fb9-9d22-824b5027e1b4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:13.818686 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c582e1-5e2c-4fb9-9d22-824b5027e1b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:13.820035 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c582e1-5e2c-4fb9-9d22-824b5027e1b4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:13.824539 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 651/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Jul 12 18:18:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:15.835709 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9099f-58bc-4703-8591-ae22d3cfec27 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:15.836225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9099f-58bc-4703-8591-ae22d3cfec27 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:15.836225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9099f-58bc-4703-8591-ae22d3cfec27 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:15.837575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 642/1293] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:18:15.842641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc2213-996e-4e40-bcf6-88f5149d45c7 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:15.843058 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc2213-996e-4e40-bcf6-88f5149d45c7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:15.843197 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc2213-996e-4e40-bcf6-88f5149d45c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:15.860830 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2abc2213-996e-4e40-bcf6-88f5149d45c7 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:18:15.862035 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2abc2213-996e-4e40-bcf6-88f5149d45c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:18:15.890065 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:15.926837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 652/1294] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:18:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:18:15.949300 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9099f-58bc-4703-8591-ae22d3cfec27 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:15.981063 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:16.047969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9099f-58bc-4703-8591-ae22d3cfec27 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:16.080296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a50b33-a466-4ae4-a923-f56dcd67574e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:16.080936 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a50b33-a466-4ae4-a923-f56dcd67574e None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:16.081215 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a50b33-a466-4ae4-a923-f56dcd67574e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:16.081514 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a50b33-a466-4ae4-a923-f56dcd67574e None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:16.082216 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a50b33-a466-4ae4-a923-f56dcd67574e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:16.083568 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a50b33-a466-4ae4-a923-f56dcd67574e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:16.096360 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 643/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Jul 12 18:18:15 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:18:18.136599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c272df6-21f0-44cc-aaba-a666ef4eefb2 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:18.137170 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c272df6-21f0-44cc-aaba-a666ef4eefb2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:18.137170 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c272df6-21f0-44cc-aaba-a666ef4eefb2 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:18.138560 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 653/1296] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:18:18.144104 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207b237-9f20-4aae-b37e-40cde70ba085 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:18.144469 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207b237-9f20-4aae-b37e-40cde70ba085 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:18.144661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207b237-9f20-4aae-b37e-40cde70ba085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:18.161706 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8207b237-9f20-4aae-b37e-40cde70ba085 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:18:18.162894 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8207b237-9f20-4aae-b37e-40cde70ba085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:18:18.237666 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 644/1297] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:18:18 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:18:18.260197 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c272df6-21f0-44cc-aaba-a666ef4eefb2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:18.371344 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c272df6-21f0-44cc-aaba-a666ef4eefb2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:18.406496 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9137fb-3672-45ad-8d70-692cdaf5dfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:18.407220 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9137fb-3672-45ad-8d70-692cdaf5dfc1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:18.407499 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9137fb-3672-45ad-8d70-692cdaf5dfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:18.407769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9137fb-3672-45ad-8d70-692cdaf5dfc1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:18.408404 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9137fb-3672-45ad-8d70-692cdaf5dfc1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:18.409793 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9137fb-3672-45ad-8d70-692cdaf5dfc1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:18.421538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-2e9137fb-3672-45ad-8d70-692cdaf5dfc1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:18:18.421538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:18.421538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:18:18.421538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:18:18.421538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:18:18.421538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:18:18.421538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:18:18.421538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:18:18.421538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:18:18.421538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:18:18.421538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:18:18.421538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:18:18.421538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:18.421538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:18:18.421538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:18:18.421538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:18:18.421538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:18:18.422756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:18:18.422756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:18:18.422756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:18:18.422756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:18:18.422756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:18:18.422756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:18:18.422756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:18:18.422756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:18:18.422756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:18:18.422756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:18:18.422756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:18:18.422756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:18:18.422756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:18:18.422756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:18:18.422756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:18:18.422756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:18:18.423773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:18:18.423773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:18:18.423773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:18:18.423773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:18:18.423773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:18:18.423773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:18:18.423773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:18:18.423773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:18:18.423773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:18:18.423773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:18:18.423773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:18:18.423773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:18:18.423773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:18:18.423773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:18:18.423773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 654/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Jul 12 18:18:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:18:18.428673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207b237-9f20-4aae-b37e-40cde70ba085 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:18.446187 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:18.525570 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207b237-9f20-4aae-b37e-40cde70ba085 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:18.569031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e45af3-41fa-43c0-9303-01a2974c525f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:18.569733 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e45af3-41fa-43c0-9303-01a2974c525f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:18.570017 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e45af3-41fa-43c0-9303-01a2974c525f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:18.570297 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e45af3-41fa-43c0-9303-01a2974c525f None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:18.571034 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e45af3-41fa-43c0-9303-01a2974c525f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:18.571340 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e45af3-41fa-43c0-9303-01a2974c525f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:18.572990 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e45af3-41fa-43c0-9303-01a2974c525f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:18.578795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 645/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Jul 12 18:18:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:18.584616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9137fb-3672-45ad-8d70-692cdaf5dfc1 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:18.615904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:18.682193 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9137fb-3672-45ad-8d70-692cdaf5dfc1 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:18.714874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b1c5e-c570-4586-81ef-e7b12d8ca4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:18.715505 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b1c5e-c570-4586-81ef-e7b12d8ca4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:18.715785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b1c5e-c570-4586-81ef-e7b12d8ca4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:18.716056 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b1c5e-c570-4586-81ef-e7b12d8ca4b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:18.716827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b1c5e-c570-4586-81ef-e7b12d8ca4b5 None admin] RBAC: Adding query filter params (interface=public, service_id=441957bb34f3457488c478cb0b7ebf0c, region_id=RegionOne) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:18.717141 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b1c5e-c570-4586-81ef-e7b12d8ca4b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:18.718553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b1c5e-c570-4586-81ef-e7b12d8ca4b5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:18.723413 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 655/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Jul 12 18:18:18 2022] GET /identity/v3/endpoints?service_id=441957bb34f3457488c478cb0b7ebf0c&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:18.728936 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e45af3-41fa-43c0-9303-01a2974c525f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:18.808698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:18.827430 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e45af3-41fa-43c0-9303-01a2974c525f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:18.862444 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb530c04-e610-4870-955f-07425d154799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:18.863097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb530c04-e610-4870-955f-07425d154799 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:18.863380 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb530c04-e610-4870-955f-07425d154799 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:18.863658 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb530c04-e610-4870-955f-07425d154799 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:18.864335 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb530c04-e610-4870-955f-07425d154799 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:18.865734 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb530c04-e610-4870-955f-07425d154799 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:18.872355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 646/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Jul 12 18:18:18 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:18:20.850972 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea808d7-4872-46ea-963b-d8202011c6a9 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:20.851510 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea808d7-4872-46ea-963b-d8202011c6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:20.851510 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea808d7-4872-46ea-963b-d8202011c6a9 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:20.852846 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 656/1302] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:18:20.858021 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2d178-78e5-4fa8-964c-34e1b8d079bb None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:20.858427 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2d178-78e5-4fa8-964c-34e1b8d079bb None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:20.858571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2d178-78e5-4fa8-964c-34e1b8d079bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:20.875936 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-5aa2d178-78e5-4fa8-964c-34e1b8d079bb None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:18:20.877105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5aa2d178-78e5-4fa8-964c-34e1b8d079bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:18:20.941360 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 647/1303] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:18:20 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:18:20.964729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea808d7-4872-46ea-963b-d8202011c6a9 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:21.056344 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:21.063900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea808d7-4872-46ea-963b-d8202011c6a9 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:21.096751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b8bdd-e69d-4f50-86fa-cd3b273aad5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:21.097565 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b8bdd-e69d-4f50-86fa-cd3b273aad5e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:21.097844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b8bdd-e69d-4f50-86fa-cd3b273aad5e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:21.098115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b8bdd-e69d-4f50-86fa-cd3b273aad5e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:21.098750 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b8bdd-e69d-4f50-86fa-cd3b273aad5e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:21.100104 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b8bdd-e69d-4f50-86fa-cd3b273aad5e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:21.112244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application [None req-915b8bdd-e69d-4f50-86fa-cd3b273aad5e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:18:21.112244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:21.112244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:18:21.112244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:18:21.112244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:18:21.112244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:18:21.112244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:18:21.112244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:18:21.112244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:18:21.112244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:18:21.112244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:18:21.112244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:18:21.112244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:18:21.112244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:18:21.112244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:18:21.112244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:18:21.112244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:18:21.113210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:18:21.113210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:18:21.113210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:18:21.113210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:18:21.113210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:18:21.113210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:18:21.113210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:18:21.113210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:18:21.113210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:18:21.113210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:18:21.113210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:18:21.113210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:18:21.113210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:18:21.113210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:18:21.113210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:18:21.113210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:18:21.114386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:18:21.114386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application with Lock( Jul 12 18:18:21.114386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:18:21.114386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:18:21.114386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:18:21.114386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:18:21.114386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:18:21.114386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:18:21.114386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:18:21.114386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:18:21.114386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:18:21.114386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:18:21.114386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:18:21.114386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: ERROR keystone.server.flask.application Jul 12 18:18:21.114386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 657/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Jul 12 18:18:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:18:21.119371 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2d178-78e5-4fa8-964c-34e1b8d079bb None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:21.192505 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:21.214887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2d178-78e5-4fa8-964c-34e1b8d079bb None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:21.248557 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b58057-3344-4428-9d3c-5f2520a1c099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:21.249214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b58057-3344-4428-9d3c-5f2520a1c099 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:21.250180 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b58057-3344-4428-9d3c-5f2520a1c099 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:21.250454 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b58057-3344-4428-9d3c-5f2520a1c099 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:21.251152 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b58057-3344-4428-9d3c-5f2520a1c099 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:18:21.251457 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b58057-3344-4428-9d3c-5f2520a1c099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:21.252829 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b58057-3344-4428-9d3c-5f2520a1c099 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:21.257852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 648/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Jul 12 18:18:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:18:21.263705 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b8bdd-e69d-4f50-86fa-cd3b273aad5e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:18:21.364544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b8bdd-e69d-4f50-86fa-cd3b273aad5e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:18:21.398903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1f66d-025e-498e-afe9-424be4c8c419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:18:21.399555 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1f66d-025e-498e-afe9-424be4c8c419 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:21.399838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1f66d-025e-498e-afe9-424be4c8c419 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:21.400112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1f66d-025e-498e-afe9-424be4c8c419 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:21.400835 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1f66d-025e-498e-afe9-424be4c8c419 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:18:21.402226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1f66d-025e-498e-afe9-424be4c8c419 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:18:21.419802 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 658/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Jul 12 18:18:21 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:18:31.254853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=30 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:31.415706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:23.574298 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96540d-aa71-444e-84a8-d87286833935 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:23.575137 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96540d-aa71-444e-84a8-d87286833935 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:23.575613 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96540d-aa71-444e-84a8-d87286833935 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:23.581555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 649/1307] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:19:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:23.583555 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8722b9e-800b-41a2-98e2-710c8d94fdd5 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:23.584010 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8722b9e-800b-41a2-98e2-710c8d94fdd5 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:23.584423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8722b9e-800b-41a2-98e2-710c8d94fdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:23.722361 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-f8722b9e-800b-41a2-98e2-710c8d94fdd5 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:23.723501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f8722b9e-800b-41a2-98e2-710c8d94fdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:23.941281 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 659/1308] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:24.019057 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d417a79-1e19-45e7-a171-f7805feee1c7 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:24.019343 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d417a79-1e19-45e7-a171-f7805feee1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:24.019584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d417a79-1e19-45e7-a171-f7805feee1c7 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:24.020994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 650/1309] 10.222.0.57 () {54 vars in 964 bytes} [Tue Jul 12 18:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:24.061794 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a437d3-5fff-418f-8244-7fa143b95481 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:24.063473 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a437d3-5fff-418f-8244-7fa143b95481 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:24.064791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a437d3-5fff-418f-8244-7fa143b95481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:24.204724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-46a437d3-5fff-418f-8244-7fa143b95481 None None] MFA Rules not processed for user `b6dc63ae259842209831040cbf45d316`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:24.208204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-46a437d3-5fff-418f-8244-7fa143b95481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:24.269039 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:24.431612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d417a79-1e19-45e7-a171-f7805feee1c7 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:24.433996 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2d417a79-1e19-45e7-a171-f7805feee1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:24.453636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 660/1310] 10.222.0.57 () {58 vars in 1061 bytes} [Tue Jul 12 18:19:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:24.609751 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d417a79-1e19-45e7-a171-f7805feee1c7 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:24.703418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215c91e-cc26-4c8b-b9ff-99ae3d965e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:24.704073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215c91e-cc26-4c8b-b9ff-99ae3d965e67 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:24.704361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215c91e-cc26-4c8b-b9ff-99ae3d965e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:24.704635 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215c91e-cc26-4c8b-b9ff-99ae3d965e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:24.706657 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5215c91e-cc26-4c8b-b9ff-99ae3d965e67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:24.768910 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:24.837860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215c91e-cc26-4c8b-b9ff-99ae3d965e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:24.839621 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215c91e-cc26-4c8b-b9ff-99ae3d965e67 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:24.863708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 651/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:19:27.218536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703eac7-bdc6-4c9d-8f44-37b60abc02d5 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:27.219080 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703eac7-bdc6-4c9d-8f44-37b60abc02d5 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:27.219080 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703eac7-bdc6-4c9d-8f44-37b60abc02d5 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:27.220481 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 661/1312] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:27.226008 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7f84d-e04e-4cdd-8173-aa95915c0618 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:27.226484 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7f84d-e04e-4cdd-8173-aa95915c0618 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:27.226576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7f84d-e04e-4cdd-8173-aa95915c0618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:27.300890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ebf7f84d-e04e-4cdd-8173-aa95915c0618 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:27.302122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ebf7f84d-e04e-4cdd-8173-aa95915c0618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:27.395484 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 652/1313] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:27.446715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d750b-3eb2-4fdf-9d70-37f251f783f4 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:27.447030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d750b-3eb2-4fdf-9d70-37f251f783f4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:27.447316 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d750b-3eb2-4fdf-9d70-37f251f783f4 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:27.448693 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 662/1314] 10.222.0.57 () {54 vars in 964 bytes} [Tue Jul 12 18:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:27.455449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d5127-c7e1-42b9-91f4-264a09b84bc4 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:27.455738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d5127-c7e1-42b9-91f4-264a09b84bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:27.456010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d5127-c7e1-42b9-91f4-264a09b84bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:27.466495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:27.531232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-876d5127-c7e1-42b9-91f4-264a09b84bc4 None None] MFA Rules not processed for user `b6dc63ae259842209831040cbf45d316`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:27.532504 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-876d5127-c7e1-42b9-91f4-264a09b84bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:27.612820 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 653/1315] 10.222.0.57 () {58 vars in 1061 bytes} [Tue Jul 12 18:19:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:19:27.621863 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d750b-3eb2-4fdf-9d70-37f251f783f4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:27.623888 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-066d750b-3eb2-4fdf-9d70-37f251f783f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:27.727830 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d750b-3eb2-4fdf-9d70-37f251f783f4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:27.798016 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:27.800723 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29827a-9b49-4263-808d-ea25dd64de6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:27.801488 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29827a-9b49-4263-808d-ea25dd64de6d service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:27.801943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29827a-9b49-4263-808d-ea25dd64de6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:27.802479 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29827a-9b49-4263-808d-ea25dd64de6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:27.804317 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7a29827a-9b49-4263-808d-ea25dd64de6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:27.913360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29827a-9b49-4263-808d-ea25dd64de6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:27.914781 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29827a-9b49-4263-808d-ea25dd64de6d service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:27.933051 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 663/1316] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:19:30.487982 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e1d28-68e0-41f7-b868-658acd62f8e3 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:30.488546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e1d28-68e0-41f7-b868-658acd62f8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:30.488546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e1d28-68e0-41f7-b868-658acd62f8e3 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:30.489947 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 654/1317] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:30.495145 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cc03a-655e-4dec-b914-83fe2134851c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:30.495516 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cc03a-655e-4dec-b914-83fe2134851c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:30.495707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cc03a-655e-4dec-b914-83fe2134851c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:30.558492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a54cc03a-655e-4dec-b914-83fe2134851c None None] MFA Rules not processed for user `d8b17c78161f4eebba3a526db806cf9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:30.559730 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a54cc03a-655e-4dec-b914-83fe2134851c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:30.610814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:30.657654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 664/1318] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:19:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:30.697899 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e1d28-68e0-41f7-b868-658acd62f8e3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:30.699436 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-978e1d28-68e0-41f7-b868-658acd62f8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:30.809741 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e1d28-68e0-41f7-b868-658acd62f8e3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:30.812452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:30.881503 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd973df-1a44-4dbb-8ebd-17f78d01b6ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:30.882134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd973df-1a44-4dbb-8ebd-17f78d01b6ed service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:30.882409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd973df-1a44-4dbb-8ebd-17f78d01b6ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:30.882683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd973df-1a44-4dbb-8ebd-17f78d01b6ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:30.884299 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1fd973df-1a44-4dbb-8ebd-17f78d01b6ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:30.993656 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd973df-1a44-4dbb-8ebd-17f78d01b6ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:30.995128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd973df-1a44-4dbb-8ebd-17f78d01b6ed service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:31.012588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 655/1319] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:19:33.570923 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb53e4-9e82-4d0c-aa6f-ad4e658a9700 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:33.571387 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb53e4-9e82-4d0c-aa6f-ad4e658a9700 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:33.571483 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb53e4-9e82-4d0c-aa6f-ad4e658a9700 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:33.572865 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 665/1320] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:33.578774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1639286-f4a8-4f89-b32b-0e02a141d561 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:33.579186 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1639286-f4a8-4f89-b32b-0e02a141d561 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:33.579331 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1639286-f4a8-4f89-b32b-0e02a141d561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:33.617225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:33.642827 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d1639286-f4a8-4f89-b32b-0e02a141d561 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:33.644020 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d1639286-f4a8-4f89-b32b-0e02a141d561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:33.738190 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 656/1321] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:19:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:33.776362 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb53e4-9e82-4d0c-aa6f-ad4e658a9700 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:33.778034 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-04bb53e4-9e82-4d0c-aa6f-ad4e658a9700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:33.878929 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb53e4-9e82-4d0c-aa6f-ad4e658a9700 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:33.949671 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a5317-20ba-47a3-956b-0ad20494585b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:33.950306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a5317-20ba-47a3-956b-0ad20494585b service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:33.951107 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a5317-20ba-47a3-956b-0ad20494585b service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:33.951390 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a5317-20ba-47a3-956b-0ad20494585b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:33.953012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-362a5317-20ba-47a3-956b-0ad20494585b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:33.960327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:34.060311 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a5317-20ba-47a3-956b-0ad20494585b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:34.061703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a5317-20ba-47a3-956b-0ad20494585b service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:34.081488 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 666/1322] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:19:36.763689 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6109263-5c24-48a4-b1ea-2ed9d20ba3fd None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:36.764266 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6109263-5c24-48a4-b1ea-2ed9d20ba3fd None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:36.764266 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6109263-5c24-48a4-b1ea-2ed9d20ba3fd None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:36.765768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 657/1323] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:36.770721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c0000-ecb4-47ac-8afe-14d4af6bde63 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:36.771111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c0000-ecb4-47ac-8afe-14d4af6bde63 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:36.771279 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c0000-ecb4-47ac-8afe-14d4af6bde63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:36.836272 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4d6c0000-ecb4-47ac-8afe-14d4af6bde63 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:36.837412 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4d6c0000-ecb4-47ac-8afe-14d4af6bde63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:36.893934 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:36.941928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 667/1324] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:36.979637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6109263-5c24-48a4-b1ea-2ed9d20ba3fd None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:36.981188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b6109263-5c24-48a4-b1ea-2ed9d20ba3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:37.094411 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6109263-5c24-48a4-b1ea-2ed9d20ba3fd None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:37.106776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:37.168526 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248a240-85e3-44d9-ab7d-75bd3e90a6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:37.169213 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248a240-85e3-44d9-ab7d-75bd3e90a6ae service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:37.169487 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248a240-85e3-44d9-ab7d-75bd3e90a6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:37.169767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248a240-85e3-44d9-ab7d-75bd3e90a6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:37.171425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6248a240-85e3-44d9-ab7d-75bd3e90a6ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:37.280660 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248a240-85e3-44d9-ab7d-75bd3e90a6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:37.282129 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248a240-85e3-44d9-ab7d-75bd3e90a6ae service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:37.300425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 658/1325] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:19:39.367470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeefdfe-815c-4e64-8f63-62fafbf9bc6f None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:39.368056 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeefdfe-815c-4e64-8f63-62fafbf9bc6f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:39.368056 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeefdfe-815c-4e64-8f63-62fafbf9bc6f None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:39.369408 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 668/1326] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:39.375424 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b6ee5-39b5-4a87-99c7-5b31351fabec None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:39.375850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b6ee5-39b5-4a87-99c7-5b31351fabec None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:39.375954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b6ee5-39b5-4a87-99c7-5b31351fabec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:39.423902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:39.443551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ca4b6ee5-39b5-4a87-99c7-5b31351fabec None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:39.444761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ca4b6ee5-39b5-4a87-99c7-5b31351fabec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:39.542659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 659/1327] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:39.578046 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeefdfe-815c-4e64-8f63-62fafbf9bc6f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:39.579578 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-beeefdfe-815c-4e64-8f63-62fafbf9bc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:39.683859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeefdfe-815c-4e64-8f63-62fafbf9bc6f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:39.759974 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed44142-d073-4a07-851b-8bc0697499bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:39.760623 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed44142-d073-4a07-851b-8bc0697499bc service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:39.760903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed44142-d073-4a07-851b-8bc0697499bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:39.761177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed44142-d073-4a07-851b-8bc0697499bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:39.762844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bed44142-d073-4a07-851b-8bc0697499bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:39.780075 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:39.880344 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed44142-d073-4a07-851b-8bc0697499bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:39.881829 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed44142-d073-4a07-851b-8bc0697499bc service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:39.900366 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 669/1328] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:19:41.998426 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb96d-e2e3-40fc-afdc-ac23690e283e None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:41.998970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb96d-e2e3-40fc-afdc-ac23690e283e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:41.998970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb96d-e2e3-40fc-afdc-ac23690e283e None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:42.000497 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 660/1329] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:42.005458 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbaa16-7176-48ed-9f6e-ac263d04503d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:42.005908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbaa16-7176-48ed-9f6e-ac263d04503d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:42.006089 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbaa16-7176-48ed-9f6e-ac263d04503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:42.071478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-42fbaa16-7176-48ed-9f6e-ac263d04503d None None] MFA Rules not processed for user `d8b17c78161f4eebba3a526db806cf9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:42.072688 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-42fbaa16-7176-48ed-9f6e-ac263d04503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:42.138651 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:42.173855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 670/1330] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:19:42 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:42.211360 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbb96d-e2e3-40fc-afdc-ac23690e283e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:42.212983 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-07bbb96d-e2e3-40fc-afdc-ac23690e283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:42.319495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbb96d-e2e3-40fc-afdc-ac23690e283e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:42.339369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:42.393303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d0c14-0910-4061-b91a-8d25ea827e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:42.393866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d0c14-0910-4061-b91a-8d25ea827e1d service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:42.394147 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d0c14-0910-4061-b91a-8d25ea827e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:42.394421 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d0c14-0910-4061-b91a-8d25ea827e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:42.396064 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-305d0c14-0910-4061-b91a-8d25ea827e1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:42.506530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d0c14-0910-4061-b91a-8d25ea827e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:42.507970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d0c14-0910-4061-b91a-8d25ea827e1d service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:42.527576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 661/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:42 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:19:44.834751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b489d9-a744-452b-8d02-ca6ea06845a1 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:44.835309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b489d9-a744-452b-8d02-ca6ea06845a1 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:44.835309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b489d9-a744-452b-8d02-ca6ea06845a1 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:44.836621 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 671/1332] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:44.841739 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddceb58-5c73-4787-8709-04fc2f2c4fcf None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:44.842203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddceb58-5c73-4787-8709-04fc2f2c4fcf None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:44.842305 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddceb58-5c73-4787-8709-04fc2f2c4fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:44.903472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:44.906432 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1ddceb58-5c73-4787-8709-04fc2f2c4fcf None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:44.908273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1ddceb58-5c73-4787-8709-04fc2f2c4fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:45.002854 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 662/1333] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:45.038761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b489d9-a744-452b-8d02-ca6ea06845a1 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:45.040289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f4b489d9-a744-452b-8d02-ca6ea06845a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:45.142755 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b489d9-a744-452b-8d02-ca6ea06845a1 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:45.214623 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b10bf-79f9-4688-8d3f-74c5aa614958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:45.215268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b10bf-79f9-4688-8d3f-74c5aa614958 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:45.215553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b10bf-79f9-4688-8d3f-74c5aa614958 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:45.215833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b10bf-79f9-4688-8d3f-74c5aa614958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:45.217529 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7a2b10bf-79f9-4688-8d3f-74c5aa614958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:45.245055 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:45.325842 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b10bf-79f9-4688-8d3f-74c5aa614958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:45.327276 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b10bf-79f9-4688-8d3f-74c5aa614958 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:45.345358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 672/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:19:47.404881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fc736-9c36-4cc3-b16f-f9f0a1dba646 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:47.405475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fc736-9c36-4cc3-b16f-f9f0a1dba646 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:47.405475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fc736-9c36-4cc3-b16f-f9f0a1dba646 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:47.406895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 663/1335] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:47.412021 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26485e-be85-4893-95e6-0612ae78e426 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:47.412436 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26485e-be85-4893-95e6-0612ae78e426 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:47.412571 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26485e-be85-4893-95e6-0612ae78e426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:47.477416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ab26485e-be85-4893-95e6-0612ae78e426 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:47.478622 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ab26485e-be85-4893-95e6-0612ae78e426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:47.552609 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:47.576458 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 673/1336] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:47.615869 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fc736-9c36-4cc3-b16f-f9f0a1dba646 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:47.617483 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5c2fc736-9c36-4cc3-b16f-f9f0a1dba646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:47.720361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fc736-9c36-4cc3-b16f-f9f0a1dba646 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:47.748341 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:47.792365 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967af15e-4446-4984-baf5-a5968f9cb25b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:47.793004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967af15e-4446-4984-baf5-a5968f9cb25b service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:47.793314 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967af15e-4446-4984-baf5-a5968f9cb25b service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:47.793594 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967af15e-4446-4984-baf5-a5968f9cb25b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:47.795800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-967af15e-4446-4984-baf5-a5968f9cb25b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:47.901350 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967af15e-4446-4984-baf5-a5968f9cb25b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:47.902788 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967af15e-4446-4984-baf5-a5968f9cb25b service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:47.921480 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 664/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:19:50.226861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06329b6d-c9aa-4b43-add4-70f40d3ef28d None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:50.227439 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06329b6d-c9aa-4b43-add4-70f40d3ef28d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:50.227439 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06329b6d-c9aa-4b43-add4-70f40d3ef28d None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:50.228795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 674/1338] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:50.234034 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabbc62-9a4b-4046-92d3-558fee9f3d7f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:50.234473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabbc62-9a4b-4046-92d3-558fee9f3d7f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:50.234576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabbc62-9a4b-4046-92d3-558fee9f3d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:50.298975 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6aabbc62-9a4b-4046-92d3-558fee9f3d7f None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:50.300164 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6aabbc62-9a4b-4046-92d3-558fee9f3d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:50.308446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:50.396418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 665/1339] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:19:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:19:50.432566 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06329b6d-c9aa-4b43-add4-70f40d3ef28d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:50.434148 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-06329b6d-c9aa-4b43-add4-70f40d3ef28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:50.535863 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06329b6d-c9aa-4b43-add4-70f40d3ef28d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:50.610424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef2118-5a82-4ea0-a4b2-da85b20fca11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:50.611100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef2118-5a82-4ea0-a4b2-da85b20fca11 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:50.611381 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef2118-5a82-4ea0-a4b2-da85b20fca11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:50.611682 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef2118-5a82-4ea0-a4b2-da85b20fca11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:50.613393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-51ef2118-5a82-4ea0-a4b2-da85b20fca11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:50.649118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:50.723027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef2118-5a82-4ea0-a4b2-da85b20fca11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:50.724463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef2118-5a82-4ea0-a4b2-da85b20fca11 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:50.743194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 675/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:19:55.031009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b8cea-837a-4e09-9d14-c38fabcf365c None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:55.031526 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b8cea-837a-4e09-9d14-c38fabcf365c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:55.031526 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b8cea-837a-4e09-9d14-c38fabcf365c None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:55.032839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 666/1341] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:55.038135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29524642-9d88-475b-bae6-e06f697d6647 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:55.038576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29524642-9d88-475b-bae6-e06f697d6647 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:55.038694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29524642-9d88-475b-bae6-e06f697d6647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:55.104325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-29524642-9d88-475b-bae6-e06f697d6647 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:55.105586 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-29524642-9d88-475b-bae6-e06f697d6647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:55.195012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:55.209455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 676/1342] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:55.247898 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b8cea-837a-4e09-9d14-c38fabcf365c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:55.249523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-350b8cea-837a-4e09-9d14-c38fabcf365c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:55.356572 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b8cea-837a-4e09-9d14-c38fabcf365c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:55.395209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:55.431485 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955cc42-d0a8-46f4-a414-01e54f1166ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:55.432219 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955cc42-d0a8-46f4-a414-01e54f1166ef service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:55.432408 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955cc42-d0a8-46f4-a414-01e54f1166ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:55.432678 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955cc42-d0a8-46f4-a414-01e54f1166ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:55.434857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f955cc42-d0a8-46f4-a414-01e54f1166ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:55.541886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955cc42-d0a8-46f4-a414-01e54f1166ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:55.543382 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955cc42-d0a8-46f4-a414-01e54f1166ef service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:55.563117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 667/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:19:58.234304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880d51d-4d17-4528-bd8e-486e1f6db03d None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:58.234875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880d51d-4d17-4528-bd8e-486e1f6db03d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:58.234875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880d51d-4d17-4528-bd8e-486e1f6db03d None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:58.236262 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 677/1344] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:58.242061 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8fd98-7d4f-460d-8e6b-9c8ff3613235 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:58.242638 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8fd98-7d4f-460d-8e6b-9c8ff3613235 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:58.242638 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8fd98-7d4f-460d-8e6b-9c8ff3613235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:58.314069 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e5a8fd98-7d4f-460d-8e6b-9c8ff3613235 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:58.315284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e5a8fd98-7d4f-460d-8e6b-9c8ff3613235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:58.336038 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:58.420258 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 668/1345] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:19:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:58.457931 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880d51d-4d17-4528-bd8e-486e1f6db03d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:58.459490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a880d51d-4d17-4528-bd8e-486e1f6db03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:58.566242 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880d51d-4d17-4528-bd8e-486e1f6db03d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:58.643473 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0713184-9a5b-4f40-831c-6d3dd8636874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:58.644125 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0713184-9a5b-4f40-831c-6d3dd8636874 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:58.644406 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0713184-9a5b-4f40-831c-6d3dd8636874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:58.644677 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0713184-9a5b-4f40-831c-6d3dd8636874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:58.646343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f0713184-9a5b-4f40-831c-6d3dd8636874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:58.689493 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:58.755508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0713184-9a5b-4f40-831c-6d3dd8636874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:58.756944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0713184-9a5b-4f40-831c-6d3dd8636874 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:58.775195 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 678/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:20:02.994691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3797ff-cd07-47f6-b765-a8f8ad6fd8e8 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:02.995820 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3797ff-cd07-47f6-b765-a8f8ad6fd8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:02.995820 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3797ff-cd07-47f6-b765-a8f8ad6fd8e8 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:02.997033 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 669/1347] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:03.002483 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f791d6-46e7-4ed1-8a17-19c69cdf1e9c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:03.002927 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f791d6-46e7-4ed1-8a17-19c69cdf1e9c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:03.003021 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f791d6-46e7-4ed1-8a17-19c69cdf1e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:03.077080 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-02f791d6-46e7-4ed1-8a17-19c69cdf1e9c None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:03.078592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-02f791d6-46e7-4ed1-8a17-19c69cdf1e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:03.181868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:03.184736 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 679/1348] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:20:03.222455 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3797ff-cd07-47f6-b765-a8f8ad6fd8e8 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:20:03.224008 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9a3797ff-cd07-47f6-b765-a8f8ad6fd8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:03.334764 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3797ff-cd07-47f6-b765-a8f8ad6fd8e8 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:20:03.384545 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:03.413411 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8546c-7d7b-4233-8d8e-0bc7dd653f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:20:03.414057 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8546c-7d7b-4233-8d8e-0bc7dd653f9e service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:03.414337 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8546c-7d7b-4233-8d8e-0bc7dd653f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:03.414608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8546c-7d7b-4233-8d8e-0bc7dd653f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:03.416256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-55e8546c-7d7b-4233-8d8e-0bc7dd653f9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:03.528599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8546c-7d7b-4233-8d8e-0bc7dd653f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:20:03.530086 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8546c-7d7b-4233-8d8e-0bc7dd653f9e service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:20:03.549201 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 670/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:20:08.437377 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0437c-24ac-4510-bf34-f9fe7548c672 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:08.438211 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0437c-24ac-4510-bf34-f9fe7548c672 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:08.438710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0437c-24ac-4510-bf34-f9fe7548c672 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:08.440574 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 680/1350] 10.222.0.57 () {54 vars in 921 bytes} [Tue Jul 12 18:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:08.452075 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34954012-27d4-4d46-96ec-76508f5413da None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:08.452075 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34954012-27d4-4d46-96ec-76508f5413da None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:08.452075 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34954012-27d4-4d46-96ec-76508f5413da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:08.577645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-34954012-27d4-4d46-96ec-76508f5413da None None] MFA Rules not processed for user `206242c775be40c7b96af6de635e2065`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:08.579534 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-34954012-27d4-4d46-96ec-76508f5413da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:08.604896 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:08.704135 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 671/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Jul 12 18:20:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:12.733587 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7414a19-1002-4d41-ab4b-81cd41932c1c None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:12.734120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7414a19-1002-4d41-ab4b-81cd41932c1c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:12.734120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7414a19-1002-4d41-ab4b-81cd41932c1c None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:12.735675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 681/1352] 10.222.0.57 () {54 vars in 921 bytes} [Tue Jul 12 18:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:12.740497 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562e1af-41a8-4dbd-b5cf-21ee5368ab1f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:12.740916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562e1af-41a8-4dbd-b5cf-21ee5368ab1f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:12.741170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562e1af-41a8-4dbd-b5cf-21ee5368ab1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:12.818534 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f562e1af-41a8-4dbd-b5cf-21ee5368ab1f None None] MFA Rules not processed for user `206242c775be40c7b96af6de635e2065`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:12.819649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f562e1af-41a8-4dbd-b5cf-21ee5368ab1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:12.893706 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:12.932112 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 672/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Jul 12 18:20:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:14.340428 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e1329-d294-4a9e-9db8-30608ee18acb None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:14.340956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e1329-d294-4a9e-9db8-30608ee18acb None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:14.341075 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e1329-d294-4a9e-9db8-30608ee18acb None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:14.342385 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 682/1354] 10.222.0.57 () {54 vars in 921 bytes} [Tue Jul 12 18:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:14.347343 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4860a-822c-4768-aeb9-515c2fd5ec58 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:14.347765 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4860a-822c-4768-aeb9-515c2fd5ec58 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:14.347951 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4860a-822c-4768-aeb9-515c2fd5ec58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:14.422791 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e9a4860a-822c-4768-aeb9-515c2fd5ec58 None None] MFA Rules not processed for user `206242c775be40c7b96af6de635e2065`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:14.423975 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e9a4860a-822c-4768-aeb9-515c2fd5ec58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:14.527600 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 673/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Jul 12 18:20:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:20:17.943938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb07ab7-d93d-46c8-b910-1fb2e437a8f0 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:17.944500 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb07ab7-d93d-46c8-b910-1fb2e437a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:17.944500 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb07ab7-d93d-46c8-b910-1fb2e437a8f0 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:17.948708 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 683/1356] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:20:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:17.953844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9792a8d-51cf-48d7-85c9-6c85390e0dcc None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:17.954313 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9792a8d-51cf-48d7-85c9-6c85390e0dcc None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:17.954409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9792a8d-51cf-48d7-85c9-6c85390e0dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:18.004456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:18.045700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e9792a8d-51cf-48d7-85c9-6c85390e0dcc None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:18.047341 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e9792a8d-51cf-48d7-85c9-6c85390e0dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:18.164216 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 674/1357] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:18.219440 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb76a2-87ed-46c2-bfb1-847676e49cc4 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:18.219727 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb76a2-87ed-46c2-bfb1-847676e49cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:18.220004 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb76a2-87ed-46c2-bfb1-847676e49cc4 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:18.221374 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 684/1358] 10.222.0.57 () {54 vars in 961 bytes} [Tue Jul 12 18:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:18.229755 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9386550-c49b-4ecf-b4fa-9364a2700d2b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:18.230180 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9386550-c49b-4ecf-b4fa-9364a2700d2b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:18.230562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9386550-c49b-4ecf-b4fa-9364a2700d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:18.313208 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b9386550-c49b-4ecf-b4fa-9364a2700d2b None None] MFA Rules not processed for user `a7c1bb51c2b642ffa4708122d826fc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:18.314430 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b9386550-c49b-4ecf-b4fa-9364a2700d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:18.366506 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:18.442140 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 675/1359] 10.222.0.57 () {58 vars in 1058 bytes} [Tue Jul 12 18:20:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:18.450915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb76a2-87ed-46c2-bfb1-847676e49cc4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:20:18.452708 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-60cb76a2-87ed-46c2-bfb1-847676e49cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:18.621608 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb76a2-87ed-46c2-bfb1-847676e49cc4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:20:18.700070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:18.751689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014b92e-ceac-4943-82aa-228586677d8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:20:18.752331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014b92e-ceac-4943-82aa-228586677d8a service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:18.752612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014b92e-ceac-4943-82aa-228586677d8a service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:18.752885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014b92e-ceac-4943-82aa-228586677d8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:18.754559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7014b92e-ceac-4943-82aa-228586677d8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:18.853212 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014b92e-ceac-4943-82aa-228586677d8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:20:18.855544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014b92e-ceac-4943-82aa-228586677d8a service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:20:18.876102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 685/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:20:21.120254 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee35117-65cd-4409-917f-1e11f9f4fcea None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:21.120812 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee35117-65cd-4409-917f-1e11f9f4fcea None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:21.120895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee35117-65cd-4409-917f-1e11f9f4fcea None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:21.122507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 676/1361] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:21.127937 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ef8bd-c897-45ac-bba1-13d01d9edf99 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:21.128438 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ef8bd-c897-45ac-bba1-13d01d9edf99 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:21.128544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ef8bd-c897-45ac-bba1-13d01d9edf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:21.196684 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-277ef8bd-c897-45ac-bba1-13d01d9edf99 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:21.197827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-277ef8bd-c897-45ac-bba1-13d01d9edf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:21.237792 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:21.302374 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 686/1362] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:21.349203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee35117-65cd-4409-917f-1e11f9f4fcea None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:20:21.350759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7ee35117-65cd-4409-917f-1e11f9f4fcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:21.523171 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee35117-65cd-4409-917f-1e11f9f4fcea None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:20:21.533764 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:21.680599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cfef8-7944-4dba-841a-5e63d068409b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:20:21.681381 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cfef8-7944-4dba-841a-5e63d068409b service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:21.681731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cfef8-7944-4dba-841a-5e63d068409b service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:21.682069 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cfef8-7944-4dba-841a-5e63d068409b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:21.684335 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-be5cfef8-7944-4dba-841a-5e63d068409b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:21.780657 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cfef8-7944-4dba-841a-5e63d068409b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:20:21.782290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cfef8-7944-4dba-841a-5e63d068409b service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:20:21.800898 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 677/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:20:24.188285 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5abfe-c459-4c09-adc1-5c787a8b29dc None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:24.188858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5abfe-c459-4c09-adc1-5c787a8b29dc None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:24.188858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5abfe-c459-4c09-adc1-5c787a8b29dc None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:24.190296 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 687/1364] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:24.196215 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16078810-beff-4d09-8619-43f65ca342f5 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:24.196693 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16078810-beff-4d09-8619-43f65ca342f5 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:24.196776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16078810-beff-4d09-8619-43f65ca342f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:24.213483 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:24.273128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-16078810-beff-4d09-8619-43f65ca342f5 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:24.274548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-16078810-beff-4d09-8619-43f65ca342f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:24.384324 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 678/1365] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:24.430143 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b81fde-8456-4760-bcda-62820cfd35c0 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:24.430431 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b81fde-8456-4760-bcda-62820cfd35c0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:24.430708 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b81fde-8456-4760-bcda-62820cfd35c0 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:24.432053 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 688/1366] 10.222.0.57 () {54 vars in 961 bytes} [Tue Jul 12 18:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:24.437730 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f6923-fa86-405b-9f9d-3f0a82523db9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:24.438022 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f6923-fa86-405b-9f9d-3f0a82523db9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:24.438354 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f6923-fa86-405b-9f9d-3f0a82523db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:24.518059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-709f6923-fa86-405b-9f9d-3f0a82523db9 None None] MFA Rules not processed for user `a7c1bb51c2b642ffa4708122d826fc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:24.519253 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-709f6923-fa86-405b-9f9d-3f0a82523db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:24.555337 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:24.655453 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 679/1367] 10.222.0.57 () {58 vars in 1058 bytes} [Tue Jul 12 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:24.663053 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b81fde-8456-4760-bcda-62820cfd35c0 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:20:24.664581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-21b81fde-8456-4760-bcda-62820cfd35c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:24.824527 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b81fde-8456-4760-bcda-62820cfd35c0 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:20:24.846559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:24.944019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94dc7b-d1f4-4abb-8c71-670ddeb3638a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:20:24.945048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94dc7b-d1f4-4abb-8c71-670ddeb3638a service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:24.945358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94dc7b-d1f4-4abb-8c71-670ddeb3638a service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:24.945638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94dc7b-d1f4-4abb-8c71-670ddeb3638a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:24.947260 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5f94dc7b-d1f4-4abb-8c71-670ddeb3638a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:25.042993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94dc7b-d1f4-4abb-8c71-670ddeb3638a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:20:25.044516 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94dc7b-d1f4-4abb-8c71-670ddeb3638a service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:20:25.063206 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 689/1368] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:20:26.088537 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375dab2-0b88-43d7-9ca6-0a273eadaa00 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:26.089595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375dab2-0b88-43d7-9ca6-0a273eadaa00 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:26.089686 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375dab2-0b88-43d7-9ca6-0a273eadaa00 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:26.091178 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 680/1369] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:20:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:26.096085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a200e5-ead5-47e7-8d4d-0ef3bc32337e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:26.096485 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a200e5-ead5-47e7-8d4d-0ef3bc32337e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:26.096666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a200e5-ead5-47e7-8d4d-0ef3bc32337e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:26.129133 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:26.167623 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c9a200e5-ead5-47e7-8d4d-0ef3bc32337e None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:26.168843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c9a200e5-ead5-47e7-8d4d-0ef3bc32337e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:26.274314 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 690/1370] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:26.626984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de7a59-4e60-4b0a-b7a0-b3e746c16e31 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:26.627277 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de7a59-4e60-4b0a-b7a0-b3e746c16e31 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:26.627559 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de7a59-4e60-4b0a-b7a0-b3e746c16e31 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:26.629285 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 681/1371] 10.222.0.57 () {54 vars in 963 bytes} [Tue Jul 12 18:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:26.634196 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efacd0-55bc-43d9-b555-4ae0066d700f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:26.634490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efacd0-55bc-43d9-b555-4ae0066d700f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:26.634774 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efacd0-55bc-43d9-b555-4ae0066d700f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:26.723935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b6efacd0-55bc-43d9-b555-4ae0066d700f None None] MFA Rules not processed for user `faf61fd1e2ab426bbbbcc8dc7d552942`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:26.725186 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b6efacd0-55bc-43d9-b555-4ae0066d700f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:26.780698 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:26.817496 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 691/1372] 10.222.0.57 () {58 vars in 1060 bytes} [Tue Jul 12 18:20:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:26.826316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de7a59-4e60-4b0a-b7a0-b3e746c16e31 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:20:26.828268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-94de7a59-4e60-4b0a-b7a0-b3e746c16e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:26.949555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de7a59-4e60-4b0a-b7a0-b3e746c16e31 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:20:26.994077 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:27.030723 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8b4e2-4d2f-4afa-acbb-f5a22eb672de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:20:27.031373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8b4e2-4d2f-4afa-acbb-f5a22eb672de service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:27.031652 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8b4e2-4d2f-4afa-acbb-f5a22eb672de service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:27.031926 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8b4e2-4d2f-4afa-acbb-f5a22eb672de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:27.033604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-49d8b4e2-4d2f-4afa-acbb-f5a22eb672de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:27.147811 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8b4e2-4d2f-4afa-acbb-f5a22eb672de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:20:27.149813 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8b4e2-4d2f-4afa-acbb-f5a22eb672de service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:20:27.169549 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 682/1373] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:20:27.194981 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b99e77-8789-4e55-bdc6-83eb5dbc2a1f None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:27.195448 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b99e77-8789-4e55-bdc6-83eb5dbc2a1f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:27.195627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b99e77-8789-4e55-bdc6-83eb5dbc2a1f None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:27.196867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 692/1374] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:27.201913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc2ac9-7112-4e7a-9e34-b392fa92804b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:27.202205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc2ac9-7112-4e7a-9e34-b392fa92804b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:27.202479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc2ac9-7112-4e7a-9e34-b392fa92804b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:27.273076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-83cc2ac9-7112-4e7a-9e34-b392fa92804b None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:27.274807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-83cc2ac9-7112-4e7a-9e34-b392fa92804b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:27.299193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:27.389762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 683/1375] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:27.427824 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b99e77-8789-4e55-bdc6-83eb5dbc2a1f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:20:27.429161 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f4b99e77-8789-4e55-bdc6-83eb5dbc2a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:27.597060 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b99e77-8789-4e55-bdc6-83eb5dbc2a1f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:20:27.646703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:27.709912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8106b62-ac39-4dbb-9b68-0ddb6506086f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:20:27.710557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8106b62-ac39-4dbb-9b68-0ddb6506086f service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:27.710841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8106b62-ac39-4dbb-9b68-0ddb6506086f service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:27.711116 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8106b62-ac39-4dbb-9b68-0ddb6506086f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:27.712763 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f8106b62-ac39-4dbb-9b68-0ddb6506086f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:27.803511 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8106b62-ac39-4dbb-9b68-0ddb6506086f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:20:27.805121 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8106b62-ac39-4dbb-9b68-0ddb6506086f service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:20:27.824022 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 693/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:20:29.896962 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1421ae-8f4f-4050-b7de-028c8a24e8e8 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:29.897521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1421ae-8f4f-4050-b7de-028c8a24e8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:29.897613 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1421ae-8f4f-4050-b7de-028c8a24e8e8 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:29.898928 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 684/1377] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:29.904019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2baae-cf4e-47c8-a711-350e05b79015 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:29.904419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2baae-cf4e-47c8-a711-350e05b79015 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:29.904577 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2baae-cf4e-47c8-a711-350e05b79015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:29.975078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-97d2baae-cf4e-47c8-a711-350e05b79015 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:29.976341 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-97d2baae-cf4e-47c8-a711-350e05b79015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:29.983993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:30.081549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 694/1378] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:30.126117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1421ae-8f4f-4050-b7de-028c8a24e8e8 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:20:30.127690 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9a1421ae-8f4f-4050-b7de-028c8a24e8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:30.287738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1421ae-8f4f-4050-b7de-028c8a24e8e8 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:20:30.291246 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:30.405809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e6b93-9d2b-4a51-81e8-b882d8c7b1ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:20:30.408277 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e6b93-9d2b-4a51-81e8-b882d8c7b1ba service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:30.408558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e6b93-9d2b-4a51-81e8-b882d8c7b1ba service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:30.408831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e6b93-9d2b-4a51-81e8-b882d8c7b1ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:30.410507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-219e6b93-9d2b-4a51-81e8-b882d8c7b1ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:30.508758 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e6b93-9d2b-4a51-81e8-b882d8c7b1ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:20:30.511848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e6b93-9d2b-4a51-81e8-b882d8c7b1ba service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:20:30.534674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 685/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:20:32.628309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03543d47-b8ac-46fa-91df-a3e4403d4d7b None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:32.628816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03543d47-b8ac-46fa-91df-a3e4403d4d7b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:32.628899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03543d47-b8ac-46fa-91df-a3e4403d4d7b None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:32.630421 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 695/1380] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:32.636061 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a72bc-abae-41e4-92f1-1f37ec24ee18 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:32.636475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a72bc-abae-41e4-92f1-1f37ec24ee18 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:32.636649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a72bc-abae-41e4-92f1-1f37ec24ee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:32.646889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:32.709115 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-240a72bc-abae-41e4-92f1-1f37ec24ee18 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:32.710629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-240a72bc-abae-41e4-92f1-1f37ec24ee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:32.819302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 686/1381] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:32.863729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03543d47-b8ac-46fa-91df-a3e4403d4d7b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:20:32.865498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-03543d47-b8ac-46fa-91df-a3e4403d4d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:33.012305 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:33.024589 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03543d47-b8ac-46fa-91df-a3e4403d4d7b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:20:33.153293 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb51f2-e741-423a-a6b9-777c0a73739c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:20:33.153943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb51f2-e741-423a-a6b9-777c0a73739c service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:33.154230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb51f2-e741-423a-a6b9-777c0a73739c service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:33.154509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb51f2-e741-423a-a6b9-777c0a73739c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:33.156167 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-24fb51f2-e741-423a-a6b9-777c0a73739c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:33.256212 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb51f2-e741-423a-a6b9-777c0a73739c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:20:33.257968 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb51f2-e741-423a-a6b9-777c0a73739c service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:20:33.269452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:33.281640 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 696/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:20:35.358483 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec55842-d643-4848-a857-abde20dc0946 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:35.359020 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec55842-d643-4848-a857-abde20dc0946 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:35.359020 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec55842-d643-4848-a857-abde20dc0946 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:35.360392 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 687/1383] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:35.367380 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd78fc0-586c-4b39-b79d-5f0bb390105d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:35.367789 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd78fc0-586c-4b39-b79d-5f0bb390105d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:35.368082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd78fc0-586c-4b39-b79d-5f0bb390105d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:35.435715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-3bd78fc0-586c-4b39-b79d-5f0bb390105d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:35.436929 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3bd78fc0-586c-4b39-b79d-5f0bb390105d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:35.548074 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 697/1384] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:35.590824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec55842-d643-4848-a857-abde20dc0946 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:20:35.592655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-cec55842-d643-4848-a857-abde20dc0946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:35.681411 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:35.752080 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec55842-d643-4848-a857-abde20dc0946 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:20:35.872080 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a245ac-b155-4aba-86ab-0f5544e84ad0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:20:35.872737 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a245ac-b155-4aba-86ab-0f5544e84ad0 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:35.873018 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a245ac-b155-4aba-86ab-0f5544e84ad0 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:35.873350 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a245ac-b155-4aba-86ab-0f5544e84ad0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:35.875013 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c0a245ac-b155-4aba-86ab-0f5544e84ad0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:35.937780 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:35.983309 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a245ac-b155-4aba-86ab-0f5544e84ad0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:20:35.984931 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a245ac-b155-4aba-86ab-0f5544e84ad0 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:20:36.003867 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 688/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:20:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:20:38.029200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5428b-a421-4f4c-800b-2cb3cef079b8 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:38.029767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5428b-a421-4f4c-800b-2cb3cef079b8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:38.029767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5428b-a421-4f4c-800b-2cb3cef079b8 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:38.031154 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 698/1386] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:38.036617 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3445e48-4511-4645-bc19-a725bb346af1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:38.037276 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3445e48-4511-4645-bc19-a725bb346af1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:38.037578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3445e48-4511-4645-bc19-a725bb346af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:38.117996 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f3445e48-4511-4645-bc19-a725bb346af1 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:38.120713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f3445e48-4511-4645-bc19-a725bb346af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:38.231072 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 689/1387] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:38.274693 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5428b-a421-4f4c-800b-2cb3cef079b8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:20:38.276305 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7dc5428b-a421-4f4c-800b-2cb3cef079b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:38.363593 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:38.445329 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5428b-a421-4f4c-800b-2cb3cef079b8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:20:38.573072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eaaa6f-01f1-4bca-9e79-780e5ba3f8b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:20:38.573988 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eaaa6f-01f1-4bca-9e79-780e5ba3f8b4 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:38.574352 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eaaa6f-01f1-4bca-9e79-780e5ba3f8b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:38.575153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eaaa6f-01f1-4bca-9e79-780e5ba3f8b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:38.577570 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-54eaaa6f-01f1-4bca-9e79-780e5ba3f8b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:38.617974 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:38.673168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eaaa6f-01f1-4bca-9e79-780e5ba3f8b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:20:38.674873 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eaaa6f-01f1-4bca-9e79-780e5ba3f8b4 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:20:38.694411 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 699/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:20:41.040585 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14860d46-1f2b-407c-bd6d-b160f794e59b None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:41.041197 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14860d46-1f2b-407c-bd6d-b160f794e59b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:41.041197 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14860d46-1f2b-407c-bd6d-b160f794e59b None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:41.043313 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 690/1389] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:20:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:41.048643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d5f0f-64ae-4f65-b2c0-3f8c21ebff99 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:41.049374 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d5f0f-64ae-4f65-b2c0-3f8c21ebff99 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:41.049664 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d5f0f-64ae-4f65-b2c0-3f8c21ebff99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:41.116574 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b93d5f0f-64ae-4f65-b2c0-3f8c21ebff99 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:41.117845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b93d5f0f-64ae-4f65-b2c0-3f8c21ebff99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:41.219266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 700/1390] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:41.265279 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14860d46-1f2b-407c-bd6d-b160f794e59b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:20:41.266261 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-14860d46-1f2b-407c-bd6d-b160f794e59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:41.300405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:41.423038 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14860d46-1f2b-407c-bd6d-b160f794e59b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:20:41.529373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:41.542657 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df5194-2fee-4abd-a6bd-72d462594ef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:20:41.543319 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df5194-2fee-4abd-a6bd-72d462594ef0 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:41.543605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df5194-2fee-4abd-a6bd-72d462594ef0 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:41.543881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df5194-2fee-4abd-a6bd-72d462594ef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:41.545596 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-32df5194-2fee-4abd-a6bd-72d462594ef0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:41.639156 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df5194-2fee-4abd-a6bd-72d462594ef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:20:41.640751 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df5194-2fee-4abd-a6bd-72d462594ef0 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:20:41.658336 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 691/1391] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:20:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:20:42.470495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724a85e-bea8-46be-8c4d-ba7d21c855dd None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:42.471149 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724a85e-bea8-46be-8c4d-ba7d21c855dd None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:42.471149 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724a85e-bea8-46be-8c4d-ba7d21c855dd None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:42.472507 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 701/1392] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:42.477992 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a70d01-076d-4261-8f0d-1362d3407c76 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:42.478385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a70d01-076d-4261-8f0d-1362d3407c76 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:42.478556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a70d01-076d-4261-8f0d-1362d3407c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:42.542148 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d8a70d01-076d-4261-8f0d-1362d3407c76 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:42.543380 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d8a70d01-076d-4261-8f0d-1362d3407c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:42.608513 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:42.648499 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 692/1393] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:42.705763 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b99ef5-7d82-4ef1-aa4e-5d2dbeff0716 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:42.706049 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b99ef5-7d82-4ef1-aa4e-5d2dbeff0716 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:42.706327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b99ef5-7d82-4ef1-aa4e-5d2dbeff0716 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:42.707812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 702/1394] 10.222.0.57 () {54 vars in 962 bytes} [Tue Jul 12 18:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:42.712904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306bd46-980a-4d83-8a2f-27925370924c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:42.713233 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306bd46-980a-4d83-8a2f-27925370924c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:42.713676 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306bd46-980a-4d83-8a2f-27925370924c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:42.790871 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-5306bd46-980a-4d83-8a2f-27925370924c None None] MFA Rules not processed for user `5602d0a51329412ab6e908e7787531a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:42.792031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5306bd46-980a-4d83-8a2f-27925370924c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:42.869401 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 693/1395] 10.222.0.57 () {58 vars in 1059 bytes} [Tue Jul 12 18:20:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:42.877816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b99ef5-7d82-4ef1-aa4e-5d2dbeff0716 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:20:42.879322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e3b99ef5-7d82-4ef1-aa4e-5d2dbeff0716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:42.893031 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:42.984596 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b99ef5-7d82-4ef1-aa4e-5d2dbeff0716 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:20:43.056069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb09d0b-2d2d-47f6-8bfb-d3e3c74b75fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5602d0a51329412ab6e908e7787531a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:20:43.056649 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb09d0b-2d2d-47f6-8bfb-d3e3c74b75fa service glance] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:43.057012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb09d0b-2d2d-47f6-8bfb-d3e3c74b75fa service glance] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:43.057772 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb09d0b-2d2d-47f6-8bfb-d3e3c74b75fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:43.059405 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-dfb09d0b-2d2d-47f6-8bfb-d3e3c74b75fa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:43.125634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:43.167428 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb09d0b-2d2d-47f6-8bfb-d3e3c74b75fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:20:43.168868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb09d0b-2d2d-47f6-8bfb-d3e3c74b75fa service glance] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:20:43.187748 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 703/1396] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:20:43.713069 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f71504-1795-453b-990f-98033be58aa6 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:43.714181 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f71504-1795-453b-990f-98033be58aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:43.714181 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f71504-1795-453b-990f-98033be58aa6 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:43.715543 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 694/1397] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:20:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:43.720601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788b955-5778-44cd-972a-222ff4304ef5 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:43.722222 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788b955-5778-44cd-972a-222ff4304ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:43.722523 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788b955-5778-44cd-972a-222ff4304ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:43.797086 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-9788b955-5778-44cd-972a-222ff4304ef5 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:43.798394 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9788b955-5778-44cd-972a-222ff4304ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:43.897064 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aed224-d665-4736-8be3-2b298e85ab43 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:43.897433 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aed224-d665-4736-8be3-2b298e85ab43 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:43.897870 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aed224-d665-4736-8be3-2b298e85ab43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:43.902493 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 704/1398] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:43.946487 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788b955-5778-44cd-972a-222ff4304ef5 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:20:43.948257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9788b955-5778-44cd-972a-222ff4304ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:43.967212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-89aed224-d665-4736-8be3-2b298e85ab43 None None] MFA Rules not processed for user `54189575a60a4d9dbaabb78d44e9c31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:43.968409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-89aed224-d665-4736-8be3-2b298e85ab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:43.975304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:43.977282 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:44.055635 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 695/1399] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Jul 12 18:20:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:20:44.070513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788b955-5778-44cd-972a-222ff4304ef5 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:20:44.100644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591a27a-0662-4206-9653-3f9bc7c98cba None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:44.100964 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591a27a-0662-4206-9653-3f9bc7c98cba None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:44.101271 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591a27a-0662-4206-9653-3f9bc7c98cba None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:44.102666 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 696/1400] 10.222.0.57 () {54 vars in 942 bytes} [Tue Jul 12 18:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:20:44.108759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bc617-e516-413e-85ad-cad2986af4d3 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:44.109121 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bc617-e516-413e-85ad-cad2986af4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:44.109354 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bc617-e516-413e-85ad-cad2986af4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:44.184544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ad6bc617-e516-413e-85ad-cad2986af4d3 None None] MFA Rules not processed for user `ade969d7aa3d49c08782a68ec5997382`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:44.185721 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ad6bc617-e516-413e-85ad-cad2986af4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:44.187840 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84765ebf-5afe-4701-bd80-6c54091b779d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:20:44.188743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84765ebf-5afe-4701-bd80-6c54091b779d service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:44.188743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84765ebf-5afe-4701-bd80-6c54091b779d service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:44.189023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84765ebf-5afe-4701-bd80-6c54091b779d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:44.190785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-84765ebf-5afe-4701-bd80-6c54091b779d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:44.210660 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:44.280996 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:44.285704 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84765ebf-5afe-4701-bd80-6c54091b779d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:20:44.287339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84765ebf-5afe-4701-bd80-6c54091b779d service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:20:44.303388 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 697/1401] 10.222.0.57 () {58 vars in 1039 bytes} [Tue Jul 12 18:20:44 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:20:44.305769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 705/1402] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:20:44.313391 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bc617-e516-413e-85ad-cad2986af4d3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:20:44.324535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bc617-e516-413e-85ad-cad2986af4d3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:20:44.443530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4b4e0-0d76-435b-87c8-f69516e0c356 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ade969d7aa3d49c08782a68ec5997382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:20:44.444091 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4b4e0-0d76-435b-87c8-f69516e0c356 service swift] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:44.444371 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4b4e0-0d76-435b-87c8-f69516e0c356 service swift] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:44.444897 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4b4e0-0d76-435b-87c8-f69516e0c356 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:44.446694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a6d4b4e0-0d76-435b-87c8-f69516e0c356 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:44.536085 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4b4e0-0d76-435b-87c8-f69516e0c356 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:20:44.537785 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4b4e0-0d76-435b-87c8-f69516e0c356 service swift] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:20:44.546549 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 698/1403] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Jul 12 18:20:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 18:20:46.393468 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9189fd-d139-4d9b-8cf3-f089b0a3e718 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:46.394027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9189fd-d139-4d9b-8cf3-f089b0a3e718 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:46.394027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9189fd-d139-4d9b-8cf3-f089b0a3e718 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:46.395433 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 706/1404] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:46.400580 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd53c5-46db-4f8d-8209-96633b83dbf4 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:46.400999 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd53c5-46db-4f8d-8209-96633b83dbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:46.401179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd53c5-46db-4f8d-8209-96633b83dbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:46.411476 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:46.472838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1fbd53c5-46db-4f8d-8209-96633b83dbf4 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:46.474921 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1fbd53c5-46db-4f8d-8209-96633b83dbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:46.583433 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 699/1405] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:46.628583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9189fd-d139-4d9b-8cf3-f089b0a3e718 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:20:46.630156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8c9189fd-d139-4d9b-8cf3-f089b0a3e718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:46.783400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:46.786052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9189fd-d139-4d9b-8cf3-f089b0a3e718 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:20:46.914235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f33781-4466-47e2-a816-cc0903ab16dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:20:46.914974 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f33781-4466-47e2-a816-cc0903ab16dd service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:46.915288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f33781-4466-47e2-a816-cc0903ab16dd service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:46.915567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f33781-4466-47e2-a816-cc0903ab16dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:46.917860 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-35f33781-4466-47e2-a816-cc0903ab16dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:47.021859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f33781-4466-47e2-a816-cc0903ab16dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:20:47.023914 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f33781-4466-47e2-a816-cc0903ab16dd service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:20:47.044700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 707/1406] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:20:49.122039 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d27b4-ea0f-4071-80ce-4fc2a056197a None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:49.122600 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d27b4-ea0f-4071-80ce-4fc2a056197a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:49.122600 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d27b4-ea0f-4071-80ce-4fc2a056197a None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:49.123922 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 700/1407] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:20:49.129016 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9ba93-1597-47f4-ad41-e1ab1986ceb2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:49.129468 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9ba93-1597-47f4-ad41-e1ab1986ceb2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:49.129782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9ba93-1597-47f4-ad41-e1ab1986ceb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:49.133158 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:49.204336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6ba9ba93-1597-47f4-ad41-e1ab1986ceb2 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:20:49.205714 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6ba9ba93-1597-47f4-ad41-e1ab1986ceb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:49.318654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 708/1408] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:20:49.358614 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d27b4-ea0f-4071-80ce-4fc2a056197a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:20:49.360138 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-aa1d27b4-ea0f-4071-80ce-4fc2a056197a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:49.454662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:49.524001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d27b4-ea0f-4071-80ce-4fc2a056197a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:20:49.658216 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1ee70-56d3-4833-8343-83d5859e5e5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:20:49.659865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1ee70-56d3-4833-8343-83d5859e5e5d service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:20:49.660355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1ee70-56d3-4833-8343-83d5859e5e5d service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:20:49.661053 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1ee70-56d3-4833-8343-83d5859e5e5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:20:49.662948 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-94f1ee70-56d3-4833-8343-83d5859e5e5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:20:49.773967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:49.828962 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1ee70-56d3-4833-8343-83d5859e5e5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:20:49.830635 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1ee70-56d3-4833-8343-83d5859e5e5d service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:20:49.853179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 701/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:20:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:20:59.312072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=64 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:20:59.849806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=23 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:06.486925 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ff1fb-f494-46f2-baa2-a82bbd6b7a89 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:06.487501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ff1fb-f494-46f2-baa2-a82bbd6b7a89 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:06.487501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ff1fb-f494-46f2-baa2-a82bbd6b7a89 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:06.488847 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 709/1410] 10.222.0.57 () {54 vars in 918 bytes} [Tue Jul 12 18:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:06.493864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db3b38-0e51-4615-a82d-d1bdb0ac08a8 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:06.494251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db3b38-0e51-4615-a82d-d1bdb0ac08a8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:06.494427 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db3b38-0e51-4615-a82d-d1bdb0ac08a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:06.569911 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d3db3b38-0e51-4615-a82d-d1bdb0ac08a8 None None] MFA Rules not processed for user `206242c775be40c7b96af6de635e2065`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:06.571388 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d3db3b38-0e51-4615-a82d-d1bdb0ac08a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:06.676538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 702/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Tue Jul 12 18:21:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:06.691541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dbf10-405a-4321-a561-4742e1c609ac None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:06.691825 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dbf10-405a-4321-a561-4742e1c609ac None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:06.692098 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dbf10-405a-4321-a561-4742e1c609ac None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:06.693517 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 710/1412] 10.222.0.57 () {54 vars in 918 bytes} [Tue Jul 12 18:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:06.698884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93291d29-d4f2-4119-ba33-2a3bd664e33c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:06.699174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93291d29-d4f2-4119-ba33-2a3bd664e33c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:06.699452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93291d29-d4f2-4119-ba33-2a3bd664e33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:06.770077 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:06.772714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-93291d29-d4f2-4119-ba33-2a3bd664e33c None None] MFA Rules not processed for user `a7c1bb51c2b642ffa4708122d826fc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:06.774591 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-93291d29-d4f2-4119-ba33-2a3bd664e33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:06.889118 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 703/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Tue Jul 12 18:21:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:09.444854 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89731246-be7a-46bf-a24b-8d920584412f None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:09.445440 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89731246-be7a-46bf-a24b-8d920584412f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:09.445981 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89731246-be7a-46bf-a24b-8d920584412f None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:09.447649 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:21:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:09.452941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaa7ba-b987-4ca8-9200-8243ded485bc None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:09.453375 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaa7ba-b987-4ca8-9200-8243ded485bc None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:09.453564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaa7ba-b987-4ca8-9200-8243ded485bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:09.518360 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9ccaa7ba-b987-4ca8-9200-8243ded485bc None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:09.519572 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9ccaa7ba-b987-4ca8-9200-8243ded485bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:09.576809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:09.620779 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:09.663137 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89731246-be7a-46bf-a24b-8d920584412f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:09.664714 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-89731246-be7a-46bf-a24b-8d920584412f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:09.813028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89731246-be7a-46bf-a24b-8d920584412f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:09.884563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:09.927979 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d7490-8aaa-418c-8b9a-f2384f482906 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:09.928662 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d7490-8aaa-418c-8b9a-f2384f482906 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:09.928948 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d7490-8aaa-418c-8b9a-f2384f482906 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:09.929228 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d7490-8aaa-418c-8b9a-f2384f482906 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:09.930961 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-255d7490-8aaa-418c-8b9a-f2384f482906 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:10.019833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d7490-8aaa-418c-8b9a-f2384f482906 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:10.021477 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d7490-8aaa-418c-8b9a-f2384f482906 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:10.040185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 712/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:10.943442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad94113-f635-4062-bda5-fa467e79faab None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:10.944038 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad94113-f635-4062-bda5-fa467e79faab None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:10.944038 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad94113-f635-4062-bda5-fa467e79faab None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:10.945367 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:10.950503 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacfb3e-2927-4fba-beb3-4a704a335f23 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:10.950920 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacfb3e-2927-4fba-beb3-4a704a335f23 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:10.951069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacfb3e-2927-4fba-beb3-4a704a335f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:11.026448 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1dacfb3e-2927-4fba-beb3-4a704a335f23 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:11.027663 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1dacfb3e-2927-4fba-beb3-4a704a335f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:11.054323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:11.123925 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:21:11.274851 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad94113-f635-4062-bda5-fa467e79faab None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:11.276852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9ad94113-f635-4062-bda5-fa467e79faab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:11.420733 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad94113-f635-4062-bda5-fa467e79faab None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:11.459852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:11.531789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5ceab-e0af-4184-9729-54af84bcfc79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:11.532363 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5ceab-e0af-4184-9729-54af84bcfc79 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:11.532647 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5ceab-e0af-4184-9729-54af84bcfc79 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:11.532920 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5ceab-e0af-4184-9729-54af84bcfc79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:11.534593 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-48d5ceab-e0af-4184-9729-54af84bcfc79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:11.622712 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5ceab-e0af-4184-9729-54af84bcfc79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:11.624320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5ceab-e0af-4184-9729-54af84bcfc79 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:11.642656 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 706/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:12.514370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346715c-a2d2-4514-b703-5f8ad9b11ca0 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:12.514908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346715c-a2d2-4514-b703-5f8ad9b11ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:12.514908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346715c-a2d2-4514-b703-5f8ad9b11ca0 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:12.516269 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:12.521052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8808c5b-86b7-431b-8d65-dddeabcf536c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:12.521473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8808c5b-86b7-431b-8d65-dddeabcf536c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:12.521649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8808c5b-86b7-431b-8d65-dddeabcf536c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:12.574479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:12.596069 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a8808c5b-86b7-431b-8d65-dddeabcf536c None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:12.597298 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a8808c5b-86b7-431b-8d65-dddeabcf536c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:12.692842 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:12.842825 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346715c-a2d2-4514-b703-5f8ad9b11ca0 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:12.844271 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d346715c-a2d2-4514-b703-5f8ad9b11ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:12.987391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346715c-a2d2-4514-b703-5f8ad9b11ca0 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:13.000127 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:13.099429 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd40dc5-68ee-4765-b6de-37491aea279d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:13.100000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd40dc5-68ee-4765-b6de-37491aea279d service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:13.100285 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd40dc5-68ee-4765-b6de-37491aea279d service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:13.100559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd40dc5-68ee-4765-b6de-37491aea279d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:13.102246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0dd40dc5-68ee-4765-b6de-37491aea279d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:13.189740 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd40dc5-68ee-4765-b6de-37491aea279d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:13.191340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd40dc5-68ee-4765-b6de-37491aea279d service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:13.209384 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 715/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:21:14.056648 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332f9e4-401f-4017-87f4-9459d6921bec None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:14.057695 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332f9e4-401f-4017-87f4-9459d6921bec None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:14.057796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332f9e4-401f-4017-87f4-9459d6921bec None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:14.059164 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:21:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:14.064054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4fe09-4e5c-4c52-9767-626b625c340d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:14.064480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4fe09-4e5c-4c52-9767-626b625c340d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:14.064783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4fe09-4e5c-4c52-9767-626b625c340d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:14.083941 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:14.140965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-98f4fe09-4e5c-4c52-9767-626b625c340d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:14.142250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-98f4fe09-4e5c-4c52-9767-626b625c340d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:14.241869 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:14.391262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332f9e4-401f-4017-87f4-9459d6921bec None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:14.392858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a332f9e4-401f-4017-87f4-9459d6921bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:14.501050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:14.536216 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332f9e4-401f-4017-87f4-9459d6921bec None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:14.647556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafdee2-9fe9-4da4-9b60-16b12efa1057 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:14.648132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafdee2-9fe9-4da4-9b60-16b12efa1057 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:14.648416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafdee2-9fe9-4da4-9b60-16b12efa1057 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:14.648691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafdee2-9fe9-4da4-9b60-16b12efa1057 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:14.650382 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9bafdee2-9fe9-4da4-9b60-16b12efa1057 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:14.724974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:14.738994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafdee2-9fe9-4da4-9b60-16b12efa1057 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:14.740593 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafdee2-9fe9-4da4-9b60-16b12efa1057 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:14.758510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 709/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:15.609221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983a200-bf00-4387-9789-d7ec9bb8deaa None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:15.609700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983a200-bf00-4387-9789-d7ec9bb8deaa None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:15.609803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983a200-bf00-4387-9789-d7ec9bb8deaa None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:15.611164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:15.616114 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab4bc6-6c0f-48fb-bc44-93a9c016e08a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:15.616520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab4bc6-6c0f-48fb-bc44-93a9c016e08a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:15.616682 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab4bc6-6c0f-48fb-bc44-93a9c016e08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:15.690776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-11ab4bc6-6c0f-48fb-bc44-93a9c016e08a None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:15.691974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-11ab4bc6-6c0f-48fb-bc44-93a9c016e08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:15.786150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:21:15.935877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983a200-bf00-4387-9789-d7ec9bb8deaa None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:15.937434 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4983a200-bf00-4387-9789-d7ec9bb8deaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:16.029523 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:16.091726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983a200-bf00-4387-9789-d7ec9bb8deaa None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:16.203192 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2405d15-5303-41e1-9476-f32e65c29dfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:16.203770 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2405d15-5303-41e1-9476-f32e65c29dfc service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:16.204056 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2405d15-5303-41e1-9476-f32e65c29dfc service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:16.204334 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2405d15-5303-41e1-9476-f32e65c29dfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:16.206018 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a2405d15-5303-41e1-9476-f32e65c29dfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:16.253380 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:16.294583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2405d15-5303-41e1-9476-f32e65c29dfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:16.296185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2405d15-5303-41e1-9476-f32e65c29dfc service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:16.314463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 718/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:17.114861 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9bf5d-8350-423c-bf26-a49bc76b66e9 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:17.115418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9bf5d-8350-423c-bf26-a49bc76b66e9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:17.115418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9bf5d-8350-423c-bf26-a49bc76b66e9 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:17.116796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:17.122164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9821eca-7d67-41c5-a7e9-f2a573b9665a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:17.122607 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9821eca-7d67-41c5-a7e9-f2a573b9665a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:17.122707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9821eca-7d67-41c5-a7e9-f2a573b9665a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:17.197678 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d9821eca-7d67-41c5-a7e9-f2a573b9665a None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:17.199444 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d9821eca-7d67-41c5-a7e9-f2a573b9665a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:17.293085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:17.441802 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9bf5d-8350-423c-bf26-a49bc76b66e9 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:17.443351 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2ef9bf5d-8350-423c-bf26-a49bc76b66e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:17.491351 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:17.587548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9bf5d-8350-423c-bf26-a49bc76b66e9 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:17.698958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca9aae-5cff-463c-816b-4a4da7173a14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:17.699520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca9aae-5cff-463c-816b-4a4da7173a14 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:17.699799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca9aae-5cff-463c-816b-4a4da7173a14 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:17.700069 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca9aae-5cff-463c-816b-4a4da7173a14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:17.701726 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-79ca9aae-5cff-463c-816b-4a4da7173a14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:17.708430 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:17.788460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca9aae-5cff-463c-816b-4a4da7173a14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:17.790147 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca9aae-5cff-463c-816b-4a4da7173a14 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:17.808065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 712/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:18.605066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8b631-884c-45b8-be17-2a1832eb24a7 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:18.605574 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8b631-884c-45b8-be17-2a1832eb24a7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:18.605673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8b631-884c-45b8-be17-2a1832eb24a7 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:18.607061 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:18.611901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb5d99-d17a-4a94-b157-d0fc28e79e33 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:18.612312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb5d99-d17a-4a94-b157-d0fc28e79e33 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:18.612450 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb5d99-d17a-4a94-b157-d0fc28e79e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:18.685969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-bafb5d99-d17a-4a94-b157-d0fc28e79e33 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:18.687176 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-bafb5d99-d17a-4a94-b157-d0fc28e79e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:18.754083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:18.784042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:18.933624 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8b631-884c-45b8-be17-2a1832eb24a7 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:18.935162 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7df8b631-884c-45b8-be17-2a1832eb24a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:18.953624 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:19.081805 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8b631-884c-45b8-be17-2a1832eb24a7 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:19.167897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:19.194041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9922b-34ad-454e-ba4f-d0cd67c3e218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:19.194684 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9922b-34ad-454e-ba4f-d0cd67c3e218 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:19.194965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9922b-34ad-454e-ba4f-d0cd67c3e218 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:19.195246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9922b-34ad-454e-ba4f-d0cd67c3e218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:19.197136 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2dc9922b-34ad-454e-ba4f-d0cd67c3e218 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:19.284933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9922b-34ad-454e-ba4f-d0cd67c3e218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:19.286570 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9922b-34ad-454e-ba4f-d0cd67c3e218 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:19.304548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 721/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:20.106544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08e7f9-c20f-41b5-a7a8-58314c45027e None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:20.107122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08e7f9-c20f-41b5-a7a8-58314c45027e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:20.107122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08e7f9-c20f-41b5-a7a8-58314c45027e None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:20.108472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:21:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:20.113312 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17472cb-9277-4479-8778-d4775791b53c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:20.113723 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17472cb-9277-4479-8778-d4775791b53c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:20.113867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17472cb-9277-4479-8778-d4775791b53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:20.188205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a17472cb-9277-4479-8778-d4775791b53c None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:20.190161 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a17472cb-9277-4479-8778-d4775791b53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:20.232195 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:20.286614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:20.437462 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08e7f9-c20f-41b5-a7a8-58314c45027e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:20.439004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ed08e7f9-c20f-41b5-a7a8-58314c45027e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:20.582796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08e7f9-c20f-41b5-a7a8-58314c45027e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:20.639756 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:20.698487 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd3099-006e-4394-a9af-0653f11fbe70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:20.699060 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd3099-006e-4394-a9af-0653f11fbe70 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:20.699340 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd3099-006e-4394-a9af-0653f11fbe70 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:20.699609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd3099-006e-4394-a9af-0653f11fbe70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:20.701227 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-dafd3099-006e-4394-a9af-0653f11fbe70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:20.788985 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd3099-006e-4394-a9af-0653f11fbe70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:20.790638 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd3099-006e-4394-a9af-0653f11fbe70 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:20.809531 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 715/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:21.610507 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198398e-531a-4579-b9c3-9978a5cd335d None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:21.610958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198398e-531a-4579-b9c3-9978a5cd335d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:21.611056 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198398e-531a-4579-b9c3-9978a5cd335d None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:21.612439 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:21.617335 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c668fda-50f1-46de-985a-8bd57ea175d7 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:21.617767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c668fda-50f1-46de-985a-8bd57ea175d7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:21.617878 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c668fda-50f1-46de-985a-8bd57ea175d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:21.692000 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1c668fda-50f1-46de-985a-8bd57ea175d7 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:21.693201 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1c668fda-50f1-46de-985a-8bd57ea175d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:21.695208 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:21.789497 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:21.938850 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198398e-531a-4579-b9c3-9978a5cd335d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:21.940469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7198398e-531a-4579-b9c3-9978a5cd335d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:22.094046 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198398e-531a-4579-b9c3-9978a5cd335d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:22.121113 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:22.207585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0613d82-7ff4-4449-af26-e7022ffce3d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:22.208173 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0613d82-7ff4-4449-af26-e7022ffce3d3 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:22.208443 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0613d82-7ff4-4449-af26-e7022ffce3d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:22.208719 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0613d82-7ff4-4449-af26-e7022ffce3d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:22.210411 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d0613d82-7ff4-4449-af26-e7022ffce3d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:22.299424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0613d82-7ff4-4449-af26-e7022ffce3d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:22.301035 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0613d82-7ff4-4449-af26-e7022ffce3d3 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:22.320714 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 724/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:24.237669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f16aa-b237-4eba-bbe5-c4f36a074358 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:24.238071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f16aa-b237-4eba-bbe5-c4f36a074358 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:24.238228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f16aa-b237-4eba-bbe5-c4f36a074358 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:24.239669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:24.245704 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6d5ce-0579-46e5-8524-f59119c11e64 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:24.246153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6d5ce-0579-46e5-8524-f59119c11e64 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:24.246272 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6d5ce-0579-46e5-8524-f59119c11e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:24.285516 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:24.311491 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1aa6d5ce-0579-46e5-8524-f59119c11e64 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:24.312696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1aa6d5ce-0579-46e5-8524-f59119c11e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:24.410583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:24.449596 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f16aa-b237-4eba-bbe5-c4f36a074358 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:24.451254 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2c1f16aa-b237-4eba-bbe5-c4f36a074358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:24.553396 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f16aa-b237-4eba-bbe5-c4f36a074358 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:24.586810 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:24.628097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21294ea7-564e-4955-8b31-95f35de25f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:24.628741 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21294ea7-564e-4955-8b31-95f35de25f36 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:24.629026 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21294ea7-564e-4955-8b31-95f35de25f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:24.629327 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21294ea7-564e-4955-8b31-95f35de25f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:24.630969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-21294ea7-564e-4955-8b31-95f35de25f36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:24.738557 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21294ea7-564e-4955-8b31-95f35de25f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:24.739921 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21294ea7-564e-4955-8b31-95f35de25f36 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:24.758037 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 718/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:26.927253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad6490-af5d-4cd2-9b0f-810918dc86ec None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:26.927897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad6490-af5d-4cd2-9b0f-810918dc86ec None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:26.927897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad6490-af5d-4cd2-9b0f-810918dc86ec None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:26.929248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:26.934939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cc93a-cce4-4e06-b402-3b4c271dbdee None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:26.935394 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cc93a-cce4-4e06-b402-3b4c271dbdee None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:26.935499 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cc93a-cce4-4e06-b402-3b4c271dbdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:27.000003 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-235cc93a-cce4-4e06-b402-3b4c271dbdee None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:27.001199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-235cc93a-cce4-4e06-b402-3b4c271dbdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:27.014380 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:27.097018 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:27.134354 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad6490-af5d-4cd2-9b0f-810918dc86ec None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:27.135892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2fad6490-af5d-4cd2-9b0f-810918dc86ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:27.238765 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad6490-af5d-4cd2-9b0f-810918dc86ec None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:27.251118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:27.310763 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a70912-e9f2-4495-921b-cb8929b4fb13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:27.311400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a70912-e9f2-4495-921b-cb8929b4fb13 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:27.311680 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a70912-e9f2-4495-921b-cb8929b4fb13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:27.311954 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a70912-e9f2-4495-921b-cb8929b4fb13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:27.313611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-05a70912-e9f2-4495-921b-cb8929b4fb13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:27.420257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a70912-e9f2-4495-921b-cb8929b4fb13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:27.421742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a70912-e9f2-4495-921b-cb8929b4fb13 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:27.440678 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 727/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:29.775850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d7e69-cf1d-4189-b505-f496a4f1edda None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:29.776396 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d7e69-cf1d-4189-b505-f496a4f1edda None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:29.776503 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d7e69-cf1d-4189-b505-f496a4f1edda None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:29.777839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:29.783301 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ac007-0ba1-4000-9bea-b127fba56c79 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:29.783713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ac007-0ba1-4000-9bea-b127fba56c79 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:29.783862 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ac007-0ba1-4000-9bea-b127fba56c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:29.831818 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:29.850301 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6f1ac007-0ba1-4000-9bea-b127fba56c79 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:29.851523 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6f1ac007-0ba1-4000-9bea-b127fba56c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:30.066592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:30.106191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d7e69-cf1d-4189-b505-f496a4f1edda None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:30.107727 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d85d7e69-cf1d-4189-b505-f496a4f1edda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:30.212593 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d7e69-cf1d-4189-b505-f496a4f1edda None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:30.252211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:30.286428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b05072-e7ad-4908-8c8a-f54786e1eada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:30.287071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b05072-e7ad-4908-8c8a-f54786e1eada service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:30.287357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b05072-e7ad-4908-8c8a-f54786e1eada service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:30.287634 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b05072-e7ad-4908-8c8a-f54786e1eada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:30.289300 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-52b05072-e7ad-4908-8c8a-f54786e1eada service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:30.396783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b05072-e7ad-4908-8c8a-f54786e1eada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:30.398254 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b05072-e7ad-4908-8c8a-f54786e1eada service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:30.416462 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 721/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:32.537349 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf6255-ed9f-403f-b810-c3c19930b6ca None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:32.537913 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf6255-ed9f-403f-b810-c3c19930b6ca None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:32.537913 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf6255-ed9f-403f-b810-c3c19930b6ca None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:32.539265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:32.544431 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf7480-960e-48ec-bf79-326b8fd224a5 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:32.544858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf7480-960e-48ec-bf79-326b8fd224a5 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:32.544999 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf7480-960e-48ec-bf79-326b8fd224a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:32.609315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ebdf7480-960e-48ec-bf79-326b8fd224a5 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:32.610528 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ebdf7480-960e-48ec-bf79-326b8fd224a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:32.630537 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:32.707389 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:32.745847 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf6255-ed9f-403f-b810-c3c19930b6ca None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:32.747398 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-91cf6255-ed9f-403f-b810-c3c19930b6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:32.849336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf6255-ed9f-403f-b810-c3c19930b6ca None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:32.868922 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:32.922801 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf8353-73cd-4fed-b195-bfd86cd03838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:32.923440 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf8353-73cd-4fed-b195-bfd86cd03838 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:32.923725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf8353-73cd-4fed-b195-bfd86cd03838 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:32.924003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf8353-73cd-4fed-b195-bfd86cd03838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:32.925674 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a3bf8353-73cd-4fed-b195-bfd86cd03838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:33.032798 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf8353-73cd-4fed-b195-bfd86cd03838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:33.034253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf8353-73cd-4fed-b195-bfd86cd03838 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:33.052636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 730/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:35.201943 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19447c7b-4c92-4d25-8cc5-ad3d84ec5d6a None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:35.202506 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19447c7b-4c92-4d25-8cc5-ad3d84ec5d6a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:35.202506 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19447c7b-4c92-4d25-8cc5-ad3d84ec5d6a None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:35.203877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:35.209084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c6f4c-75cf-4c3e-9c33-93e7c4cf8ac7 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:35.209525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c6f4c-75cf-4c3e-9c33-93e7c4cf8ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:35.209677 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c6f4c-75cf-4c3e-9c33-93e7c4cf8ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:35.271312 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:35.275368 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-929c6f4c-75cf-4c3e-9c33-93e7c4cf8ac7 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:35.277282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-929c6f4c-75cf-4c3e-9c33-93e7c4cf8ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:35.376070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:35.414118 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19447c7b-4c92-4d25-8cc5-ad3d84ec5d6a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:35.415683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-19447c7b-4c92-4d25-8cc5-ad3d84ec5d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:35.518293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19447c7b-4c92-4d25-8cc5-ad3d84ec5d6a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:35.565284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:35.591358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a22b60-13c6-4b5e-91c5-2f8227833ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:35.592006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a22b60-13c6-4b5e-91c5-2f8227833ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:35.592292 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a22b60-13c6-4b5e-91c5-2f8227833ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:35.592569 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a22b60-13c6-4b5e-91c5-2f8227833ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:35.594257 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-00a22b60-13c6-4b5e-91c5-2f8227833ae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:35.703086 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a22b60-13c6-4b5e-91c5-2f8227833ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:35.704550 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a22b60-13c6-4b5e-91c5-2f8227833ae8 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:35.722136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 724/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:37.782296 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8950e4-c1d2-4c9e-bbdb-bf9eee212df3 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:37.782905 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8950e4-c1d2-4c9e-bbdb-bf9eee212df3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:37.782905 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8950e4-c1d2-4c9e-bbdb-bf9eee212df3 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:37.784204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:37.789356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36921ea7-3200-42dd-b3ef-4b40f2227021 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:37.789772 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36921ea7-3200-42dd-b3ef-4b40f2227021 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:37.789943 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36921ea7-3200-42dd-b3ef-4b40f2227021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:37.853668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-36921ea7-3200-42dd-b3ef-4b40f2227021 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:37.855310 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-36921ea7-3200-42dd-b3ef-4b40f2227021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:37.884290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:37.952158 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:37.990348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8950e4-c1d2-4c9e-bbdb-bf9eee212df3 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:37.991891 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2b8950e4-c1d2-4c9e-bbdb-bf9eee212df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:38.092937 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8950e4-c1d2-4c9e-bbdb-bf9eee212df3 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:38.121225 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:38.165772 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076eb4d-1e90-43f9-aaa8-3055f457098d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:38.166424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076eb4d-1e90-43f9-aaa8-3055f457098d service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:38.166712 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076eb4d-1e90-43f9-aaa8-3055f457098d service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:38.167607 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076eb4d-1e90-43f9-aaa8-3055f457098d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:38.169307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3076eb4d-1e90-43f9-aaa8-3055f457098d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:38.284658 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076eb4d-1e90-43f9-aaa8-3055f457098d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:38.286126 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076eb4d-1e90-43f9-aaa8-3055f457098d service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:38.304524 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 733/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:40.349327 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b88f00-550e-4b72-8ebf-03dfa0f90bf7 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:40.349838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b88f00-550e-4b72-8ebf-03dfa0f90bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:40.349838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b88f00-550e-4b72-8ebf-03dfa0f90bf7 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:40.351186 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:40.356345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c12fc5-8481-4bd1-acb7-831be484287d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:40.356766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c12fc5-8481-4bd1-acb7-831be484287d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:40.356992 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c12fc5-8481-4bd1-acb7-831be484287d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:40.421597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-27c12fc5-8481-4bd1-acb7-831be484287d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:40.422816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-27c12fc5-8481-4bd1-acb7-831be484287d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:40.431131 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:40.520469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:40.558732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b88f00-550e-4b72-8ebf-03dfa0f90bf7 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:40.560289 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f9b88f00-550e-4b72-8ebf-03dfa0f90bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:40.662804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b88f00-550e-4b72-8ebf-03dfa0f90bf7 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:40.717273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:40.737153 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ba60c-1996-4c29-b6e2-72a6eda8bf9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:40.737844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ba60c-1996-4c29-b6e2-72a6eda8bf9a service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:40.738129 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ba60c-1996-4c29-b6e2-72a6eda8bf9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:40.738407 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ba60c-1996-4c29-b6e2-72a6eda8bf9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:40.740066 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ee2ba60c-1996-4c29-b6e2-72a6eda8bf9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:40.848081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ba60c-1996-4c29-b6e2-72a6eda8bf9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:40.849548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ba60c-1996-4c29-b6e2-72a6eda8bf9a service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:40.867686 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 727/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:42.926736 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104079c1-d559-4357-813d-a6fb5b934211 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:42.927273 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104079c1-d559-4357-813d-a6fb5b934211 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:42.927273 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104079c1-d559-4357-813d-a6fb5b934211 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:42.928651 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:42.933843 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d72e26-72ef-4fd6-a835-67180f23d74b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:42.934263 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d72e26-72ef-4fd6-a835-67180f23d74b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:42.934397 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d72e26-72ef-4fd6-a835-67180f23d74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:42.997619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-03d72e26-72ef-4fd6-a835-67180f23d74b None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:42.998818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-03d72e26-72ef-4fd6-a835-67180f23d74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:43.036497 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:43.093851 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:43.129992 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104079c1-d559-4357-813d-a6fb5b934211 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:43.131533 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-104079c1-d559-4357-813d-a6fb5b934211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:43.233776 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104079c1-d559-4357-813d-a6fb5b934211 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:43.271124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:43.305979 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38448e-7825-4a5c-8ddd-b6d5a4273512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:43.306622 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38448e-7825-4a5c-8ddd-b6d5a4273512 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:43.306902 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38448e-7825-4a5c-8ddd-b6d5a4273512 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:43.307178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38448e-7825-4a5c-8ddd-b6d5a4273512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:43.309369 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8b38448e-7825-4a5c-8ddd-b6d5a4273512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:43.416066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38448e-7825-4a5c-8ddd-b6d5a4273512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:43.417532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38448e-7825-4a5c-8ddd-b6d5a4273512 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:43.436004 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 736/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:45.489731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc8211-9621-4680-b8f2-2e8e9ac8c9b1 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:45.490309 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc8211-9621-4680-b8f2-2e8e9ac8c9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:45.490309 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc8211-9621-4680-b8f2-2e8e9ac8c9b1 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:45.491655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:45.497294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fa61e-091a-4c7e-929d-33f7a37cecea None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:45.498045 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fa61e-091a-4c7e-929d-33f7a37cecea None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:45.498328 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fa61e-091a-4c7e-929d-33f7a37cecea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:45.563481 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8c4fa61e-091a-4c7e-929d-33f7a37cecea None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:45.564679 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8c4fa61e-091a-4c7e-929d-33f7a37cecea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:45.582871 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:45.662538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:45.698870 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc8211-9621-4680-b8f2-2e8e9ac8c9b1 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:45.700405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9acc8211-9621-4680-b8f2-2e8e9ac8c9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:45.801416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc8211-9621-4680-b8f2-2e8e9ac8c9b1 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:45.865615 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:45.872369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd941f3c-190e-46c7-9537-0f57e5e23948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:45.873012 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd941f3c-190e-46c7-9537-0f57e5e23948 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:45.873322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd941f3c-190e-46c7-9537-0f57e5e23948 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:45.873602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd941f3c-190e-46c7-9537-0f57e5e23948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:45.875241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-cd941f3c-190e-46c7-9537-0f57e5e23948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:45.983385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd941f3c-190e-46c7-9537-0f57e5e23948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:45.984830 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd941f3c-190e-46c7-9537-0f57e5e23948 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:46.002760 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 730/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:48.034538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f2b41-a19d-476a-b668-c42cf402bded None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:48.035102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f2b41-a19d-476a-b668-c42cf402bded None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:48.035102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f2b41-a19d-476a-b668-c42cf402bded None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:48.036466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:48.041558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d122c-3659-4974-af71-70371f23ad68 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:48.042028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d122c-3659-4974-af71-70371f23ad68 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:48.042727 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d122c-3659-4974-af71-70371f23ad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:48.108063 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-643d122c-3659-4974-af71-70371f23ad68 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:48.109319 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-643d122c-3659-4974-af71-70371f23ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:48.157544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:48.207326 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:48.246291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f2b41-a19d-476a-b668-c42cf402bded None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:48.247827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e50f2b41-a19d-476a-b668-c42cf402bded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:48.351843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f2b41-a19d-476a-b668-c42cf402bded None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:48.398039 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:48.424052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864acd0-f615-4e27-b384-d0fc63956d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:48.424683 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864acd0-f615-4e27-b384-d0fc63956d0c service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:48.424962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864acd0-f615-4e27-b384-d0fc63956d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:48.425231 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864acd0-f615-4e27-b384-d0fc63956d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:48.426888 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a864acd0-f615-4e27-b384-d0fc63956d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:48.537583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864acd0-f615-4e27-b384-d0fc63956d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:48.539027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864acd0-f615-4e27-b384-d0fc63956d0c service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:48.557725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 739/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:58.205469 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=22 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:58.555422 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=66 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:08.108995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc875d4-c4f2-4ad9-af7b-20d891cc3d65 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:08.109610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc875d4-c4f2-4ad9-af7b-20d891cc3d65 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:08.109610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc875d4-c4f2-4ad9-af7b-20d891cc3d65 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:08.111002 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 732/1471] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:22:08.116236 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf255caf-8e8e-414b-861d-460316b60185 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:08.116661 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf255caf-8e8e-414b-861d-460316b60185 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:08.116771 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf255caf-8e8e-414b-861d-460316b60185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:08.179663 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-bf255caf-8e8e-414b-861d-460316b60185 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:08.180847 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bf255caf-8e8e-414b-861d-460316b60185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:08.273793 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 740/1472] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:08.357555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa45c59-174b-4e0e-bdfe-e4190719dcd8 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:08.357846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa45c59-174b-4e0e-bdfe-e4190719dcd8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:08.358123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa45c59-174b-4e0e-bdfe-e4190719dcd8 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:08.359528 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 733/1473] 10.222.0.57 () {54 vars in 962 bytes} [Tue Jul 12 18:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:22:08.364337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf1e2c-0fd0-49da-8f8f-50c61a167ffd None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:08.364629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf1e2c-0fd0-49da-8f8f-50c61a167ffd None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:08.364905 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf1e2c-0fd0-49da-8f8f-50c61a167ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:08.439181 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ccbf1e2c-0fd0-49da-8f8f-50c61a167ffd None None] MFA Rules not processed for user `5602d0a51329412ab6e908e7787531a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:08.440377 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ccbf1e2c-0fd0-49da-8f8f-50c61a167ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:08.461979 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:08.517073 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 741/1474] 10.222.0.57 () {58 vars in 1059 bytes} [Tue Jul 12 18:22:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:08.524361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa45c59-174b-4e0e-bdfe-e4190719dcd8 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:08.526133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1aa45c59-174b-4e0e-bdfe-e4190719dcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:08.627467 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa45c59-174b-4e0e-bdfe-e4190719dcd8 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:08.698349 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2433c-ea3e-4f3a-b95d-1159db58808e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5602d0a51329412ab6e908e7787531a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:08.699584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2433c-ea3e-4f3a-b95d-1159db58808e service glance] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:08.699863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2433c-ea3e-4f3a-b95d-1159db58808e service glance] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:08.700133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2433c-ea3e-4f3a-b95d-1159db58808e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:08.701807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c8c2433c-ea3e-4f3a-b95d-1159db58808e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:08.753770 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:08.807469 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2433c-ea3e-4f3a-b95d-1159db58808e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:08.808934 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2433c-ea3e-4f3a-b95d-1159db58808e service glance] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:08.827054 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 734/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:10.908898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51288187-d671-4290-a70d-1b1294115afb None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:10.909493 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51288187-d671-4290-a70d-1b1294115afb None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:10.909493 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51288187-d671-4290-a70d-1b1294115afb None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:10.910814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 742/1476] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:22:10.916184 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a7f52-b33d-4b2d-b5db-a1039c3a348d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:10.916635 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a7f52-b33d-4b2d-b5db-a1039c3a348d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:10.916776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a7f52-b33d-4b2d-b5db-a1039c3a348d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:10.980852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1c2a7f52-b33d-4b2d-b5db-a1039c3a348d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:10.982097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1c2a7f52-b33d-4b2d-b5db-a1039c3a348d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:11.077717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 735/1477] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:11.100319 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51288187-d671-4290-a70d-1b1294115afb None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:11.101883 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-51288187-d671-4290-a70d-1b1294115afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:11.226867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51288187-d671-4290-a70d-1b1294115afb None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:11.275657 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:11.320752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65faa091-3811-4f67-bba1-1106ef44618c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:11.321449 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faa091-3811-4f67-bba1-1106ef44618c admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:11.321733 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faa091-3811-4f67-bba1-1106ef44618c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:11.322008 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faa091-3811-4f67-bba1-1106ef44618c admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:11.322989 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65faa091-3811-4f67-bba1-1106ef44618c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:11.324707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: WARNING py.warnings [None req-65faa091-3811-4f67-bba1-1106ef44618c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:22:11.324707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: warnings.warn(msg) Jul 12 18:22:11.324707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: Jul 12 18:22:11.325882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65faa091-3811-4f67-bba1-1106ef44618c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:11.344757 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 743/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Jul 12 18:22:11 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:13.375228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f730d-a939-478f-b958-31e671cc941c None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:13.375794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f730d-a939-478f-b958-31e671cc941c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.375794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f730d-a939-478f-b958-31e671cc941c None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.377133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 736/1479] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:22:13.382294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c33cc1-92a8-4436-8688-0390ffce5537 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:13.382715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c33cc1-92a8-4436-8688-0390ffce5537 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.382848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c33cc1-92a8-4436-8688-0390ffce5537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.445065 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-72c33cc1-92a8-4436-8688-0390ffce5537 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:13.446291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-72c33cc1-92a8-4436-8688-0390ffce5537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:13.541107 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 744/1480] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:13.584530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f730d-a939-478f-b958-31e671cc941c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:13.586256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9d4f730d-a939-478f-b958-31e671cc941c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:13.595842 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:13.731596 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f730d-a939-478f-b958-31e671cc941c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:13.810325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:13.842615 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051a6a1-4248-4d6d-ac64-f7518a469b47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:13.843255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051a6a1-4248-4d6d-ac64-f7518a469b47 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:13.843540 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051a6a1-4248-4d6d-ac64-f7518a469b47 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.843807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051a6a1-4248-4d6d-ac64-f7518a469b47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.845481 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4051a6a1-4248-4d6d-ac64-f7518a469b47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:13.931742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051a6a1-4248-4d6d-ac64-f7518a469b47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:13.933405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051a6a1-4248-4d6d-ac64-f7518a469b47 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:13.951185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 737/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:16.154918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d698a3-fb74-401a-88a4-983cdfac0d58 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:16.155504 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d698a3-fb74-401a-88a4-983cdfac0d58 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:16.155504 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d698a3-fb74-401a-88a4-983cdfac0d58 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:16.156838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 745/1482] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:22:16.161948 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7b47d-4cea-494f-9143-993500a09b9c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:16.162371 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7b47d-4cea-494f-9143-993500a09b9c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:16.162507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7b47d-4cea-494f-9143-993500a09b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:16.226369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-37c7b47d-4cea-494f-9143-993500a09b9c None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:16.227572 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-37c7b47d-4cea-494f-9143-993500a09b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:16.273168 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:16.324656 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 738/1483] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:16.360301 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d698a3-fb74-401a-88a4-983cdfac0d58 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:16.361865 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-18d698a3-fb74-401a-88a4-983cdfac0d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:16.385504 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:16.465700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d698a3-fb74-401a-88a4-983cdfac0d58 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:16.537322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3acad8-d6b8-4206-b9d4-192079b7cef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:16.537964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3acad8-d6b8-4206-b9d4-192079b7cef3 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:16.538248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3acad8-d6b8-4206-b9d4-192079b7cef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:16.538525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3acad8-d6b8-4206-b9d4-192079b7cef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:16.540210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9a3acad8-d6b8-4206-b9d4-192079b7cef3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:16.618173 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:16.652604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3acad8-d6b8-4206-b9d4-192079b7cef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:16.654060 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3acad8-d6b8-4206-b9d4-192079b7cef3 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:16.672539 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 746/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:18.722234 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba4232-4369-4e2e-b056-236acc0daa59 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:18.722791 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba4232-4369-4e2e-b056-236acc0daa59 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:18.722791 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba4232-4369-4e2e-b056-236acc0daa59 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:18.724162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 739/1485] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:22:18.729306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4543d-842f-4905-a767-d9e7d40f0eba None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:18.729705 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4543d-842f-4905-a767-d9e7d40f0eba None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:18.729900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4543d-842f-4905-a767-d9e7d40f0eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:18.794351 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-9cb4543d-842f-4905-a767-d9e7d40f0eba None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:18.795552 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9cb4543d-842f-4905-a767-d9e7d40f0eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:18.892259 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 747/1486] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:18.929627 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba4232-4369-4e2e-b056-236acc0daa59 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:18.931166 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c9ba4232-4369-4e2e-b056-236acc0daa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:19.033654 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba4232-4369-4e2e-b056-236acc0daa59 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:19.103828 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:19.105628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0fb72-7ecd-4537-86e8-6060d6cf6202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:19.106288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0fb72-7ecd-4537-86e8-6060d6cf6202 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:19.106767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0fb72-7ecd-4537-86e8-6060d6cf6202 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:19.107121 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0fb72-7ecd-4537-86e8-6060d6cf6202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:19.109115 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-98d0fb72-7ecd-4537-86e8-6060d6cf6202 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:19.217306 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0fb72-7ecd-4537-86e8-6060d6cf6202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:19.218748 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0fb72-7ecd-4537-86e8-6060d6cf6202 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:19.236512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 740/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:21.409615 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db319ed4-f112-42cf-8f25-43ad7716c212 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:21.410152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db319ed4-f112-42cf-8f25-43ad7716c212 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:21.410264 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db319ed4-f112-42cf-8f25-43ad7716c212 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:21.411553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 748/1488] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:22:21.416764 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6948083-715f-4680-aa7b-cbdc0171ef5d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:21.417149 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6948083-715f-4680-aa7b-cbdc0171ef5d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:21.417358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6948083-715f-4680-aa7b-cbdc0171ef5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:21.481419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d6948083-715f-4680-aa7b-cbdc0171ef5d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:21.482620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d6948083-715f-4680-aa7b-cbdc0171ef5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:21.533887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:21.585892 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 741/1489] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:21.627916 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db319ed4-f112-42cf-8f25-43ad7716c212 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:21.629520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-db319ed4-f112-42cf-8f25-43ad7716c212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:21.665572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:21.732913 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db319ed4-f112-42cf-8f25-43ad7716c212 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:21.804494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9caee-396f-48cb-bbfa-a09bc3ec21ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:21.805139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9caee-396f-48cb-bbfa-a09bc3ec21ec service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:21.805451 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9caee-396f-48cb-bbfa-a09bc3ec21ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:21.805734 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9caee-396f-48cb-bbfa-a09bc3ec21ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:21.807378 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-11b9caee-396f-48cb-bbfa-a09bc3ec21ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:21.890155 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:21.919221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9caee-396f-48cb-bbfa-a09bc3ec21ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:21.920580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9caee-396f-48cb-bbfa-a09bc3ec21ec service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:21.938748 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 749/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:24.151228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e1e1e-1369-4743-8be9-d28217aafe08 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:24.151762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e1e1e-1369-4743-8be9-d28217aafe08 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:24.151920 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e1e1e-1369-4743-8be9-d28217aafe08 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:24.153769 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 742/1491] 10.222.0.57 () {54 vars in 926 bytes} [Tue Jul 12 18:22:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:22:24.158970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5157d2a-e60b-41de-840f-6ac709bc04b1 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:24.159415 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5157d2a-e60b-41de-840f-6ac709bc04b1 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:24.159520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5157d2a-e60b-41de-840f-6ac709bc04b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:24.225268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d5157d2a-e60b-41de-840f-6ac709bc04b1 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:24.226527 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d5157d2a-e60b-41de-840f-6ac709bc04b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:24.322653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 750/1492] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Jul 12 18:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:24.363182 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e1e1e-1369-4743-8be9-d28217aafe08 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:24.364725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ed6e1e1e-1369-4743-8be9-d28217aafe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:24.470099 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e1e1e-1369-4743-8be9-d28217aafe08 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:24.543355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffee7e7-8444-45c5-a608-737aa8ff8b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:24.544113 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffee7e7-8444-45c5-a608-737aa8ff8b15 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:24.544399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffee7e7-8444-45c5-a608-737aa8ff8b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:24.544677 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffee7e7-8444-45c5-a608-737aa8ff8b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:24.546377 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3ffee7e7-8444-45c5-a608-737aa8ff8b15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:24.555379 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:24.663518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffee7e7-8444-45c5-a608-737aa8ff8b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:24.664982 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffee7e7-8444-45c5-a608-737aa8ff8b15 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:24.691133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 743/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:34.320816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=82 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:34.687144 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=50 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:50.186630 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5cc57-1810-4115-9e74-3273cfa51759 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:50.187243 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5cc57-1810-4115-9e74-3273cfa51759 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:50.187243 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5cc57-1810-4115-9e74-3273cfa51759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:50.261666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a8f5cc57-1810-4115-9e74-3273cfa51759 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:50.262780 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a8f5cc57-1810-4115-9e74-3273cfa51759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:50.358263 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 751/1494] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:50.366212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967de48c-be07-4de9-b409-4f5d3015cd4d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:50.366707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967de48c-be07-4de9-b409-4f5d3015cd4d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:50.366807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967de48c-be07-4de9-b409-4f5d3015cd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:50.439741 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-967de48c-be07-4de9-b409-4f5d3015cd4d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:50.440945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-967de48c-be07-4de9-b409-4f5d3015cd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:50.534974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 744/1495] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:50.539494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5cc57-1810-4115-9e74-3273cfa51759 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:50.540707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a8f5cc57-1810-4115-9e74-3273cfa51759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:50.552165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5cc57-1810-4115-9e74-3273cfa51759 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:50.614627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:50.649709 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b93d35-68a2-4a6a-b51e-019abe504f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:50.650365 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b93d35-68a2-4a6a-b51e-019abe504f63 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:50.650641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b93d35-68a2-4a6a-b51e-019abe504f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:50.650908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b93d35-68a2-4a6a-b51e-019abe504f63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:50.652281 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b93d35-68a2-4a6a-b51e-019abe504f63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:23:50.652582 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b93d35-68a2-4a6a-b51e-019abe504f63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:50.653635 dv-cinder-835384-15-smb devstack@keystone.service[80226]: WARNING py.warnings [None req-e3b93d35-68a2-4a6a-b51e-019abe504f63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:23:50.653635 dv-cinder-835384-15-smb devstack@keystone.service[80226]: warnings.warn(msg) Jul 12 18:23:50.653635 dv-cinder-835384-15-smb devstack@keystone.service[80226]: Jul 12 18:23:50.654547 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b93d35-68a2-4a6a-b51e-019abe504f63 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:50.665713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 752/1496] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:23:50.673810 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967de48c-be07-4de9-b409-4f5d3015cd4d None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:50.683502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967de48c-be07-4de9-b409-4f5d3015cd4d None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:50.744064 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:50.779014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b8e1c-da7c-41a1-82b2-752efc8a43f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:50.779667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b8e1c-da7c-41a1-82b2-752efc8a43f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:50.779949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b8e1c-da7c-41a1-82b2-752efc8a43f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:50.780226 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b8e1c-da7c-41a1-82b2-752efc8a43f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:50.780914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b8e1c-da7c-41a1-82b2-752efc8a43f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:50.782729 dv-cinder-835384-15-smb devstack@keystone.service[80227]: WARNING py.warnings [None req-b75b8e1c-da7c-41a1-82b2-752efc8a43f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:23:50.782729 dv-cinder-835384-15-smb devstack@keystone.service[80227]: warnings.warn(msg) Jul 12 18:23:50.782729 dv-cinder-835384-15-smb devstack@keystone.service[80227]: Jul 12 18:23:50.783932 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b8e1c-da7c-41a1-82b2-752efc8a43f3 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:50.838508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 745/1497] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:23:50 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:23:50.842591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b93d35-68a2-4a6a-b51e-019abe504f63 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:50.844202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e3b93d35-68a2-4a6a-b51e-019abe504f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:50.877457 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b93d35-68a2-4a6a-b51e-019abe504f63 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:50.973994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b88635-7be9-4a04-b156-7dc85af8fb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:50.974659 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b88635-7be9-4a04-b156-7dc85af8fb54 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:50.974941 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b88635-7be9-4a04-b156-7dc85af8fb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:50.975216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b88635-7be9-4a04-b156-7dc85af8fb54 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:50.975911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b88635-7be9-4a04-b156-7dc85af8fb54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:50.976918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: WARNING py.warnings [None req-51b88635-7be9-4a04-b156-7dc85af8fb54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:23:50.976918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: warnings.warn(msg) Jul 12 18:23:50.976918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: Jul 12 18:23:50.978152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b88635-7be9-4a04-b156-7dc85af8fb54 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:51.018200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 753/1498] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:23:50 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:23:51.022285 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b8e1c-da7c-41a1-82b2-752efc8a43f3 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:51.023834 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b75b8e1c-da7c-41a1-82b2-752efc8a43f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:51.085057 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b8e1c-da7c-41a1-82b2-752efc8a43f3 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:51.166407 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:51.177473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252b051-76e2-4ac4-ac67-14fcdbffb910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:51.178145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252b051-76e2-4ac4-ac67-14fcdbffb910 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:51.178426 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252b051-76e2-4ac4-ac67-14fcdbffb910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:51.178715 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252b051-76e2-4ac4-ac67-14fcdbffb910 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:51.179566 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252b051-76e2-4ac4-ac67-14fcdbffb910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:51.180591 dv-cinder-835384-15-smb devstack@keystone.service[80227]: WARNING py.warnings [None req-6252b051-76e2-4ac4-ac67-14fcdbffb910 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:23:51.180591 dv-cinder-835384-15-smb devstack@keystone.service[80227]: warnings.warn(msg) Jul 12 18:23:51.180591 dv-cinder-835384-15-smb devstack@keystone.service[80227]: Jul 12 18:23:51.181494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252b051-76e2-4ac4-ac67-14fcdbffb910 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:51.195255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 746/1499] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:23:51.199848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b88635-7be9-4a04-b156-7dc85af8fb54 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:51.201415 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-51b88635-7be9-4a04-b156-7dc85af8fb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:51.212775 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b88635-7be9-4a04-b156-7dc85af8fb54 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:51.237821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:51.308685 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f097fbb-833a-46e9-a6cd-451ca89910c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:51.309371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f097fbb-833a-46e9-a6cd-451ca89910c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:51.309650 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f097fbb-833a-46e9-a6cd-451ca89910c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:51.309917 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f097fbb-833a-46e9-a6cd-451ca89910c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:51.310626 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f097fbb-833a-46e9-a6cd-451ca89910c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:51.311618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: WARNING py.warnings [None req-1f097fbb-833a-46e9-a6cd-451ca89910c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:23:51.311618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: warnings.warn(msg) Jul 12 18:23:51.311618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: Jul 12 18:23:51.312498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f097fbb-833a-46e9-a6cd-451ca89910c7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:51.325293 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 754/1500] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:23:51.329621 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252b051-76e2-4ac4-ac67-14fcdbffb910 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:51.331219 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6252b051-76e2-4ac4-ac67-14fcdbffb910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:51.364295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252b051-76e2-4ac4-ac67-14fcdbffb910 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:51.456621 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb658caf-ac24-4007-b585-bcc2e3965309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:51.457465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb658caf-ac24-4007-b585-bcc2e3965309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:51.457750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb658caf-ac24-4007-b585-bcc2e3965309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:51.458025 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb658caf-ac24-4007-b585-bcc2e3965309 admin admin] PATH_INFO: `/v3/projects/85c7edbe6ec4493cb488643b8ad9374b/users/86bcaa7e63ff42148bf7c2a1a582d6c7/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:51.479090 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb658caf-ac24-4007-b585-bcc2e3965309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c7edbe6ec4493cb488643b8ad9374b, user_id=86bcaa7e63ff42148bf7c2a1a582d6c7, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:51.480121 dv-cinder-835384-15-smb devstack@keystone.service[80227]: WARNING py.warnings [None req-eb658caf-ac24-4007-b585-bcc2e3965309 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:23:51.480121 dv-cinder-835384-15-smb devstack@keystone.service[80227]: warnings.warn(msg) Jul 12 18:23:51.480121 dv-cinder-835384-15-smb devstack@keystone.service[80227]: Jul 12 18:23:51.482096 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb658caf-ac24-4007-b585-bcc2e3965309 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:51.507121 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 747/1501] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:23:51 2022] PUT /identity/v3/projects/85c7edbe6ec4493cb488643b8ad9374b/users/86bcaa7e63ff42148bf7c2a1a582d6c7/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:23:51.520076 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec518c-da7f-4270-a005-a42a25c7d970 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:51.520391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec518c-da7f-4270-a005-a42a25c7d970 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:51.520662 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec518c-da7f-4270-a005-a42a25c7d970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:51.577544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-eaec518c-da7f-4270-a005-a42a25c7d970 None None] MFA Rules not processed for user `86bcaa7e63ff42148bf7c2a1a582d6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:51.578788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-eaec518c-da7f-4270-a005-a42a25c7d970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:51.654823 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 755/1502] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:23:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:51.667898 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395f37b-3e80-4d08-8cd5-cfabd50728ba None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:51.668191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395f37b-3e80-4d08-8cd5-cfabd50728ba None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:51.668472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395f37b-3e80-4d08-8cd5-cfabd50728ba None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:51.669916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 748/1503] 10.222.0.57 () {54 vars in 963 bytes} [Tue Jul 12 18:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:23:51.674907 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf242cb0-1cbd-4a60-b4ae-52e0c796f9a5 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:51.675103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf242cb0-1cbd-4a60-b4ae-52e0c796f9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:51.675454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf242cb0-1cbd-4a60-b4ae-52e0c796f9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:51.705602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:51.749754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-cf242cb0-1cbd-4a60-b4ae-52e0c796f9a5 None None] MFA Rules not processed for user `faf61fd1e2ab426bbbbcc8dc7d552942`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:51.750894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-cf242cb0-1cbd-4a60-b4ae-52e0c796f9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:51.825795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 756/1504] 10.222.0.57 () {58 vars in 1060 bytes} [Tue Jul 12 18:23:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:51.833392 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395f37b-3e80-4d08-8cd5-cfabd50728ba None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:51.834929 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e395f37b-3e80-4d08-8cd5-cfabd50728ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:51.884377 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:51.938720 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395f37b-3e80-4d08-8cd5-cfabd50728ba None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:52.012867 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f8cd1-07d9-4801-b7fa-f26461dc0851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:52.013474 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f8cd1-07d9-4801-b7fa-f26461dc0851 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:52.013754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f8cd1-07d9-4801-b7fa-f26461dc0851 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:52.014025 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f8cd1-07d9-4801-b7fa-f26461dc0851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:52.015663 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ff9f8cd1-07d9-4801-b7fa-f26461dc0851 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:52.112382 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f8cd1-07d9-4801-b7fa-f26461dc0851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:52.113848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f8cd1-07d9-4801-b7fa-f26461dc0851 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:52.117291 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:52.131622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 749/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:52.173674 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7accc3f-013a-445d-9d1c-44a7d861db25 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:52.173964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7accc3f-013a-445d-9d1c-44a7d861db25 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:52.174242 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7accc3f-013a-445d-9d1c-44a7d861db25 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:52.175531 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 757/1506] 10.222.0.57 () {52 vars in 829 bytes} [Tue Jul 12 18:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:23:52.179382 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f8cd1-07d9-4801-b7fa-f26461dc0851 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:52.180590 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ff9f8cd1-07d9-4801-b7fa-f26461dc0851 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:52.277866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f8cd1-07d9-4801-b7fa-f26461dc0851 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:52.368644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd28e0-ce6b-4fbc-8336-087e633df05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:52.369531 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd28e0-ce6b-4fbc-8336-087e633df05f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:52.369809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd28e0-ce6b-4fbc-8336-087e633df05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:52.370569 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd28e0-ce6b-4fbc-8336-087e633df05f admin admin] PATH_INFO: `/v3/users/86bcaa7e63ff42148bf7c2a1a582d6c7` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:52.382519 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd28e0-ce6b-4fbc-8336-087e633df05f admin admin] RBAC: Authorizing `identity:delete_user(user_id=86bcaa7e63ff42148bf7c2a1a582d6c7)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:52.383536 dv-cinder-835384-15-smb devstack@keystone.service[80227]: WARNING py.warnings [None req-57fd28e0-ce6b-4fbc-8336-087e633df05f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:23:52.383536 dv-cinder-835384-15-smb devstack@keystone.service[80227]: warnings.warn(msg) Jul 12 18:23:52.383536 dv-cinder-835384-15-smb devstack@keystone.service[80227]: Jul 12 18:23:52.384739 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd28e0-ce6b-4fbc-8336-087e633df05f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:52.394665 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:52.447243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-57fd28e0-ce6b-4fbc-8336-087e633df05f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86bcaa7e63ff42148bf7c2a1a582d6c7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:52.447682 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-57fd28e0-ce6b-4fbc-8336-087e633df05f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86bcaa7e63ff42148bf7c2a1a582d6c7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:52.466872 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-57fd28e0-ce6b-4fbc-8336-087e633df05f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86bcaa7e63ff42148bf7c2a1a582d6c7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:52.479115 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-57fd28e0-ce6b-4fbc-8336-087e633df05f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86bcaa7e63ff42148bf7c2a1a582d6c7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:52.479666 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-57fd28e0-ce6b-4fbc-8336-087e633df05f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86bcaa7e63ff42148bf7c2a1a582d6c7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:52.493824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 750/1507] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:23:52 2022] DELETE /identity/v3/users/86bcaa7e63ff42148bf7c2a1a582d6c7 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:23:52.498712 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c2052-0516-483a-92ae-1317a44eca0b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:52.499188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c2052-0516-483a-92ae-1317a44eca0b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:52.499297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c2052-0516-483a-92ae-1317a44eca0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:52.554379 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d98c2052-0516-483a-92ae-1317a44eca0b None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:52.555534 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d98c2052-0516-483a-92ae-1317a44eca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:52.630073 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:52.643607 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 758/1508] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:52.653125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd28e0-ce6b-4fbc-8336-087e633df05f admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:52.654427 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-57fd28e0-ce6b-4fbc-8336-087e633df05f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:52.873627 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd28e0-ce6b-4fbc-8336-087e633df05f admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:52.927661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:52.948777 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f2ef6-d08a-4f3f-9658-f70f9500fb60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:52.949714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f2ef6-d08a-4f3f-9658-f70f9500fb60 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:52.950001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f2ef6-d08a-4f3f-9658-f70f9500fb60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:52.950279 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f2ef6-d08a-4f3f-9658-f70f9500fb60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:52.951919 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-153f2ef6-d08a-4f3f-9658-f70f9500fb60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:53.061675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f2ef6-d08a-4f3f-9658-f70f9500fb60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:53.063109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f2ef6-d08a-4f3f-9658-f70f9500fb60 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:53.080942 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 751/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:53.439700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c2052-0516-483a-92ae-1317a44eca0b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:53.440953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d98c2052-0516-483a-92ae-1317a44eca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:53.453329 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c2052-0516-483a-92ae-1317a44eca0b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:53.557922 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99131d8-d772-4225-aa15-d1d437900bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:53.558786 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99131d8-d772-4225-aa15-d1d437900bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:53.559101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99131d8-d772-4225-aa15-d1d437900bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:53.559385 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99131d8-d772-4225-aa15-d1d437900bd6 admin admin] PATH_INFO: `/v3/projects/85c7edbe6ec4493cb488643b8ad9374b` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:53.569686 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99131d8-d772-4225-aa15-d1d437900bd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c7edbe6ec4493cb488643b8ad9374b)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:53.570721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: WARNING py.warnings [None req-a99131d8-d772-4225-aa15-d1d437900bd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:23:53.570721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: warnings.warn(msg) Jul 12 18:23:53.570721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: Jul 12 18:23:53.571923 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99131d8-d772-4225-aa15-d1d437900bd6 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:53.629326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a99131d8-d772-4225-aa15-d1d437900bd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c7edbe6ec4493cb488643b8ad9374b', 'request_id': 'req-a99131d8-d772-4225-aa15-d1d437900bd6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:53.635185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a99131d8-d772-4225-aa15-d1d437900bd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c7edbe6ec4493cb488643b8ad9374b', 'request_id': 'req-a99131d8-d772-4225-aa15-d1d437900bd6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:53.648604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a99131d8-d772-4225-aa15-d1d437900bd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c7edbe6ec4493cb488643b8ad9374b', 'request_id': 'req-a99131d8-d772-4225-aa15-d1d437900bd6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:53.674729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a99131d8-d772-4225-aa15-d1d437900bd6 admin admin] The token cache is being invalidate because project 85c7edbe6ec4493cb488643b8ad9374b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:23:53.675018 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a99131d8-d772-4225-aa15-d1d437900bd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:53.675448 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a99131d8-d772-4225-aa15-d1d437900bd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:53.676893 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 759/1510] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:23:53 2022] DELETE /identity/v3/projects/85c7edbe6ec4493cb488643b8ad9374b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:24:03.078631 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=62 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:24:03.672674 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:40.882484 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa3db0-19d7-477e-82b0-6cf7b17070ad None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:40.883079 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa3db0-19d7-477e-82b0-6cf7b17070ad None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:40.883079 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa3db0-19d7-477e-82b0-6cf7b17070ad None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:40.884587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:25:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:25:40.889382 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fb81e-1c69-4ab1-9964-3b095877cd8c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:40.889819 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fb81e-1c69-4ab1-9964-3b095877cd8c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:40.889959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fb81e-1c69-4ab1-9964-3b095877cd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:40.969572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-312fb81e-1c69-4ab1-9964-3b095877cd8c None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:25:40.970806 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-312fb81e-1c69-4ab1-9964-3b095877cd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:25:41.074702 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:25:41.226432 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa3db0-19d7-477e-82b0-6cf7b17070ad None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:25:41.228498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a0fa3db0-19d7-477e-82b0-6cf7b17070ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:25:41.343374 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa3db0-19d7-477e-82b0-6cf7b17070ad None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:25:41.348745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8437b-993f-4a9d-8ad6-e055c5b6efc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:25:41.349427 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8437b-993f-4a9d-8ad6-e055c5b6efc5 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:41.349710 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8437b-993f-4a9d-8ad6-e055c5b6efc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:41.349984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8437b-993f-4a9d-8ad6-e055c5b6efc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:41.358074 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8437b-993f-4a9d-8ad6-e055c5b6efc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:25:41.359641 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8437b-993f-4a9d-8ad6-e055c5b6efc5 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:25:41.369357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 753/1513] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:25:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:25:42.188938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a2190-6895-4f3a-abda-03dcd9ecbb17 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:42.189550 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a2190-6895-4f3a-abda-03dcd9ecbb17 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:42.189550 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a2190-6895-4f3a-abda-03dcd9ecbb17 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:42.190896 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:25:42.196058 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969ddcd-86e9-42be-82f1-488e53435705 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:42.196484 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969ddcd-86e9-42be-82f1-488e53435705 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:42.196609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969ddcd-86e9-42be-82f1-488e53435705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:42.214537 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c969ddcd-86e9-42be-82f1-488e53435705 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:25:42.215706 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c969ddcd-86e9-42be-82f1-488e53435705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:25:42.223418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:25:42.371588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a2190-6895-4f3a-abda-03dcd9ecbb17 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:25:42.386296 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a2190-6895-4f3a-abda-03dcd9ecbb17 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:25:42.391695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a358765-c3b3-4a93-8c51-f5b23d229958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:25:42.392326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a358765-c3b3-4a93-8c51-f5b23d229958 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:42.392611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a358765-c3b3-4a93-8c51-f5b23d229958 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:42.392887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a358765-c3b3-4a93-8c51-f5b23d229958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:42.401592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a358765-c3b3-4a93-8c51-f5b23d229958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:25:42.403184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a358765-c3b3-4a93-8c51-f5b23d229958 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:25:42.412880 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 762/1516] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:25:42.636285 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b49f8d-dd19-4f4d-9d79-7e8b0008ecd8 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:42.636560 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b49f8d-dd19-4f4d-9d79-7e8b0008ecd8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:42.636848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b49f8d-dd19-4f4d-9d79-7e8b0008ecd8 None None] PATH_INFO: `/v3` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:42.638199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 755/1517] 10.222.0.27 () {54 vars in 925 bytes} [Tue Jul 12 18:25:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:25:42.658376 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727c82a-6e7c-4007-8a79-00d3348e3d6c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:42.658664 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727c82a-6e7c-4007-8a79-00d3348e3d6c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:42.658965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727c82a-6e7c-4007-8a79-00d3348e3d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:42.716867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4727c82a-6e7c-4007-8a79-00d3348e3d6c None None] MFA Rules not processed for user `206242c775be40c7b96af6de635e2065`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:25:42.718032 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4727c82a-6e7c-4007-8a79-00d3348e3d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:25:42.734895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:42.789807 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 763/1518] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Jul 12 18:25:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:25:52.036695 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04531a9-cea8-4828-938b-46a54a4cadc4 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:52.037288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04531a9-cea8-4828-938b-46a54a4cadc4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:52.037288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04531a9-cea8-4828-938b-46a54a4cadc4 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:52.038700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 756/1519] 10.222.0.57 () {54 vars in 960 bytes} [Tue Jul 12 18:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:25:52.043976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fd20d-0d84-43c8-9345-846ad9dcfbb7 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:52.044429 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fd20d-0d84-43c8-9345-846ad9dcfbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:52.044536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fd20d-0d84-43c8-9345-846ad9dcfbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:52.062438 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4b6fd20d-0d84-43c8-9345-846ad9dcfbb7 None None] MFA Rules not processed for user `206242c775be40c7b96af6de635e2065`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:25:52.063626 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4b6fd20d-0d84-43c8-9345-846ad9dcfbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:25:52.072620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 764/1520] 10.222.0.57 () {58 vars in 1057 bytes} [Tue Jul 12 18:25:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:25:52.080197 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04531a9-cea8-4828-938b-46a54a4cadc4 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:25:52.093778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04531a9-cea8-4828-938b-46a54a4cadc4 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:25:52.098629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17608dcc-b02d-442f-97db-f187ffd89ba4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206242c775be40c7b96af6de635e2065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:25:52.099247 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17608dcc-b02d-442f-97db-f187ffd89ba4 service placement] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:52.099526 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17608dcc-b02d-442f-97db-f187ffd89ba4 service placement] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:52.099800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17608dcc-b02d-442f-97db-f187ffd89ba4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:52.107811 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17608dcc-b02d-442f-97db-f187ffd89ba4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:25:52.109408 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17608dcc-b02d-442f-97db-f187ffd89ba4 service placement] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:25:52.118730 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 757/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:25:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:25:53.642724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6865af7-20f4-48b2-b9d7-a91d33a3693b None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:53.643260 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6865af7-20f4-48b2-b9d7-a91d33a3693b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:53.643260 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6865af7-20f4-48b2-b9d7-a91d33a3693b None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:53.644654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:25:53.650019 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880857d-db6b-42ea-b8b1-23c4a604634a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:53.650413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880857d-db6b-42ea-b8b1-23c4a604634a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:53.650573 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880857d-db6b-42ea-b8b1-23c4a604634a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:53.668147 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e880857d-db6b-42ea-b8b1-23c4a604634a None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:25:53.669351 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e880857d-db6b-42ea-b8b1-23c4a604634a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:25:53.676949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:25:53.832173 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6865af7-20f4-48b2-b9d7-a91d33a3693b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:25:53.846301 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6865af7-20f4-48b2-b9d7-a91d33a3693b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:25:53.851577 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a5569-a4fe-450d-9ea4-c4b74f309421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:25:53.852231 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a5569-a4fe-450d-9ea4-c4b74f309421 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:53.852510 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a5569-a4fe-450d-9ea4-c4b74f309421 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:53.852809 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a5569-a4fe-450d-9ea4-c4b74f309421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:53.860737 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a5569-a4fe-450d-9ea4-c4b74f309421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:25:53.862342 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a5569-a4fe-450d-9ea4-c4b74f309421 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:25:53.872110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 766/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:25:54.697145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e402ce-bf5e-4f5a-8f15-318a24ace27b None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:54.697676 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e402ce-bf5e-4f5a-8f15-318a24ace27b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:54.697676 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e402ce-bf5e-4f5a-8f15-318a24ace27b None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:54.699054 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:25:54.704295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5abb2f-6156-4753-8535-19aebd7c3aed None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:54.708512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5abb2f-6156-4753-8535-19aebd7c3aed None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:54.708512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5abb2f-6156-4753-8535-19aebd7c3aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:54.723414 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ce5abb2f-6156-4753-8535-19aebd7c3aed None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:25:54.724629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ce5abb2f-6156-4753-8535-19aebd7c3aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:25:54.733041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:25:54.884456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e402ce-bf5e-4f5a-8f15-318a24ace27b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:25:54.898753 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e402ce-bf5e-4f5a-8f15-318a24ace27b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:25:54.904722 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9339d-f391-4c77-af8f-49b363ef297b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:25:54.905406 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9339d-f391-4c77-af8f-49b363ef297b service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:54.905693 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9339d-f391-4c77-af8f-49b363ef297b service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:54.905973 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9339d-f391-4c77-af8f-49b363ef297b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:54.914078 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9339d-f391-4c77-af8f-49b363ef297b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:25:54.915663 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9339d-f391-4c77-af8f-49b363ef297b service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:25:54.924987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 760/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:25:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:25:58.776099 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea610b0-d72d-4b5c-b0e5-a67b9bb1b844 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:58.776628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea610b0-d72d-4b5c-b0e5-a67b9bb1b844 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:58.776628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea610b0-d72d-4b5c-b0e5-a67b9bb1b844 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:58.777963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:25:58.783179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8ae82-3876-4750-bed8-119225e040ee None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:58.783615 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8ae82-3876-4750-bed8-119225e040ee None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:58.783719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8ae82-3876-4750-bed8-119225e040ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:58.803624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-94f8ae82-3876-4750-bed8-119225e040ee None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:25:58.805074 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-94f8ae82-3876-4750-bed8-119225e040ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:25:58.813425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:25:58.885084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea610b0-d72d-4b5c-b0e5-a67b9bb1b844 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:25:58.886867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9ea610b0-d72d-4b5c-b0e5-a67b9bb1b844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:25:58.964579 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea610b0-d72d-4b5c-b0e5-a67b9bb1b844 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:25:58.968260 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5193a2d-1762-4056-a47a-c7b1d9e2006f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:25:58.968898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193a2d-1762-4056-a47a-c7b1d9e2006f service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:58.969177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193a2d-1762-4056-a47a-c7b1d9e2006f service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:58.969482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193a2d-1762-4056-a47a-c7b1d9e2006f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:58.978982 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5193a2d-1762-4056-a47a-c7b1d9e2006f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:25:58.980436 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5193a2d-1762-4056-a47a-c7b1d9e2006f service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:25:58.989755 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 769/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:26:01.002887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a37a9-883f-4b0b-8681-fc35a649b40f None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:01.003425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a37a9-883f-4b0b-8681-fc35a649b40f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:01.003425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a37a9-883f-4b0b-8681-fc35a649b40f None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:01.004799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:26:01.010406 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c29c6-59ca-4daf-830b-6b09493cb339 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:01.010806 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c29c6-59ca-4daf-830b-6b09493cb339 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:01.010968 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c29c6-59ca-4daf-830b-6b09493cb339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:01.029470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b17c29c6-59ca-4daf-830b-6b09493cb339 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:26:01.030670 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b17c29c6-59ca-4daf-830b-6b09493cb339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:01.038871 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:26:01.073852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a37a9-883f-4b0b-8681-fc35a649b40f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:01.084927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a37a9-883f-4b0b-8681-fc35a649b40f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:01.089127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c767f-2c8a-4e81-a971-2784be138e88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:01.089790 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c767f-2c8a-4e81-a971-2784be138e88 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:01.090076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c767f-2c8a-4e81-a971-2784be138e88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:01.090354 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c767f-2c8a-4e81-a971-2784be138e88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:01.099483 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c767f-2c8a-4e81-a971-2784be138e88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:01.100916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c767f-2c8a-4e81-a971-2784be138e88 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:01.110282 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 763/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:26:04.724052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d674b-b028-4375-9edf-e9fa8e42e15f None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:04.724666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d674b-b028-4375-9edf-e9fa8e42e15f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:04.724666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d674b-b028-4375-9edf-e9fa8e42e15f None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:04.725992 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:26:04.731665 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e69e88-0c12-41c0-8cef-0f988788307d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:04.732125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e69e88-0c12-41c0-8cef-0f988788307d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:04.732230 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e69e88-0c12-41c0-8cef-0f988788307d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:04.738562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=81 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:04.753154 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-50e69e88-0c12-41c0-8cef-0f988788307d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:26:04.754396 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-50e69e88-0c12-41c0-8cef-0f988788307d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:04.762341 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:26:05.069777 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d674b-b028-4375-9edf-e9fa8e42e15f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:05.071520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-222d674b-b028-4375-9edf-e9fa8e42e15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:05.139208 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:05.156282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d674b-b028-4375-9edf-e9fa8e42e15f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:05.160244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ae87c-547c-4370-a222-c3b73856a8a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:05.160962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ae87c-547c-4370-a222-c3b73856a8a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:05.161277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ae87c-547c-4370-a222-c3b73856a8a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:05.161565 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ae87c-547c-4370-a222-c3b73856a8a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:05.171294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ae87c-547c-4370-a222-c3b73856a8a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:05.172731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ae87c-547c-4370-a222-c3b73856a8a4 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:05.182180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 772/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:26:07.241806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1292da-27ba-4763-8658-a71a39612213 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:07.242369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1292da-27ba-4763-8658-a71a39612213 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:07.242369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1292da-27ba-4763-8658-a71a39612213 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:07.243739 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:26:07.249083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6a29d-8cbb-4c29-8243-b9adaa7ace39 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:07.249548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6a29d-8cbb-4c29-8243-b9adaa7ace39 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:07.249653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6a29d-8cbb-4c29-8243-b9adaa7ace39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:07.267942 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5ff6a29d-8cbb-4c29-8243-b9adaa7ace39 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:26:07.269131 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5ff6a29d-8cbb-4c29-8243-b9adaa7ace39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:07.277313 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:26:07.575251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1292da-27ba-4763-8658-a71a39612213 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:07.577165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0c1292da-27ba-4763-8658-a71a39612213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:07.590055 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1292da-27ba-4763-8658-a71a39612213 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:07.593605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ea24a-103c-42f4-a437-db670ccae0ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:07.594240 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea24a-103c-42f4-a437-db670ccae0ef service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:07.594524 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea24a-103c-42f4-a437-db670ccae0ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:07.594801 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea24a-103c-42f4-a437-db670ccae0ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:07.604153 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ea24a-103c-42f4-a437-db670ccae0ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:07.605616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ea24a-103c-42f4-a437-db670ccae0ef service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:07.614803 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 766/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:26:17.262407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=11 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:17.610759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=8 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:39.889467 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022668e-baa6-4a60-bb3a-e63c740dfc42 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:39.890112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022668e-baa6-4a60-bb3a-e63c740dfc42 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:39.890112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022668e-baa6-4a60-bb3a-e63c740dfc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:39.921804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c022668e-baa6-4a60-bb3a-e63c740dfc42 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:39.923097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c022668e-baa6-4a60-bb3a-e63c740dfc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:39.937318 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 774/1540] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:39.946877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53baf0-0dbe-40ad-88bc-ab706e0383de None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:39.947938 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53baf0-0dbe-40ad-88bc-ab706e0383de None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:39.948453 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53baf0-0dbe-40ad-88bc-ab706e0383de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:39.982232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ca53baf0-0dbe-40ad-88bc-ab706e0383de None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:39.983852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ca53baf0-0dbe-40ad-88bc-ab706e0383de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.004707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 767/1541] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:40.008927 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022668e-baa6-4a60-bb3a-e63c740dfc42 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.023076 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022668e-baa6-4a60-bb3a-e63c740dfc42 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.034072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f49bc5-e638-4fa0-8899-f253f21d31a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.035054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f49bc5-e638-4fa0-8899-f253f21d31a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.035520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f49bc5-e638-4fa0-8899-f253f21d31a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.035957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f49bc5-e638-4fa0-8899-f253f21d31a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.036868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f49bc5-e638-4fa0-8899-f253f21d31a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:40.037349 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f49bc5-e638-4fa0-8899-f253f21d31a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.039307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f49bc5-e638-4fa0-8899-f253f21d31a5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.053398 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 775/1542] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:40.062052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53baf0-0dbe-40ad-88bc-ab706e0383de None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.079914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53baf0-0dbe-40ad-88bc-ab706e0383de None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.089991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0c194-59c8-484a-8eb5-869ef09a7b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.090671 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0c194-59c8-484a-8eb5-869ef09a7b2a admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.090959 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0c194-59c8-484a-8eb5-869ef09a7b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.091238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0c194-59c8-484a-8eb5-869ef09a7b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.091954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0c194-59c8-484a-8eb5-869ef09a7b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.093926 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0c194-59c8-484a-8eb5-869ef09a7b2a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.147811 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 768/1543] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:40.152150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0c194-59c8-484a-8eb5-869ef09a7b2a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.153238 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328a960-8110-42ba-8c25-1441b7520e02 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.153788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328a960-8110-42ba-8c25-1441b7520e02 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.154279 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328a960-8110-42ba-8c25-1441b7520e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.190425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-0328a960-8110-42ba-8c25-1441b7520e02 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:40.192022 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0328a960-8110-42ba-8c25-1441b7520e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.255860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0c194-59c8-484a-8eb5-869ef09a7b2a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.270877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8bdfa-b2bc-4834-a16f-e97fe7a0bf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.272073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8bdfa-b2bc-4834-a16f-e97fe7a0bf89 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.272358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8bdfa-b2bc-4834-a16f-e97fe7a0bf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.272634 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8bdfa-b2bc-4834-a16f-e97fe7a0bf89 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.273370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8bdfa-b2bc-4834-a16f-e97fe7a0bf89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.274418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: WARNING py.warnings [None req-46b8bdfa-b2bc-4834-a16f-e97fe7a0bf89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:27:40.274418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: warnings.warn(msg) Jul 12 18:27:40.274418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: Jul 12 18:27:40.275633 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8bdfa-b2bc-4834-a16f-e97fe7a0bf89 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.307524 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 769/1544] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:40.308799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10369b-0119-4f6f-854b-aa87558606ba None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.309143 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10369b-0119-4f6f-854b-aa87558606ba None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.314615 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10369b-0119-4f6f-854b-aa87558606ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.324352 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 776/1545] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:40.325784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328a960-8110-42ba-8c25-1441b7520e02 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.346660 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328a960-8110-42ba-8c25-1441b7520e02 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.353279 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-da10369b-0119-4f6f-854b-aa87558606ba None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:40.353279 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-da10369b-0119-4f6f-854b-aa87558606ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.363856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f617e5-b06c-4e75-b0a5-cb8666edf40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.364550 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f617e5-b06c-4e75-b0a5-cb8666edf40e admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.364842 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f617e5-b06c-4e75-b0a5-cb8666edf40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.365121 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f617e5-b06c-4e75-b0a5-cb8666edf40e admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.365887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f617e5-b06c-4e75-b0a5-cb8666edf40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.367503 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f617e5-b06c-4e75-b0a5-cb8666edf40e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.370648 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 770/1546] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:40.372103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a269d-e8af-4c3f-aec7-d10db784b3e9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.372390 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a269d-e8af-4c3f-aec7-d10db784b3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.372665 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a269d-e8af-4c3f-aec7-d10db784b3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.401229 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 777/1547] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:40.402458 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e13533-acc2-4e7c-99be-ce1185d70919 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.407337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e13533-acc2-4e7c-99be-ce1185d70919 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.407637 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e13533-acc2-4e7c-99be-ce1185d70919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.425196 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a17a269d-e8af-4c3f-aec7-d10db784b3e9 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:40.426450 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a17a269d-e8af-4c3f-aec7-d10db784b3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.448944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 771/1548] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:40.454627 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccedf5-85e4-4a8a-90b2-ec7d8373edc8 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.455354 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccedf5-85e4-4a8a-90b2-ec7d8373edc8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.455829 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccedf5-85e4-4a8a-90b2-ec7d8373edc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.460525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b6e13533-acc2-4e7c-99be-ce1185d70919 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:40.461794 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b6e13533-acc2-4e7c-99be-ce1185d70919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.480322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 778/1549] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:40.483319 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e13533-acc2-4e7c-99be-ce1185d70919 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.487578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-59ccedf5-85e4-4a8a-90b2-ec7d8373edc8 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:40.488812 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-59ccedf5-85e4-4a8a-90b2-ec7d8373edc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.495585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e13533-acc2-4e7c-99be-ce1185d70919 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.498432 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 772/1550] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:40.499522 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e316336-4307-49ee-ace6-42d108ed081e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.499807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e316336-4307-49ee-ace6-42d108ed081e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.500083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e316336-4307-49ee-ace6-42d108ed081e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.500862 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2d260-87ea-473f-af10-b50be30a0f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.502395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2d260-87ea-473f-af10-b50be30a0f58 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.502678 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2d260-87ea-473f-af10-b50be30a0f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.502949 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2d260-87ea-473f-af10-b50be30a0f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.503664 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2d260-87ea-473f-af10-b50be30a0f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.505273 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2d260-87ea-473f-af10-b50be30a0f58 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.518502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 779/1551] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:40.519374 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2d260-87ea-473f-af10-b50be30a0f58 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.527086 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6e316336-4307-49ee-ace6-42d108ed081e None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:40.528295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6e316336-4307-49ee-ace6-42d108ed081e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.528886 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2d260-87ea-473f-af10-b50be30a0f58 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.533490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d061f3-0cec-40f1-a2ac-b1d258d38fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.534128 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d061f3-0cec-40f1-a2ac-b1d258d38fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.534407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d061f3-0cec-40f1-a2ac-b1d258d38fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.534669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d061f3-0cec-40f1-a2ac-b1d258d38fa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.535377 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d061f3-0cec-40f1-a2ac-b1d258d38fa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:40.535674 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d061f3-0cec-40f1-a2ac-b1d258d38fa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.536592 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 773/1552] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:40.537268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d061f3-0cec-40f1-a2ac-b1d258d38fa4 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.537405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e316336-4307-49ee-ace6-42d108ed081e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.546953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e316336-4307-49ee-ace6-42d108ed081e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.552139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17ea04-bd37-4a0e-99f9-6a7869319df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.552783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17ea04-bd37-4a0e-99f9-6a7869319df5 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.553067 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17ea04-bd37-4a0e-99f9-6a7869319df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.553381 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17ea04-bd37-4a0e-99f9-6a7869319df5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.554106 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17ea04-bd37-4a0e-99f9-6a7869319df5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:40.554415 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17ea04-bd37-4a0e-99f9-6a7869319df5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.555432 dv-cinder-835384-15-smb devstack@keystone.service[80227]: WARNING py.warnings [None req-bb17ea04-bd37-4a0e-99f9-6a7869319df5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:27:40.555432 dv-cinder-835384-15-smb devstack@keystone.service[80227]: warnings.warn(msg) Jul 12 18:27:40.555432 dv-cinder-835384-15-smb devstack@keystone.service[80227]: Jul 12 18:27:40.555673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 780/1553] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:40.556320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17ea04-bd37-4a0e-99f9-6a7869319df5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.556709 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596f451-2cd2-4304-bea6-1a17fba752d6 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.556994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596f451-2cd2-4304-bea6-1a17fba752d6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.557290 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596f451-2cd2-4304-bea6-1a17fba752d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.571463 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 774/1554] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:40.572775 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c6602-c340-43ec-96fd-f51fc2112e16 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.573084 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c6602-c340-43ec-96fd-f51fc2112e16 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.580331 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c6602-c340-43ec-96fd-f51fc2112e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.580965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4596f451-2cd2-4304-bea6-1a17fba752d6 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:40.582518 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4596f451-2cd2-4304-bea6-1a17fba752d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.590576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 781/1555] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:40.591798 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f279e-9bdb-406f-b513-cbdd04b8fb3a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.592106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f279e-9bdb-406f-b513-cbdd04b8fb3a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.592501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f279e-9bdb-406f-b513-cbdd04b8fb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.593308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-bf5c6602-c340-43ec-96fd-f51fc2112e16 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:40.594706 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-bf5c6602-c340-43ec-96fd-f51fc2112e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.602835 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 775/1556] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:40.604056 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5562dc-89cc-4035-9d6b-9845c86ff884 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.604341 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5562dc-89cc-4035-9d6b-9845c86ff884 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.604997 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5562dc-89cc-4035-9d6b-9845c86ff884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.610159 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-111f279e-9bdb-406f-b513-cbdd04b8fb3a None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:40.611867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-111f279e-9bdb-406f-b513-cbdd04b8fb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.619682 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 782/1557] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:40.620420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f279e-9bdb-406f-b513-cbdd04b8fb3a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.622815 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1e5562dc-89cc-4035-9d6b-9845c86ff884 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:40.624010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1e5562dc-89cc-4035-9d6b-9845c86ff884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.630191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f279e-9bdb-406f-b513-cbdd04b8fb3a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.632703 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 776/1558] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:40.634205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0625a6-5d37-46f2-b00a-f3bc770cdbd9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.634496 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0625a6-5d37-46f2-b00a-f3bc770cdbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.634777 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0625a6-5d37-46f2-b00a-f3bc770cdbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.635303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9e925-2c99-404c-9a39-0c19e6029023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.636181 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9e925-2c99-404c-9a39-0c19e6029023 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.636467 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9e925-2c99-404c-9a39-0c19e6029023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.636744 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9e925-2c99-404c-9a39-0c19e6029023 admin admin] PATH_INFO: `/v3/projects/5ee911f05869464b936cc4516a115f80/users/11fcce5b21a948c8b98a535c0af07306/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.651596 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9e925-2c99-404c-9a39-0c19e6029023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee911f05869464b936cc4516a115f80, user_id=11fcce5b21a948c8b98a535c0af07306, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.652067 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ce0625a6-5d37-46f2-b00a-f3bc770cdbd9 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:40.652626 dv-cinder-835384-15-smb devstack@keystone.service[80226]: WARNING py.warnings [None req-6db9e925-2c99-404c-9a39-0c19e6029023 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:27:40.652626 dv-cinder-835384-15-smb devstack@keystone.service[80226]: warnings.warn(msg) Jul 12 18:27:40.652626 dv-cinder-835384-15-smb devstack@keystone.service[80226]: Jul 12 18:27:40.653273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ce0625a6-5d37-46f2-b00a-f3bc770cdbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.654597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9e925-2c99-404c-9a39-0c19e6029023 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.662829 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 777/1559] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:40.663492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0625a6-5d37-46f2-b00a-f3bc770cdbd9 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.672685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0625a6-5d37-46f2-b00a-f3bc770cdbd9 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.674137 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 783/1560] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:40 2022] PUT /identity/v3/projects/5ee911f05869464b936cc4516a115f80/users/11fcce5b21a948c8b98a535c0af07306/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:40.674934 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9e925-2c99-404c-9a39-0c19e6029023 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.722314 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:40.732977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f1167-297c-4b8b-afe1-0fad6fbb3e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.733682 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f1167-297c-4b8b-afe1-0fad6fbb3e38 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.733964 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f1167-297c-4b8b-afe1-0fad6fbb3e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.734485 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f1167-297c-4b8b-afe1-0fad6fbb3e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.734922 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f1167-297c-4b8b-afe1-0fad6fbb3e38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.737539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f1167-297c-4b8b-afe1-0fad6fbb3e38 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.744714 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9e925-2c99-404c-9a39-0c19e6029023 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.749282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb2c57-a932-42d8-888e-c5f36ca90f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.749940 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb2c57-a932-42d8-888e-c5f36ca90f1a admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.750223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb2c57-a932-42d8-888e-c5f36ca90f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.750498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb2c57-a932-42d8-888e-c5f36ca90f1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.751225 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb2c57-a932-42d8-888e-c5f36ca90f1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.752249 dv-cinder-835384-15-smb devstack@keystone.service[80226]: WARNING py.warnings [None req-eebb2c57-a932-42d8-888e-c5f36ca90f1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:27:40.752249 dv-cinder-835384-15-smb devstack@keystone.service[80226]: warnings.warn(msg) Jul 12 18:27:40.752249 dv-cinder-835384-15-smb devstack@keystone.service[80226]: Jul 12 18:27:40.753428 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb2c57-a932-42d8-888e-c5f36ca90f1a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.757502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:40.762705 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 778/1561] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:40.764075 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fcbc9-98d2-4716-a0b3-75b8cae60f74 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.764369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fcbc9-98d2-4716-a0b3-75b8cae60f74 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.764644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fcbc9-98d2-4716-a0b3-75b8cae60f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.782643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 784/1562] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:40.783929 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1b1fcbc9-98d2-4716-a0b3-75b8cae60f74 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:40.785120 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1b1fcbc9-98d2-4716-a0b3-75b8cae60f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.787046 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a045e54-873e-4929-ba76-4757d0a22d89 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.787343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a045e54-873e-4929-ba76-4757d0a22d89 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.787626 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a045e54-873e-4929-ba76-4757d0a22d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.805528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-7a045e54-873e-4929-ba76-4757d0a22d89 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:40.806721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7a045e54-873e-4929-ba76-4757d0a22d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.845285 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 779/1563] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:40.846294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fcbc9-98d2-4716-a0b3-75b8cae60f74 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.855320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fcbc9-98d2-4716-a0b3-75b8cae60f74 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.859926 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6389e6-de74-426a-89a9-a3f3624dda05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.861210 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6389e6-de74-426a-89a9-a3f3624dda05 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.861541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6389e6-de74-426a-89a9-a3f3624dda05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.861799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6389e6-de74-426a-89a9-a3f3624dda05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.862516 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6389e6-de74-426a-89a9-a3f3624dda05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:40.862825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6389e6-de74-426a-89a9-a3f3624dda05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.864475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6389e6-de74-426a-89a9-a3f3624dda05 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.868065 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 785/1564] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:40.869357 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38bc1b-d657-4ab4-83c9-54a9d2f999b2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.869649 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38bc1b-d657-4ab4-83c9-54a9d2f999b2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.869923 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38bc1b-d657-4ab4-83c9-54a9d2f999b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.883629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 780/1565] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:40.883629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6389e6-de74-426a-89a9-a3f3624dda05 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.887437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6389e6-de74-426a-89a9-a3f3624dda05 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.888030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5d38bc1b-d657-4ab4-83c9-54a9d2f999b2 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:40.889225 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5d38bc1b-d657-4ab4-83c9-54a9d2f999b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.892199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6ac14-4efd-4ef2-9a71-39244eb52a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.892833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6ac14-4efd-4ef2-9a71-39244eb52a37 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.893116 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6ac14-4efd-4ef2-9a71-39244eb52a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.894029 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6ac14-4efd-4ef2-9a71-39244eb52a37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.894753 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6ac14-4efd-4ef2-9a71-39244eb52a37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:40.895065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6ac14-4efd-4ef2-9a71-39244eb52a37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.896662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6ac14-4efd-4ef2-9a71-39244eb52a37 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.897276 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 786/1566] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:40.898473 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c13f6-b3ef-40dc-9e33-84bb2dd35368 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.898762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c13f6-b3ef-40dc-9e33-84bb2dd35368 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.899457 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c13f6-b3ef-40dc-9e33-84bb2dd35368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.910150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 781/1567] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:40.911007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6ac14-4efd-4ef2-9a71-39244eb52a37 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.920481 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6ac14-4efd-4ef2-9a71-39244eb52a37 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.925963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e229f-3e13-4b0a-8e23-a9e97dd6a21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.926720 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e229f-3e13-4b0a-8e23-a9e97dd6a21d admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.927009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e229f-3e13-4b0a-8e23-a9e97dd6a21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.927280 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e229f-3e13-4b0a-8e23-a9e97dd6a21d admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.927954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e229f-3e13-4b0a-8e23-a9e97dd6a21d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.929901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e229f-3e13-4b0a-8e23-a9e97dd6a21d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.932227 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-864c13f6-b3ef-40dc-9e33-84bb2dd35368 None None] MFA Rules not processed for user `11fcce5b21a948c8b98a535c0af07306`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:40.933473 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-864c13f6-b3ef-40dc-9e33-84bb2dd35368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.949874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 782/1568] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/users => generated 297 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:40.950831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e229f-3e13-4b0a-8e23-a9e97dd6a21d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.960772 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e229f-3e13-4b0a-8e23-a9e97dd6a21d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.965519 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de17d8-0c34-467f-b0cb-f16ed625729e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.966167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de17d8-0c34-467f-b0cb-f16ed625729e admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.966452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de17d8-0c34-467f-b0cb-f16ed625729e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.966730 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de17d8-0c34-467f-b0cb-f16ed625729e admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.967406 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de17d8-0c34-467f-b0cb-f16ed625729e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.969369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de17d8-0c34-467f-b0cb-f16ed625729e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.992954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 783/1569] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/users => generated 289 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:40.992954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de17d8-0c34-467f-b0cb-f16ed625729e admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.003203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de17d8-0c34-467f-b0cb-f16ed625729e admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.005566 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 787/1570] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:41.006391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c13f6-b3ef-40dc-9e33-84bb2dd35368 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.008655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9a2e4-8a4b-4ea6-93ea-bc3ba68e1237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.009456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9a2e4-8a4b-4ea6-93ea-bc3ba68e1237 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.009894 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9a2e4-8a4b-4ea6-93ea-bc3ba68e1237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.010266 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9a2e4-8a4b-4ea6-93ea-bc3ba68e1237 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.011005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9a2e4-8a4b-4ea6-93ea-bc3ba68e1237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:41.011317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9a2e4-8a4b-4ea6-93ea-bc3ba68e1237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.012962 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9a2e4-8a4b-4ea6-93ea-bc3ba68e1237 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.025729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c13f6-b3ef-40dc-9e33-84bb2dd35368 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.026477 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 784/1571] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:41.027335 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9a2e4-8a4b-4ea6-93ea-bc3ba68e1237 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.034919 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31876f5c-dc85-4c27-8be5-359592e55dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.035853 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31876f5c-dc85-4c27-8be5-359592e55dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.036143 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31876f5c-dc85-4c27-8be5-359592e55dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.036424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31876f5c-dc85-4c27-8be5-359592e55dc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.037159 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31876f5c-dc85-4c27-8be5-359592e55dc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:41.037556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31876f5c-dc85-4c27-8be5-359592e55dc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.037923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9a2e4-8a4b-4ea6-93ea-bc3ba68e1237 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.039204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31876f5c-dc85-4c27-8be5-359592e55dc0 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.043641 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4e58a-01a1-4cad-ae09-748ecdd5bb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.044610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4e58a-01a1-4cad-ae09-748ecdd5bb30 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.044901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4e58a-01a1-4cad-ae09-748ecdd5bb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.045182 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4e58a-01a1-4cad-ae09-748ecdd5bb30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.045972 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4e58a-01a1-4cad-ae09-748ecdd5bb30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.047870 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4e58a-01a1-4cad-ae09-748ecdd5bb30 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.053292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 788/1572] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:41.053951 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31876f5c-dc85-4c27-8be5-359592e55dc0 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.064845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31876f5c-dc85-4c27-8be5-359592e55dc0 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.069826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454d2a0-bc0e-4b2c-9d9c-2beca5b96c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.070482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454d2a0-bc0e-4b2c-9d9c-2beca5b96c86 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.070767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454d2a0-bc0e-4b2c-9d9c-2beca5b96c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.071042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454d2a0-bc0e-4b2c-9d9c-2beca5b96c86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.071908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454d2a0-bc0e-4b2c-9d9c-2beca5b96c86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:41.072220 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454d2a0-bc0e-4b2c-9d9c-2beca5b96c86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.073839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454d2a0-bc0e-4b2c-9d9c-2beca5b96c86 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.077087 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 785/1573] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:41 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:41.077928 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4e58a-01a1-4cad-ae09-748ecdd5bb30 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.094323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 789/1574] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:41.094323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454d2a0-bc0e-4b2c-9d9c-2beca5b96c86 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.098995 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454d2a0-bc0e-4b2c-9d9c-2beca5b96c86 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.123337 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:41.139696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:41.140660 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4e58a-01a1-4cad-ae09-748ecdd5bb30 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.145851 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f61bdf-5d66-4720-a640-84a360d9ccc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.146576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f61bdf-5d66-4720-a640-84a360d9ccc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.146777 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f61bdf-5d66-4720-a640-84a360d9ccc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.147051 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f61bdf-5d66-4720-a640-84a360d9ccc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.147730 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f61bdf-5d66-4720-a640-84a360d9ccc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.149655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f61bdf-5d66-4720-a640-84a360d9ccc5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.155651 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bb93d-ff29-42e3-8581-60e09f0ce8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.156317 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bb93d-ff29-42e3-8581-60e09f0ce8fe admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.156596 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bb93d-ff29-42e3-8581-60e09f0ce8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.156876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bb93d-ff29-42e3-8581-60e09f0ce8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.158203 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bb93d-ff29-42e3-8581-60e09f0ce8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.159801 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bb93d-ff29-42e3-8581-60e09f0ce8fe admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.169639 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 790/1575] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:41.170437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bb93d-ff29-42e3-8581-60e09f0ce8fe admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.179324 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 786/1576] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:41 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:41.179324 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f61bdf-5d66-4720-a640-84a360d9ccc5 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.182021 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bb93d-ff29-42e3-8581-60e09f0ce8fe admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.237320 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd3e46-5b0e-4db1-b97e-f642a128c248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.237980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd3e46-5b0e-4db1-b97e-f642a128c248 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.238266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd3e46-5b0e-4db1-b97e-f642a128c248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.238547 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd3e46-5b0e-4db1-b97e-f642a128c248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.239246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd3e46-5b0e-4db1-b97e-f642a128c248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.240569 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f61bdf-5d66-4720-a640-84a360d9ccc5 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.240835 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd3e46-5b0e-4db1-b97e-f642a128c248 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.245288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f755711-6b4b-43d8-a5e8-b6c86ad137fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.245950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f755711-6b4b-43d8-a5e8-b6c86ad137fd admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.246231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f755711-6b4b-43d8-a5e8-b6c86ad137fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.246506 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f755711-6b4b-43d8-a5e8-b6c86ad137fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.247185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f755711-6b4b-43d8-a5e8-b6c86ad137fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.249074 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f755711-6b4b-43d8-a5e8-b6c86ad137fd admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.250440 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 791/1577] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:41.251702 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddf3e2-f8f5-48f3-a42e-e352d09c94c7 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.251994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddf3e2-f8f5-48f3-a42e-e352d09c94c7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.252256 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddf3e2-f8f5-48f3-a42e-e352d09c94c7 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.253654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 792/1578] 10.222.0.57 () {54 vars in 961 bytes} [Tue Jul 12 18:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:27:41.258019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddf3e2-f8f5-48f3-a42e-e352d09c94c7 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.271228 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddf3e2-f8f5-48f3-a42e-e352d09c94c7 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.275832 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe90a2a-bd42-4832-8935-99ce198da0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.276235 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 787/1579] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:41 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:41.276467 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe90a2a-bd42-4832-8935-99ce198da0cc admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.276751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe90a2a-bd42-4832-8935-99ce198da0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.277026 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f755711-6b4b-43d8-a5e8-b6c86ad137fd admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.277132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe90a2a-bd42-4832-8935-99ce198da0cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.277751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe90a2a-bd42-4832-8935-99ce198da0cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.279666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe90a2a-bd42-4832-8935-99ce198da0cc admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.305295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 793/1580] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:41 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:41.306002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe90a2a-bd42-4832-8935-99ce198da0cc admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.343016 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f755711-6b4b-43d8-a5e8-b6c86ad137fd admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.369071 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe90a2a-bd42-4832-8935-99ce198da0cc admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.373737 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f05c1-3a3e-494c-ac20-6d5ee3ba08dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.374392 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f05c1-3a3e-494c-ac20-6d5ee3ba08dc admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.374677 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f05c1-3a3e-494c-ac20-6d5ee3ba08dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.374978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f05c1-3a3e-494c-ac20-6d5ee3ba08dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.375651 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f05c1-3a3e-494c-ac20-6d5ee3ba08dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.377630 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f05c1-3a3e-494c-ac20-6d5ee3ba08dc admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.399255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e6b02-ae42-4b38-bbee-c3f24515968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.399957 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e6b02-ae42-4b38-bbee-c3f24515968a admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.400241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e6b02-ae42-4b38-bbee-c3f24515968a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.400540 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e6b02-ae42-4b38-bbee-c3f24515968a admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.401226 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e6b02-ae42-4b38-bbee-c3f24515968a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.403196 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e6b02-ae42-4b38-bbee-c3f24515968a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.406617 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 794/1581] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:41 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:41.406617 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f05c1-3a3e-494c-ac20-6d5ee3ba08dc admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.410769 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:41.425584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 788/1582] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:41 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:41.426358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e6b02-ae42-4b38-bbee-c3f24515968a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.435701 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e6b02-ae42-4b38-bbee-c3f24515968a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.451675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:41.473309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f05c1-3a3e-494c-ac20-6d5ee3ba08dc admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.477983 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd9c53-fb3c-445b-8bd9-6f1be0f24c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.478644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd9c53-fb3c-445b-8bd9-6f1be0f24c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.478925 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd9c53-fb3c-445b-8bd9-6f1be0f24c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.479199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd9c53-fb3c-445b-8bd9-6f1be0f24c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.479920 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd9c53-fb3c-445b-8bd9-6f1be0f24c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.481563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd9c53-fb3c-445b-8bd9-6f1be0f24c41 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.491260 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 795/1583] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:41.492041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd9c53-fb3c-445b-8bd9-6f1be0f24c41 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.495375 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aef6f-85a2-4b53-bb74-f11789566689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.496599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aef6f-85a2-4b53-bb74-f11789566689 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.496892 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aef6f-85a2-4b53-bb74-f11789566689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.497175 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aef6f-85a2-4b53-bb74-f11789566689 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.497927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7aef6f-85a2-4b53-bb74-f11789566689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.499968 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7aef6f-85a2-4b53-bb74-f11789566689 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.504376 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd9c53-fb3c-445b-8bd9-6f1be0f24c41 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.508936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcf048-28b8-4fac-bb2a-42896615ab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.509601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcf048-28b8-4fac-bb2a-42896615ab29 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.509885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcf048-28b8-4fac-bb2a-42896615ab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.510161 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcf048-28b8-4fac-bb2a-42896615ab29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.510870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcf048-28b8-4fac-bb2a-42896615ab29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.512439 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcf048-28b8-4fac-bb2a-42896615ab29 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.522164 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 789/1584] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:41 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:41.523279 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 796/1585] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:41.523552 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0d846-3758-4502-a5af-d7ef56a65bd2 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.523971 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcf048-28b8-4fac-bb2a-42896615ab29 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.524098 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0d846-3758-4502-a5af-d7ef56a65bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.524394 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0d846-3758-4502-a5af-d7ef56a65bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.534358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcf048-28b8-4fac-bb2a-42896615ab29 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.541925 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f49ba4-532a-420f-8928-fb0e6272c7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.544610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f49ba4-532a-420f-8928-fb0e6272c7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.544610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f49ba4-532a-420f-8928-fb0e6272c7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.544610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f49ba4-532a-420f-8928-fb0e6272c7b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.544610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f49ba4-532a-420f-8928-fb0e6272c7b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.546185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f49ba4-532a-420f-8928-fb0e6272c7b7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.564510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ffe0d846-3758-4502-a5af-d7ef56a65bd2 None None] MFA Rules not processed for user `a7c1bb51c2b642ffa4708122d826fc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:41.565815 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ffe0d846-3758-4502-a5af-d7ef56a65bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:41.570057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 797/1586] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:41 2022] POST /identity/v3/users => generated 290 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:41.570818 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f49ba4-532a-420f-8928-fb0e6272c7b7 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.581221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f49ba4-532a-420f-8928-fb0e6272c7b7 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.585830 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c3d9d-b630-46e6-89f1-12e787ea5591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.586485 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c3d9d-b630-46e6-89f1-12e787ea5591 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.586766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c3d9d-b630-46e6-89f1-12e787ea5591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.587042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c3d9d-b630-46e6-89f1-12e787ea5591 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.587720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c3d9d-b630-46e6-89f1-12e787ea5591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.589669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c3d9d-b630-46e6-89f1-12e787ea5591 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.608614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 798/1587] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:41 2022] POST /identity/v3/users => generated 293 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:41.609550 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c3d9d-b630-46e6-89f1-12e787ea5591 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.619027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c3d9d-b630-46e6-89f1-12e787ea5591 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.623630 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea73718-c51e-4514-8185-4d8f4a04bc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.624277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea73718-c51e-4514-8185-4d8f4a04bc60 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.624549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea73718-c51e-4514-8185-4d8f4a04bc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.624871 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea73718-c51e-4514-8185-4d8f4a04bc60 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.625558 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea73718-c51e-4514-8185-4d8f4a04bc60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.627938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea73718-c51e-4514-8185-4d8f4a04bc60 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.643197 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 790/1588] 10.222.0.57 () {58 vars in 1058 bytes} [Tue Jul 12 18:27:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:41.644050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0d846-3758-4502-a5af-d7ef56a65bd2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.650049 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 799/1589] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:41 2022] POST /identity/v3/users => generated 284 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:41.651178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea73718-c51e-4514-8185-4d8f4a04bc60 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.657744 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0d846-3758-4502-a5af-d7ef56a65bd2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.660483 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea73718-c51e-4514-8185-4d8f4a04bc60 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.662569 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45269958-dd1c-4aac-beb6-9db1dbc6ebf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.663225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45269958-dd1c-4aac-beb6-9db1dbc6ebf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.663511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45269958-dd1c-4aac-beb6-9db1dbc6ebf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.663784 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45269958-dd1c-4aac-beb6-9db1dbc6ebf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.664558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45269958-dd1c-4aac-beb6-9db1dbc6ebf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.665249 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75266f0-a89a-49ae-93b5-2e1e8e52c40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.666134 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75266f0-a89a-49ae-93b5-2e1e8e52c40e admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.666241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45269958-dd1c-4aac-beb6-9db1dbc6ebf7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.666413 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75266f0-a89a-49ae-93b5-2e1e8e52c40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.666684 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75266f0-a89a-49ae-93b5-2e1e8e52c40e admin admin] PATH_INFO: `/v3/projects/5d1a5e9995dc427cb44b3ed259263932/users/b42aeef31b0449af97c3da52e27307fa/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.676447 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 791/1590] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:41.677243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45269958-dd1c-4aac-beb6-9db1dbc6ebf7 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.684707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75266f0-a89a-49ae-93b5-2e1e8e52c40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1a5e9995dc427cb44b3ed259263932, user_id=b42aeef31b0449af97c3da52e27307fa, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.686623 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45269958-dd1c-4aac-beb6-9db1dbc6ebf7 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.687666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75266f0-a89a-49ae-93b5-2e1e8e52c40e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.691772 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30fdd1-c294-42e3-8054-3bdc75b87b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.692749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30fdd1-c294-42e3-8054-3bdc75b87b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.693034 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30fdd1-c294-42e3-8054-3bdc75b87b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.693475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30fdd1-c294-42e3-8054-3bdc75b87b99 admin admin] PATH_INFO: `/v3/projects/3bc90cefafe64b28a3e79b304290191f/users/c56ca5f1b01b4d2990e73c136b606ce1/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.701667 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 800/1591] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:41 2022] PUT /identity/v3/projects/5d1a5e9995dc427cb44b3ed259263932/users/b42aeef31b0449af97c3da52e27307fa/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:41.702465 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75266f0-a89a-49ae-93b5-2e1e8e52c40e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.711566 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30fdd1-c294-42e3-8054-3bdc75b87b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc90cefafe64b28a3e79b304290191f, user_id=c56ca5f1b01b4d2990e73c136b606ce1, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.714414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30fdd1-c294-42e3-8054-3bdc75b87b99 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.727307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 792/1592] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:41 2022] PUT /identity/v3/projects/3bc90cefafe64b28a3e79b304290191f/users/c56ca5f1b01b4d2990e73c136b606ce1/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:41.728222 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30fdd1-c294-42e3-8054-3bdc75b87b99 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.761636 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:41.763848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75266f0-a89a-49ae-93b5-2e1e8e52c40e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.801489 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30fdd1-c294-42e3-8054-3bdc75b87b99 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.806346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82464837-321c-44db-934e-eaa5724fee4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.807012 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464837-321c-44db-934e-eaa5724fee4d admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.807329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464837-321c-44db-934e-eaa5724fee4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.807601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464837-321c-44db-934e-eaa5724fee4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.808422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82464837-321c-44db-934e-eaa5724fee4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.809973 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82464837-321c-44db-934e-eaa5724fee4d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.816804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:41.820128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 793/1593] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:41.820128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82464837-321c-44db-934e-eaa5724fee4d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.826149 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c03f8-feba-41a5-95e6-d91009e6a6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.826848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c03f8-feba-41a5-95e6-d91009e6a6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.827129 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c03f8-feba-41a5-95e6-d91009e6a6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.827452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c03f8-feba-41a5-95e6-d91009e6a6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.828179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c03f8-feba-41a5-95e6-d91009e6a6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.830327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c03f8-feba-41a5-95e6-d91009e6a6b1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.831795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82464837-321c-44db-934e-eaa5724fee4d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.836329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da915b-b123-4998-bb5a-458f87f15ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.836995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da915b-b123-4998-bb5a-458f87f15ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.837500 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da915b-b123-4998-bb5a-458f87f15ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.837622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da915b-b123-4998-bb5a-458f87f15ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.838290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da915b-b123-4998-bb5a-458f87f15ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.839863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da915b-b123-4998-bb5a-458f87f15ea6 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.841126 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 801/1594] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:41.842142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c03f8-feba-41a5-95e6-d91009e6a6b1 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.853719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 794/1595] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:41.853719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da915b-b123-4998-bb5a-458f87f15ea6 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.861132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da915b-b123-4998-bb5a-458f87f15ea6 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.865920 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb500a7-494d-45fa-89f7-dda6458f6b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.866541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb500a7-494d-45fa-89f7-dda6458f6b08 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.866825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb500a7-494d-45fa-89f7-dda6458f6b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.867101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb500a7-494d-45fa-89f7-dda6458f6b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.867807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb500a7-494d-45fa-89f7-dda6458f6b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.869401 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb500a7-494d-45fa-89f7-dda6458f6b08 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.879168 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 795/1596] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:41.879920 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb500a7-494d-45fa-89f7-dda6458f6b08 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.889466 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb500a7-494d-45fa-89f7-dda6458f6b08 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.894695 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f49d06-8746-4b30-921f-769b0241c5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.895359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f49d06-8746-4b30-921f-769b0241c5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.895663 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f49d06-8746-4b30-921f-769b0241c5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.895950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f49d06-8746-4b30-921f-769b0241c5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.896697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f49d06-8746-4b30-921f-769b0241c5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.898348 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f49d06-8746-4b30-921f-769b0241c5d6 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.909161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 796/1597] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:41.910405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7ec6a-f799-4404-8d71-ad80d918059d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.910697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7ec6a-f799-4404-8d71-ad80d918059d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.910976 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7ec6a-f799-4404-8d71-ad80d918059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.915928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c03f8-feba-41a5-95e6-d91009e6a6b1 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.922285 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdc560-19cf-462b-bf4e-3c26929dcf11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.922959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdc560-19cf-462b-bf4e-3c26929dcf11 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.923242 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdc560-19cf-462b-bf4e-3c26929dcf11 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.923627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdc560-19cf-462b-bf4e-3c26929dcf11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.927540 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6fa7ec6a-f799-4404-8d71-ad80d918059d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:41.928721 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6fa7ec6a-f799-4404-8d71-ad80d918059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:41.936118 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 797/1598] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:41.939456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4334-ee79-42e7-9c35-84ce93328c7c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.939456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4334-ee79-42e7-9c35-84ce93328c7c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.939456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4334-ee79-42e7-9c35-84ce93328c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.967509 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ea2d4334-ee79-42e7-9c35-84ce93328c7c None None] MFA Rules not processed for user `c56ca5f1b01b4d2990e73c136b606ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:41.968708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ea2d4334-ee79-42e7-9c35-84ce93328c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:41.982006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fdc560-19cf-462b-bf4e-3c26929dcf11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.983599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fdc560-19cf-462b-bf4e-3c26929dcf11 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.992619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 802/1599] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:41.993451 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdc560-19cf-462b-bf4e-3c26929dcf11 service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:42.003277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdc560-19cf-462b-bf4e-3c26929dcf11 service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:42.007820 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d594380-a740-4d59-8681-4510fd360dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:42.008587 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d594380-a740-4d59-8681-4510fd360dce admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.008866 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d594380-a740-4d59-8681-4510fd360dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.009136 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d594380-a740-4d59-8681-4510fd360dce admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.009980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d594380-a740-4d59-8681-4510fd360dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:42.011540 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d594380-a740-4d59-8681-4510fd360dce admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:42.022133 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 803/1600] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:42.022754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d594380-a740-4d59-8681-4510fd360dce admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:42.033174 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d594380-a740-4d59-8681-4510fd360dce admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:42.038671 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2984711-95d1-4ddd-a6c5-b598cce933a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:42.039418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2984711-95d1-4ddd-a6c5-b598cce933a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.039800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2984711-95d1-4ddd-a6c5-b598cce933a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.040431 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2984711-95d1-4ddd-a6c5-b598cce933a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.041227 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2984711-95d1-4ddd-a6c5-b598cce933a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:42.042921 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2984711-95d1-4ddd-a6c5-b598cce933a7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:42.043534 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 798/1601] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:42.046074 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d4334-ee79-42e7-9c35-84ce93328c7c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:42.057458 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 804/1602] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:42.058309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2984711-95d1-4ddd-a6c5-b598cce933a7 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:42.059612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d4334-ee79-42e7-9c35-84ce93328c7c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:42.064507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092b7da-970f-4650-a135-470c683088e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:42.065022 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092b7da-970f-4650-a135-470c683088e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.065401 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092b7da-970f-4650-a135-470c683088e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.065739 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092b7da-970f-4650-a135-470c683088e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.066541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092b7da-970f-4650-a135-470c683088e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:42.068199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092b7da-970f-4650-a135-470c683088e4 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:42.068349 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2984711-95d1-4ddd-a6c5-b598cce933a7 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:42.076677 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdcb01-28e0-4e06-9b2b-1c058400a0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:42.077499 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdcb01-28e0-4e06-9b2b-1c058400a0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.077787 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdcb01-28e0-4e06-9b2b-1c058400a0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.078214 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdcb01-28e0-4e06-9b2b-1c058400a0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.079481 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdcb01-28e0-4e06-9b2b-1c058400a0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:42.082916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 799/1603] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:42.082916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092b7da-970f-4650-a135-470c683088e4 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:42.083124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdcb01-28e0-4e06-9b2b-1c058400a0c8 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:42.090694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092b7da-970f-4650-a135-470c683088e4 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:42.096583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 805/1604] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:42.096583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdcb01-28e0-4e06-9b2b-1c058400a0c8 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:42.099088 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65e5d2-5c87-4a88-be5e-76c183faff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:42.100058 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65e5d2-5c87-4a88-be5e-76c183faff7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.100415 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65e5d2-5c87-4a88-be5e-76c183faff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.100752 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65e5d2-5c87-4a88-be5e-76c183faff7f admin admin] PATH_INFO: `/v3/projects/5ece2104d99740fbaf75710d531106e8/users/1fc73723cc744362941270f74946b3eb/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.116405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65e5d2-5c87-4a88-be5e-76c183faff7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ece2104d99740fbaf75710d531106e8, user_id=1fc73723cc744362941270f74946b3eb, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:42.119303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65e5d2-5c87-4a88-be5e-76c183faff7f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:42.139679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 800/1605] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:42 2022] PUT /identity/v3/projects/5ece2104d99740fbaf75710d531106e8/users/1fc73723cc744362941270f74946b3eb/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:42.139679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65e5d2-5c87-4a88-be5e-76c183faff7f admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:42.155255 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdcb01-28e0-4e06-9b2b-1c058400a0c8 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:42.163825 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:42.181738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:42.210288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a2bf1-56c9-4a4e-82e7-7d6d3bdf2533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:42.211270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a2bf1-56c9-4a4e-82e7-7d6d3bdf2533 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.211562 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a2bf1-56c9-4a4e-82e7-7d6d3bdf2533 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.211841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a2bf1-56c9-4a4e-82e7-7d6d3bdf2533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.216181 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65e5d2-5c87-4a88-be5e-76c183faff7f admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:42.221885 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597cf90-8c82-4bc5-b160-d65a16211e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:42.222874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597cf90-8c82-4bc5-b160-d65a16211e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.223271 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597cf90-8c82-4bc5-b160-d65a16211e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.223377 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a2bf1-56c9-4a4e-82e7-7d6d3bdf2533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:42.223740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597cf90-8c82-4bc5-b160-d65a16211e62 admin admin] PATH_INFO: `/v3/projects/3ffb1cbeb9664655aa64e8754de4fe25/users/f16b40fe2b734406a6d1494f30e0c1e2/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.225121 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a2bf1-56c9-4a4e-82e7-7d6d3bdf2533 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:42.236931 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 806/1606] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:42.237774 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a2bf1-56c9-4a4e-82e7-7d6d3bdf2533 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:42.239176 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597cf90-8c82-4bc5-b160-d65a16211e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ffb1cbeb9664655aa64e8754de4fe25, user_id=f16b40fe2b734406a6d1494f30e0c1e2, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:42.241983 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597cf90-8c82-4bc5-b160-d65a16211e62 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:42.248580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a2bf1-56c9-4a4e-82e7-7d6d3bdf2533 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:42.256171 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 801/1607] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:42 2022] PUT /identity/v3/projects/3ffb1cbeb9664655aa64e8754de4fe25/users/f16b40fe2b734406a6d1494f30e0c1e2/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:42.257212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597cf90-8c82-4bc5-b160-d65a16211e62 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:42.318355 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f4242-5c01-40fa-a622-3f25c4394e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:42.318690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f4242-5c01-40fa-a622-3f25c4394e4b admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.319139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f4242-5c01-40fa-a622-3f25c4394e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.319456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f4242-5c01-40fa-a622-3f25c4394e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.320242 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f4242-5c01-40fa-a622-3f25c4394e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:42.322427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f4242-5c01-40fa-a622-3f25c4394e4b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:42.333790 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597cf90-8c82-4bc5-b160-d65a16211e62 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:42.339571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580126f2-742c-4ecc-aa4f-f4c814bc1092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:42.340536 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580126f2-742c-4ecc-aa4f-f4c814bc1092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.340896 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580126f2-742c-4ecc-aa4f-f4c814bc1092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.341176 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580126f2-742c-4ecc-aa4f-f4c814bc1092 admin admin] PATH_INFO: `/v3/projects/8fd33368d5364b958f9a3c372878458c/users/458c7882e646485aaefe49d8da63fed5/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.351348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 807/1608] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:42 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:42.352485 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f4242-5c01-40fa-a622-3f25c4394e4b admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:42.362184 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580126f2-742c-4ecc-aa4f-f4c814bc1092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd33368d5364b958f9a3c372878458c, user_id=458c7882e646485aaefe49d8da63fed5, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:42.365965 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580126f2-742c-4ecc-aa4f-f4c814bc1092 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:42.383173 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 802/1609] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:42 2022] PUT /identity/v3/projects/8fd33368d5364b958f9a3c372878458c/users/458c7882e646485aaefe49d8da63fed5/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:42.384101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580126f2-742c-4ecc-aa4f-f4c814bc1092 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:42.435655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f4242-5c01-40fa-a622-3f25c4394e4b admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:42.467203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580126f2-742c-4ecc-aa4f-f4c814bc1092 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:42.472521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b375fd-f4ca-40bd-b004-c1b3c04f6783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:42.473797 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b375fd-f4ca-40bd-b004-c1b3c04f6783 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.474177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b375fd-f4ca-40bd-b004-c1b3c04f6783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.475072 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b375fd-f4ca-40bd-b004-c1b3c04f6783 admin admin] PATH_INFO: `/v3/projects/ff78abb5180841a6b084d82edee01fef/users/b2fd5d3dfbca4944bb180ce8b7fcae19/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.486246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:42.490679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b375fd-f4ca-40bd-b004-c1b3c04f6783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff78abb5180841a6b084d82edee01fef, user_id=b2fd5d3dfbca4944bb180ce8b7fcae19, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:42.493463 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b375fd-f4ca-40bd-b004-c1b3c04f6783 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:42.503949 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5ab43-d55c-48cf-9ca5-4907f7dcd509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:42.504767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5ab43-d55c-48cf-9ca5-4907f7dcd509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.505138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5ab43-d55c-48cf-9ca5-4907f7dcd509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.505509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5ab43-d55c-48cf-9ca5-4907f7dcd509 admin admin] PATH_INFO: `/v3/projects/21de11b598a0498b9aa9563cb0d628d3/users/1551d02783d44fd293cf7828aeea7f4c/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.508674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 803/1610] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:42 2022] PUT /identity/v3/projects/ff78abb5180841a6b084d82edee01fef/users/b2fd5d3dfbca4944bb180ce8b7fcae19/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:42.511275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf9faf-d591-47f4-9db1-1a4f948bf494 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.511807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf9faf-d591-47f4-9db1-1a4f948bf494 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.512249 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf9faf-d591-47f4-9db1-1a4f948bf494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.523847 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5ab43-d55c-48cf-9ca5-4907f7dcd509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21de11b598a0498b9aa9563cb0d628d3, user_id=1551d02783d44fd293cf7828aeea7f4c, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:42.526198 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5ab43-d55c-48cf-9ca5-4907f7dcd509 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:42.542954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-19bf9faf-d591-47f4-9db1-1a4f948bf494 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:42.553554 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 808/1611] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:42 2022] PUT /identity/v3/projects/21de11b598a0498b9aa9563cb0d628d3/users/1551d02783d44fd293cf7828aeea7f4c/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:42.553771 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-19bf9faf-d591-47f4-9db1-1a4f948bf494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:42.553861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250ae37-a3c2-4898-8cc0-3393bedb260e None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.553861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250ae37-a3c2-4898-8cc0-3393bedb260e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.553861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250ae37-a3c2-4898-8cc0-3393bedb260e None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.553861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 809/1612] 10.222.0.57 () {54 vars in 912 bytes} [Tue Jul 12 18:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:27:42.553861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ca159-3dc4-4217-93e1-dda48b09161d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.553861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ca159-3dc4-4217-93e1-dda48b09161d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.554272 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ca159-3dc4-4217-93e1-dda48b09161d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.566001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:42.577661 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-834ca159-3dc4-4217-93e1-dda48b09161d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:42.579232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-834ca159-3dc4-4217-93e1-dda48b09161d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:42.640948 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 804/1613] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:42.640948 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf9faf-d591-47f4-9db1-1a4f948bf494 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:42.651787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf9faf-d591-47f4-9db1-1a4f948bf494 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:42.657758 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd6e41-d7d5-42f4-ab2e-e70d830e2fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:42.658748 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd6e41-d7d5-42f4-ab2e-e70d830e2fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.659299 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd6e41-d7d5-42f4-ab2e-e70d830e2fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.659675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd6e41-d7d5-42f4-ab2e-e70d830e2fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.660464 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd6e41-d7d5-42f4-ab2e-e70d830e2fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:42.663046 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd6e41-d7d5-42f4-ab2e-e70d830e2fc0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:42.665647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 810/1614] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:42.667252 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02cc41-3ccd-4be7-9f76-99438c84bd88 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.667943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02cc41-3ccd-4be7-9f76-99438c84bd88 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.678442 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02cc41-3ccd-4be7-9f76-99438c84bd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.695729 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 805/1615] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:42 2022] POST /identity/v3/users => generated 294 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:42.697365 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f8efd-9639-4117-9034-7123e162c5bf None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.697748 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f8efd-9639-4117-9034-7123e162c5bf None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.698093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f8efd-9639-4117-9034-7123e162c5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.713913 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-3e02cc41-3ccd-4be7-9f76-99438c84bd88 None None] MFA Rules not processed for user `458c7882e646485aaefe49d8da63fed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:42.715321 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3e02cc41-3ccd-4be7-9f76-99438c84bd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:42.727787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6c4f8efd-9639-4117-9034-7123e162c5bf None None] MFA Rules not processed for user `b2fd5d3dfbca4944bb180ce8b7fcae19`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:42.728995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6c4f8efd-9639-4117-9034-7123e162c5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:42.790206 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 811/1616] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:42.795039 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dc32d-66da-4516-aa2c-7ba369bf3ee8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.795598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dc32d-66da-4516-aa2c-7ba369bf3ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.796684 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dc32d-66da-4516-aa2c-7ba369bf3ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.802664 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 806/1617] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:42.808713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f4ce2-5435-4a00-8ea9-4e3c8a0740a4 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.808713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f4ce2-5435-4a00-8ea9-4e3c8a0740a4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.808914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f4ce2-5435-4a00-8ea9-4e3c8a0740a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.830835 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-cd4f4ce2-5435-4a00-8ea9-4e3c8a0740a4 None None] MFA Rules not processed for user `a7c1bb51c2b642ffa4708122d826fc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:42.832364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-cd4f4ce2-5435-4a00-8ea9-4e3c8a0740a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:42.833770 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-972dc32d-66da-4516-aa2c-7ba369bf3ee8 None None] MFA Rules not processed for user `1551d02783d44fd293cf7828aeea7f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:42.835156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-972dc32d-66da-4516-aa2c-7ba369bf3ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:42.899762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:42.927431 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 812/1618] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:42.928488 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dc32d-66da-4516-aa2c-7ba369bf3ee8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:42.934106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-972dc32d-66da-4516-aa2c-7ba369bf3ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:42.936715 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 807/1619] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Jul 12 18:27:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:42.940160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f4ce2-5435-4a00-8ea9-4e3c8a0740a4 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:42.951986 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-cd4f4ce2-5435-4a00-8ea9-4e3c8a0740a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:42.994039 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:43.025230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dc32d-66da-4516-aa2c-7ba369bf3ee8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:43.028700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd73dae-5e93-4422-8752-0a18f215ecc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:43.029396 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd73dae-5e93-4422-8752-0a18f215ecc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:43.030090 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f4ce2-5435-4a00-8ea9-4e3c8a0740a4 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:43.030269 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd73dae-5e93-4422-8752-0a18f215ecc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:43.030532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd73dae-5e93-4422-8752-0a18f215ecc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:43.038073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce584b4a-8982-4cbc-932f-084c2069f212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:43.038743 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce584b4a-8982-4cbc-932f-084c2069f212 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:43.039076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce584b4a-8982-4cbc-932f-084c2069f212 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:43.039524 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce584b4a-8982-4cbc-932f-084c2069f212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:43.045616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd73dae-5e93-4422-8752-0a18f215ecc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:43.047635 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd73dae-5e93-4422-8752-0a18f215ecc7 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:43.057162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce584b4a-8982-4cbc-932f-084c2069f212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:43.059982 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 813/1620] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:43.060817 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd73dae-5e93-4422-8752-0a18f215ecc7 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:43.064812 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce584b4a-8982-4cbc-932f-084c2069f212 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:43.076972 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 808/1621] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:43.077870 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce584b4a-8982-4cbc-932f-084c2069f212 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:43.084503 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd73dae-5e93-4422-8752-0a18f215ecc7 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:43.102811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb2557-abb7-48fc-ae6a-e05c13b8b1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:43.103497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb2557-abb7-48fc-ae6a-e05c13b8b1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:43.103785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb2557-abb7-48fc-ae6a-e05c13b8b1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:43.104064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb2557-abb7-48fc-ae6a-e05c13b8b1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:43.104803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb2557-abb7-48fc-ae6a-e05c13b8b1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:43.106477 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb2557-abb7-48fc-ae6a-e05c13b8b1b0 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:43.125152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 814/1622] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:43.125152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04326dd-baf0-4756-8f06-7310b3e83542 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:43.125152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04326dd-baf0-4756-8f06-7310b3e83542 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:43.125152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04326dd-baf0-4756-8f06-7310b3e83542 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:43.125923 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 815/1623] 10.222.0.57 () {54 vars in 961 bytes} [Tue Jul 12 18:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:27:43.127254 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04326dd-baf0-4756-8f06-7310b3e83542 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:43.164671 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce584b4a-8982-4cbc-932f-084c2069f212 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:43.169454 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98556c03-248b-4901-bfa8-23f1a61371cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:43.170317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98556c03-248b-4901-bfa8-23f1a61371cf service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:43.170764 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98556c03-248b-4901-bfa8-23f1a61371cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:43.171674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98556c03-248b-4901-bfa8-23f1a61371cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:43.183864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98556c03-248b-4901-bfa8-23f1a61371cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:43.185847 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98556c03-248b-4901-bfa8-23f1a61371cf service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:43.196402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04326dd-baf0-4756-8f06-7310b3e83542 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:43.202688 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e0e86-b632-4a15-a675-3c56c4102267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:43.203353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e0e86-b632-4a15-a675-3c56c4102267 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:43.203686 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e0e86-b632-4a15-a675-3c56c4102267 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:43.203993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e0e86-b632-4a15-a675-3c56c4102267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:43.207299 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 809/1624] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:43.208700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98556c03-248b-4901-bfa8-23f1a61371cf service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:43.227384 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e0e86-b632-4a15-a675-3c56c4102267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:43.229726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e0e86-b632-4a15-a675-3c56c4102267 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:43.245425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98556c03-248b-4901-bfa8-23f1a61371cf service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:43.250988 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 816/1625] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:43.252471 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7885557-6573-4e01-81c1-0f7bc5080e6d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:43.252769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7885557-6573-4e01-81c1-0f7bc5080e6d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:43.253194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7885557-6573-4e01-81c1-0f7bc5080e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:43.255017 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f5149-f16c-4d93-8b38-fce5d611cec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:43.255930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f5149-f16c-4d93-8b38-fce5d611cec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:43.256216 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f5149-f16c-4d93-8b38-fce5d611cec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:43.256490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f5149-f16c-4d93-8b38-fce5d611cec7 admin admin] PATH_INFO: `/v3/projects/3bcf66bfa7114846a1b6b83245a43e81/users/42291ec3466d4f188bd8e6eb6413d996/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:43.284641 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f5149-f16c-4d93-8b38-fce5d611cec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bcf66bfa7114846a1b6b83245a43e81, user_id=42291ec3466d4f188bd8e6eb6413d996, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:43.288423 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f5149-f16c-4d93-8b38-fce5d611cec7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:43.304205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c7885557-6573-4e01-81c1-0f7bc5080e6d None None] MFA Rules not processed for user `a7c1bb51c2b642ffa4708122d826fc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:43.313225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 810/1626] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:43 2022] PUT /identity/v3/projects/3bcf66bfa7114846a1b6b83245a43e81/users/42291ec3466d4f188bd8e6eb6413d996/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:43.316307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c7885557-6573-4e01-81c1-0f7bc5080e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:43.317412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f5149-f16c-4d93-8b38-fce5d611cec7 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:43.472800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f5149-f16c-4d93-8b38-fce5d611cec7 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:43.492682 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17af15c-0888-4eec-ae28-4a2b2a427aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:43.497421 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17af15c-0888-4eec-ae28-4a2b2a427aeb admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:43.497857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17af15c-0888-4eec-ae28-4a2b2a427aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:43.498211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17af15c-0888-4eec-ae28-4a2b2a427aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:43.504680 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17af15c-0888-4eec-ae28-4a2b2a427aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:43.506991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17af15c-0888-4eec-ae28-4a2b2a427aeb admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:43.511295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 817/1627] 10.222.0.57 () {58 vars in 1058 bytes} [Tue Jul 12 18:27:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:43.521433 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7885557-6573-4e01-81c1-0f7bc5080e6d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:43.539725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 811/1628] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:43.544087 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7885557-6573-4e01-81c1-0f7bc5080e6d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:43.545687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17af15c-0888-4eec-ae28-4a2b2a427aeb admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:43.567574 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b9c89-e4f6-444e-933c-d5dba7c22999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:43.582780 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17af15c-0888-4eec-ae28-4a2b2a427aeb admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:43.583151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b9c89-e4f6-444e-933c-d5dba7c22999 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:43.583620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b9c89-e4f6-444e-933c-d5dba7c22999 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:43.583912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b9c89-e4f6-444e-933c-d5dba7c22999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:43.589630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72b10c-ee00-4d23-a1b5-7a1f4c830db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:43.590525 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72b10c-ee00-4d23-a1b5-7a1f4c830db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:43.590809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72b10c-ee00-4d23-a1b5-7a1f4c830db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:43.591090 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72b10c-ee00-4d23-a1b5-7a1f4c830db0 admin admin] PATH_INFO: `/v3/projects/3bcf66bfa7114846a1b6b83245a43e81/users/42291ec3466d4f188bd8e6eb6413d996/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:43.595845 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72b10c-ee00-4d23-a1b5-7a1f4c830db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bcf66bfa7114846a1b6b83245a43e81, user_id=42291ec3466d4f188bd8e6eb6413d996, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:43.600526 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72b10c-ee00-4d23-a1b5-7a1f4c830db0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:43.636743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:43.654546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 812/1629] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:43 2022] PUT /identity/v3/projects/3bcf66bfa7114846a1b6b83245a43e81/users/42291ec3466d4f188bd8e6eb6413d996/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:43.657187 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164585a-8691-40a2-aae9-ae0db477fa59 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:43.660723 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164585a-8691-40a2-aae9-ae0db477fa59 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:43.663445 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164585a-8691-40a2-aae9-ae0db477fa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:43.730214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6164585a-8691-40a2-aae9-ae0db477fa59 None None] MFA Rules not processed for user `42291ec3466d4f188bd8e6eb6413d996`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:43.731484 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6164585a-8691-40a2-aae9-ae0db477fa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:43.749518 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b9c89-e4f6-444e-933c-d5dba7c22999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:43.753638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b9c89-e4f6-444e-933c-d5dba7c22999 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:43.772022 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 818/1630] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:27:43.774248 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:43.858438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 813/1631] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:44.069429 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b9c89-e4f6-444e-933c-d5dba7c22999 service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:44.096415 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164585a-8691-40a2-aae9-ae0db477fa59 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:44.158429 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b9c89-e4f6-444e-933c-d5dba7c22999 service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:44.233848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164585a-8691-40a2-aae9-ae0db477fa59 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:44.241996 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba4b7d-ae81-45ba-a677-5a65fcf27da7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:44.242788 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba4b7d-ae81-45ba-a677-5a65fcf27da7 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:44.243163 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba4b7d-ae81-45ba-a677-5a65fcf27da7 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:44.243490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba4b7d-ae81-45ba-a677-5a65fcf27da7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:44.277653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcf4f4-a753-4def-8f1f-259764d61c74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:44.278844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf4f4-a753-4def-8f1f-259764d61c74 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:44.279357 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf4f4-a753-4def-8f1f-259764d61c74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:44.279907 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf4f4-a753-4def-8f1f-259764d61c74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:44.317747 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba4b7d-ae81-45ba-a677-5a65fcf27da7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:44.319640 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba4b7d-ae81-45ba-a677-5a65fcf27da7 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:44.333053 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 814/1632] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:44.377484 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf635db9-29a2-4888-abb3-f313eeea49f5 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:44.377906 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf635db9-29a2-4888-abb3-f313eeea49f5 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:44.378422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf635db9-29a2-4888-abb3-f313eeea49f5 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:44.380932 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 815/1633] 10.222.0.57 () {54 vars in 912 bytes} [Tue Jul 12 18:27:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:27:44.387515 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c97869-f235-4190-8a87-56b292e94173 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:44.387882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c97869-f235-4190-8a87-56b292e94173 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:44.388390 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c97869-f235-4190-8a87-56b292e94173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:44.410982 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcf4f4-a753-4def-8f1f-259764d61c74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:44.413062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcf4f4-a753-4def-8f1f-259764d61c74 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:44.416681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d7c97869-f235-4190-8a87-56b292e94173 None None] MFA Rules not processed for user `a7c1bb51c2b642ffa4708122d826fc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:44.419531 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d7c97869-f235-4190-8a87-56b292e94173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:44.430053 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 819/1634] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:44.460158 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 816/1635] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Jul 12 18:27:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:45.019560 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcf4f4-a753-4def-8f1f-259764d61c74 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:45.041177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcf4f4-a753-4def-8f1f-259764d61c74 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:45.046939 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e055d-2764-4a13-8e6d-c4530a6a9d0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:45.064975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e055d-2764-4a13-8e6d-c4530a6a9d0c service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:45.064975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e055d-2764-4a13-8e6d-c4530a6a9d0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:45.065283 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e055d-2764-4a13-8e6d-c4530a6a9d0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:45.085836 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e055d-2764-4a13-8e6d-c4530a6a9d0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:45.089283 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e055d-2764-4a13-8e6d-c4530a6a9d0c service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:45.104189 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 820/1636] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:45.809594 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c97869-f235-4190-8a87-56b292e94173 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:45.929598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:45.952489 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c97869-f235-4190-8a87-56b292e94173 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:45.962011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d6d4d-3127-42ba-95af-7badd601b471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:45.963340 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d6d4d-3127-42ba-95af-7badd601b471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:45.964297 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d6d4d-3127-42ba-95af-7badd601b471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:45.964817 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d6d4d-3127-42ba-95af-7badd601b471 admin admin] PATH_INFO: `/v3/users/458c7882e646485aaefe49d8da63fed5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:45.966586 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d6d4d-3127-42ba-95af-7badd601b471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=458c7882e646485aaefe49d8da63fed5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:45.968826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d6d4d-3127-42ba-95af-7badd601b471 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:46.084161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3c7d6d4d-3127-42ba-95af-7badd601b471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '458c7882e646485aaefe49d8da63fed5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:46.084948 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3c7d6d4d-3127-42ba-95af-7badd601b471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '458c7882e646485aaefe49d8da63fed5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:46.119347 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3c7d6d4d-3127-42ba-95af-7badd601b471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '458c7882e646485aaefe49d8da63fed5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:46.142515 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3c7d6d4d-3127-42ba-95af-7badd601b471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '458c7882e646485aaefe49d8da63fed5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:46.143178 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3c7d6d4d-3127-42ba-95af-7badd601b471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '458c7882e646485aaefe49d8da63fed5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:46.203414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 817/1637] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:45 2022] DELETE /identity/v3/users/458c7882e646485aaefe49d8da63fed5 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:46.208174 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f6d3b-4fa4-43a9-8c2e-a92132af7ce5 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:46.209230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f6d3b-4fa4-43a9-8c2e-a92132af7ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:46.209755 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f6d3b-4fa4-43a9-8c2e-a92132af7ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:46.244285 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d22f6d3b-4fa4-43a9-8c2e-a92132af7ce5 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:46.245931 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d22f6d3b-4fa4-43a9-8c2e-a92132af7ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:46.262839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:46.394067 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 821/1638] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:46.485157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d6d4d-3127-42ba-95af-7badd601b471 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:46.486723 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3c7d6d4d-3127-42ba-95af-7badd601b471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:46.652916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d6d4d-3127-42ba-95af-7badd601b471 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:46.667905 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63e5b8-6b12-480a-ae2c-5fca41d72013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:46.668755 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63e5b8-6b12-480a-ae2c-5fca41d72013 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:46.669149 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63e5b8-6b12-480a-ae2c-5fca41d72013 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:46.669608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63e5b8-6b12-480a-ae2c-5fca41d72013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:46.699912 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63e5b8-6b12-480a-ae2c-5fca41d72013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:46.701858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63e5b8-6b12-480a-ae2c-5fca41d72013 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:46.749488 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 818/1639] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:27:48.197007 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f6d3b-4fa4-43a9-8c2e-a92132af7ce5 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:48.199007 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d22f6d3b-4fa4-43a9-8c2e-a92132af7ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:48.383264 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f6d3b-4fa4-43a9-8c2e-a92132af7ce5 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:48.397213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715cf99-db14-4762-be10-64fff163a369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:48.398540 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715cf99-db14-4762-be10-64fff163a369 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:48.399105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715cf99-db14-4762-be10-64fff163a369 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:48.400630 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715cf99-db14-4762-be10-64fff163a369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:48.405212 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2715cf99-db14-4762-be10-64fff163a369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:48.462209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63e5b8-6b12-480a-ae2c-5fca41d72013 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:48.464817 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8c63e5b8-6b12-480a-ae2c-5fca41d72013 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:48.496874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63e5b8-6b12-480a-ae2c-5fca41d72013 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:48.522662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289ec5d-ae12-4913-8b4f-1b7cdd8b25d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:48.523657 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289ec5d-ae12-4913-8b4f-1b7cdd8b25d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:48.528053 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289ec5d-ae12-4913-8b4f-1b7cdd8b25d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:48.528398 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289ec5d-ae12-4913-8b4f-1b7cdd8b25d0 admin admin] PATH_INFO: `/v3/projects/8fd33368d5364b958f9a3c372878458c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:48.534460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289ec5d-ae12-4913-8b4f-1b7cdd8b25d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd33368d5364b958f9a3c372878458c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:48.540204 dv-cinder-835384-15-smb devstack@keystone.service[80227]: WARNING py.warnings [None req-a289ec5d-ae12-4913-8b4f-1b7cdd8b25d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:27:48.540204 dv-cinder-835384-15-smb devstack@keystone.service[80227]: warnings.warn(msg) Jul 12 18:27:48.540204 dv-cinder-835384-15-smb devstack@keystone.service[80227]: Jul 12 18:27:48.545751 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289ec5d-ae12-4913-8b4f-1b7cdd8b25d0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:48.697891 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715cf99-db14-4762-be10-64fff163a369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:48.699755 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715cf99-db14-4762-be10-64fff163a369 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:48.736461 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 822/1640] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:48.737600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715cf99-db14-4762-be10-64fff163a369 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:48.744491 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2715cf99-db14-4762-be10-64fff163a369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:48.778855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715cf99-db14-4762-be10-64fff163a369 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:48.790648 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a289ec5d-ae12-4913-8b4f-1b7cdd8b25d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd33368d5364b958f9a3c372878458c', 'request_id': 'req-a289ec5d-ae12-4913-8b4f-1b7cdd8b25d0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:48.812787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a289ec5d-ae12-4913-8b4f-1b7cdd8b25d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd33368d5364b958f9a3c372878458c', 'request_id': 'req-a289ec5d-ae12-4913-8b4f-1b7cdd8b25d0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:48.823662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:48.829899 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a289ec5d-ae12-4913-8b4f-1b7cdd8b25d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd33368d5364b958f9a3c372878458c', 'request_id': 'req-a289ec5d-ae12-4913-8b4f-1b7cdd8b25d0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:48.890841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a289ec5d-ae12-4913-8b4f-1b7cdd8b25d0 admin admin] The token cache is being invalidate because project 8fd33368d5364b958f9a3c372878458c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:27:48.891353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a289ec5d-ae12-4913-8b4f-1b7cdd8b25d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:48.891949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a289ec5d-ae12-4913-8b4f-1b7cdd8b25d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:48.896949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 819/1641] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:27:48 2022] DELETE /identity/v3/projects/8fd33368d5364b958f9a3c372878458c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:48.901017 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049916a-37f9-48ec-8b4e-1660c7925757 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:48.901987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049916a-37f9-48ec-8b4e-1660c7925757 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:48.902340 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049916a-37f9-48ec-8b4e-1660c7925757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:48.952128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-5049916a-37f9-48ec-8b4e-1660c7925757 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:48.954535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5049916a-37f9-48ec-8b4e-1660c7925757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:48.988577 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4eb7e-c4bd-4017-a969-dbfe64570a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:48.999294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4eb7e-c4bd-4017-a969-dbfe64570a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:48.999651 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4eb7e-c4bd-4017-a969-dbfe64570a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:48.999993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4eb7e-c4bd-4017-a969-dbfe64570a64 admin admin] PATH_INFO: `/v3/users/11fcce5b21a948c8b98a535c0af07306` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:49.004532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4eb7e-c4bd-4017-a969-dbfe64570a64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11fcce5b21a948c8b98a535c0af07306)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:49.005856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: WARNING py.warnings [None req-59f4eb7e-c4bd-4017-a969-dbfe64570a64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:27:49.005856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: warnings.warn(msg) Jul 12 18:27:49.005856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: Jul 12 18:27:49.007433 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4eb7e-c4bd-4017-a969-dbfe64570a64 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:49.029815 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:49.132385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 820/1642] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:49.134273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb3984-6aed-4848-bb3f-5c0c3a45c9de None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:49.134668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb3984-6aed-4848-bb3f-5c0c3a45c9de None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:49.135048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb3984-6aed-4848-bb3f-5c0c3a45c9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:49.171864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-14bb3984-6aed-4848-bb3f-5c0c3a45c9de None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:49.173732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-14bb3984-6aed-4848-bb3f-5c0c3a45c9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:49.218077 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 821/1643] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:49.219280 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb3984-6aed-4848-bb3f-5c0c3a45c9de None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:49.251764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-59f4eb7e-c4bd-4017-a969-dbfe64570a64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11fcce5b21a948c8b98a535c0af07306'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:49.255209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb3984-6aed-4848-bb3f-5c0c3a45c9de None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:49.255513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-59f4eb7e-c4bd-4017-a969-dbfe64570a64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11fcce5b21a948c8b98a535c0af07306'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:49.281310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-59f4eb7e-c4bd-4017-a969-dbfe64570a64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11fcce5b21a948c8b98a535c0af07306'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:49.282517 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-59f4eb7e-c4bd-4017-a969-dbfe64570a64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11fcce5b21a948c8b98a535c0af07306'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:49.284953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b9d01-4ac1-4304-bccc-0e0fec402929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:49.285786 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b9d01-4ac1-4304-bccc-0e0fec402929 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:49.286165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b9d01-4ac1-4304-bccc-0e0fec402929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:49.286535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b9d01-4ac1-4304-bccc-0e0fec402929 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:49.287370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b9d01-4ac1-4304-bccc-0e0fec402929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:49.287780 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b9d01-4ac1-4304-bccc-0e0fec402929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:49.289547 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b9d01-4ac1-4304-bccc-0e0fec402929 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:49.308076 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-59f4eb7e-c4bd-4017-a969-dbfe64570a64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11fcce5b21a948c8b98a535c0af07306'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:49.358946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 822/1644] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:49.360025 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b9d01-4ac1-4304-bccc-0e0fec402929 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:49.377759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-563b9d01-4ac1-4304-bccc-0e0fec402929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:49.434355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b9d01-4ac1-4304-bccc-0e0fec402929 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:49.446176 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c7c9a-78c7-494f-b309-36524d20b971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:49.446802 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c7c9a-78c7-494f-b309-36524d20b971 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:49.447095 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c7c9a-78c7-494f-b309-36524d20b971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:49.447452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c7c9a-78c7-494f-b309-36524d20b971 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:49.448160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c7c9a-78c7-494f-b309-36524d20b971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:49.453394 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 823/1645] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:48 2022] DELETE /identity/v3/users/11fcce5b21a948c8b98a535c0af07306 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:49.458358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b059d6-414a-41e3-a276-cfac74cf4875 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:49.458968 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b059d6-414a-41e3-a276-cfac74cf4875 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:49.459127 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b059d6-414a-41e3-a276-cfac74cf4875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:49.463107 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c7c9a-78c7-494f-b309-36524d20b971 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:49.528258 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-53b059d6-414a-41e3-a276-cfac74cf4875 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:49.529521 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-53b059d6-414a-41e3-a276-cfac74cf4875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:49.536203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 823/1646] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:49 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:49.540079 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c7c9a-78c7-494f-b309-36524d20b971 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:49.736578 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 824/1647] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:49.753028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c7c9a-78c7-494f-b309-36524d20b971 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:49.765146 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2859240-608b-4cda-93be-e97ce044f1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:49.765949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2859240-608b-4cda-93be-e97ce044f1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:49.766266 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2859240-608b-4cda-93be-e97ce044f1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:49.767060 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2859240-608b-4cda-93be-e97ce044f1e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:49.767774 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2859240-608b-4cda-93be-e97ce044f1e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:49.769814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2859240-608b-4cda-93be-e97ce044f1e8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:49.823687 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b059d6-414a-41e3-a276-cfac74cf4875 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:49.824710 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 824/1648] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:49 2022] POST /identity/v3/users => generated 290 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:27:49.841376 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b059d6-414a-41e3-a276-cfac74cf4875 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:49.860219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d9d07-2542-4038-8882-d7f9b2346411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:49.860959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d9d07-2542-4038-8882-d7f9b2346411 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:49.861245 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d9d07-2542-4038-8882-d7f9b2346411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:49.861549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d9d07-2542-4038-8882-d7f9b2346411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:49.862446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d9d07-2542-4038-8882-d7f9b2346411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:49.864496 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d9d07-2542-4038-8882-d7f9b2346411 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:49.893972 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 825/1649] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:49.899179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2859240-608b-4cda-93be-e97ce044f1e8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:49.915304 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2859240-608b-4cda-93be-e97ce044f1e8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:49.944003 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e41080-56de-499e-8fd1-1221ad874990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:49.944765 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e41080-56de-499e-8fd1-1221ad874990 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:49.945044 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e41080-56de-499e-8fd1-1221ad874990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:49.947110 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e41080-56de-499e-8fd1-1221ad874990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:49.948769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d9d07-2542-4038-8882-d7f9b2346411 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:49.950822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-198d9d07-2542-4038-8882-d7f9b2346411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:49.958393 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e41080-56de-499e-8fd1-1221ad874990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:49.960128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e41080-56de-499e-8fd1-1221ad874990 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:50.029680 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 825/1650] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:50.030770 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e41080-56de-499e-8fd1-1221ad874990 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:50.102916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e41080-56de-499e-8fd1-1221ad874990 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:50.132712 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ffd43-182d-4f01-984c-1c499db0fdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:50.134598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ffd43-182d-4f01-984c-1c499db0fdae admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:50.134598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ffd43-182d-4f01-984c-1c499db0fdae admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:50.134598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ffd43-182d-4f01-984c-1c499db0fdae admin admin] PATH_INFO: `/v3/projects/b7749765e1e64a4bb14be8add3c162a5/users/ed0effc7e86b459084745d73f0271a84/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:50.195412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ffd43-182d-4f01-984c-1c499db0fdae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7749765e1e64a4bb14be8add3c162a5, user_id=ed0effc7e86b459084745d73f0271a84, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:50.198190 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ffd43-182d-4f01-984c-1c499db0fdae admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:50.227561 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d9d07-2542-4038-8882-d7f9b2346411 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:50.258057 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 826/1651] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:50 2022] PUT /identity/v3/projects/b7749765e1e64a4bb14be8add3c162a5/users/ed0effc7e86b459084745d73f0271a84/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:50.273007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169d456-ac26-441f-91a4-d0c40a7a79b6 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:50.273325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169d456-ac26-441f-91a4-d0c40a7a79b6 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:50.273611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169d456-ac26-441f-91a4-d0c40a7a79b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:50.300449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:50.364571 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:50.377291 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8169d456-ac26-441f-91a4-d0c40a7a79b6 None None] MFA Rules not processed for user `ed0effc7e86b459084745d73f0271a84`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:50.382557 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8169d456-ac26-441f-91a4-d0c40a7a79b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:50.466170 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b394d-ef48-44f8-86ce-bb841a3867eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:50.467232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b394d-ef48-44f8-86ce-bb841a3867eb service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:50.467662 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b394d-ef48-44f8-86ce-bb841a3867eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:50.468071 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b394d-ef48-44f8-86ce-bb841a3867eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:50.645985 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b394d-ef48-44f8-86ce-bb841a3867eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:50.648637 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b394d-ef48-44f8-86ce-bb841a3867eb service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:50.664676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 826/1652] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:50.706197 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 827/1653] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:50.708705 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b394d-ef48-44f8-86ce-bb841a3867eb service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:50.731240 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b394d-ef48-44f8-86ce-bb841a3867eb service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:50.746037 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bf1d4-7fb5-4d01-9e6c-ee4e42c37bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:50.746988 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bf1d4-7fb5-4d01-9e6c-ee4e42c37bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:50.747567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bf1d4-7fb5-4d01-9e6c-ee4e42c37bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:50.749010 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bf1d4-7fb5-4d01-9e6c-ee4e42c37bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:50.749904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bf1d4-7fb5-4d01-9e6c-ee4e42c37bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:50.756402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bf1d4-7fb5-4d01-9e6c-ee4e42c37bf7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:50.841402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 827/1654] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:50 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:50.842541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169d456-ac26-441f-91a4-d0c40a7a79b6 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:50.870499 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169d456-ac26-441f-91a4-d0c40a7a79b6 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:51.056386 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cfc2b-9c97-49e6-a76e-86e5ff745d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:51.057081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cfc2b-9c97-49e6-a76e-86e5ff745d69 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:51.057393 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cfc2b-9c97-49e6-a76e-86e5ff745d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:51.057673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cfc2b-9c97-49e6-a76e-86e5ff745d69 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:51.058375 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cfc2b-9c97-49e6-a76e-86e5ff745d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:51.060339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cfc2b-9c97-49e6-a76e-86e5ff745d69 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:51.117569 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 828/1655] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:50 2022] POST /identity/v3/users => generated 296 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:51.122159 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bf1d4-7fb5-4d01-9e6c-ee4e42c37bf7 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:51.139626 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bf1d4-7fb5-4d01-9e6c-ee4e42c37bf7 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:51.161991 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a6810-fb7b-4c02-81ec-f50e778362ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:51.162685 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a6810-fb7b-4c02-81ec-f50e778362ce admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:51.162965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a6810-fb7b-4c02-81ec-f50e778362ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:51.169499 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a6810-fb7b-4c02-81ec-f50e778362ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:51.170317 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a6810-fb7b-4c02-81ec-f50e778362ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:51.174629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a6810-fb7b-4c02-81ec-f50e778362ce admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:51.205778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 828/1656] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:51.210157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cfc2b-9c97-49e6-a76e-86e5ff745d69 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:51.259328 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cfc2b-9c97-49e6-a76e-86e5ff745d69 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:51.297002 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a691f9b-ba8e-4667-9443-9a317ffdd0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:51.298796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a691f9b-ba8e-4667-9443-9a317ffdd0f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:51.299075 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a691f9b-ba8e-4667-9443-9a317ffdd0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:51.299505 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a691f9b-ba8e-4667-9443-9a317ffdd0f9 admin admin] PATH_INFO: `/v3/projects/09dfbdec8abe41b8a60b377d23e7085c/users/a07d65441dd0470e82fe53491099de82/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:51.327253 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a691f9b-ba8e-4667-9443-9a317ffdd0f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09dfbdec8abe41b8a60b377d23e7085c, user_id=a07d65441dd0470e82fe53491099de82, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:51.331227 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a691f9b-ba8e-4667-9443-9a317ffdd0f9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:51.364019 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 829/1657] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:51 2022] PUT /identity/v3/projects/09dfbdec8abe41b8a60b377d23e7085c/users/a07d65441dd0470e82fe53491099de82/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:51.368018 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a6810-fb7b-4c02-81ec-f50e778362ce admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:51.382648 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a6810-fb7b-4c02-81ec-f50e778362ce admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:51.553035 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9c50a-60c0-4e4b-a39d-5f8b19ad256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:51.554152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9c50a-60c0-4e4b-a39d-5f8b19ad256d admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:51.554650 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9c50a-60c0-4e4b-a39d-5f8b19ad256d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:51.555171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9c50a-60c0-4e4b-a39d-5f8b19ad256d admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:51.556115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9c50a-60c0-4e4b-a39d-5f8b19ad256d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:51.557977 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9c50a-60c0-4e4b-a39d-5f8b19ad256d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:51.596665 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 829/1658] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:51.600852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a691f9b-ba8e-4667-9443-9a317ffdd0f9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:51.630266 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a691f9b-ba8e-4667-9443-9a317ffdd0f9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:51.647916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4413df3-1324-4593-bb95-9c5870ddf08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:51.649058 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4413df3-1324-4593-bb95-9c5870ddf08c admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:51.649567 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4413df3-1324-4593-bb95-9c5870ddf08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:51.650052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4413df3-1324-4593-bb95-9c5870ddf08c admin admin] PATH_INFO: `/v3/projects/09dfbdec8abe41b8a60b377d23e7085c/users/a07d65441dd0470e82fe53491099de82/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:51.654580 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4413df3-1324-4593-bb95-9c5870ddf08c admin admin] RBAC: Authorizing `identity:create_grant(project_id=09dfbdec8abe41b8a60b377d23e7085c, user_id=a07d65441dd0470e82fe53491099de82, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:51.660226 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4413df3-1324-4593-bb95-9c5870ddf08c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:51.717013 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 830/1659] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:51 2022] PUT /identity/v3/projects/09dfbdec8abe41b8a60b377d23e7085c/users/a07d65441dd0470e82fe53491099de82/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:51.731724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bfeb8-6115-4f3d-87b6-01d5ad208352 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:51.732321 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bfeb8-6115-4f3d-87b6-01d5ad208352 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:51.733780 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bfeb8-6115-4f3d-87b6-01d5ad208352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:51.859168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-df3bfeb8-6115-4f3d-87b6-01d5ad208352 None None] MFA Rules not processed for user `a07d65441dd0470e82fe53491099de82`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:51.860551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-df3bfeb8-6115-4f3d-87b6-01d5ad208352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:51.893699 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4413df3-1324-4593-bb95-9c5870ddf08c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:51.895949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b4413df3-1324-4593-bb95-9c5870ddf08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:51.944551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:52.041805 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 830/1660] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:52.053901 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bfeb8-6115-4f3d-87b6-01d5ad208352 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:52.055338 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-df3bfeb8-6115-4f3d-87b6-01d5ad208352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:52.090423 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:52.139690 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4413df3-1324-4593-bb95-9c5870ddf08c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:52.194051 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d885bea-ed44-406a-aa8f-9526162a8b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:52.195239 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d885bea-ed44-406a-aa8f-9526162a8b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:52.195469 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d885bea-ed44-406a-aa8f-9526162a8b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:52.195552 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d885bea-ed44-406a-aa8f-9526162a8b2e admin admin] PATH_INFO: `/v3/users/1551d02783d44fd293cf7828aeea7f4c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:52.198311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d885bea-ed44-406a-aa8f-9526162a8b2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1551d02783d44fd293cf7828aeea7f4c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:52.201756 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d885bea-ed44-406a-aa8f-9526162a8b2e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:52.242485 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bfeb8-6115-4f3d-87b6-01d5ad208352 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:52.253232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44735a9f-f960-435a-b07e-a57b5224f89d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:52.254152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44735a9f-f960-435a-b07e-a57b5224f89d service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:52.254437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44735a9f-f960-435a-b07e-a57b5224f89d service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:52.254720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44735a9f-f960-435a-b07e-a57b5224f89d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:52.358399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5d885bea-ed44-406a-aa8f-9526162a8b2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1551d02783d44fd293cf7828aeea7f4c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:52.359648 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5d885bea-ed44-406a-aa8f-9526162a8b2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1551d02783d44fd293cf7828aeea7f4c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:52.401335 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5d885bea-ed44-406a-aa8f-9526162a8b2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1551d02783d44fd293cf7828aeea7f4c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:52.429719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5d885bea-ed44-406a-aa8f-9526162a8b2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1551d02783d44fd293cf7828aeea7f4c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:52.437232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5d885bea-ed44-406a-aa8f-9526162a8b2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1551d02783d44fd293cf7828aeea7f4c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:52.471349 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 831/1661] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:51 2022] DELETE /identity/v3/users/1551d02783d44fd293cf7828aeea7f4c => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:27:52.473133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d0381-1665-4547-89a0-09fe9cb43676 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:52.473598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d0381-1665-4547-89a0-09fe9cb43676 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:52.474457 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d0381-1665-4547-89a0-09fe9cb43676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:52.484592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44735a9f-f960-435a-b07e-a57b5224f89d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:52.488614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44735a9f-f960-435a-b07e-a57b5224f89d service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:52.521477 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-429d0381-1665-4547-89a0-09fe9cb43676 None None] MFA Rules not processed for user `1fc73723cc744362941270f74946b3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:52.523001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-429d0381-1665-4547-89a0-09fe9cb43676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:52.524020 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 831/1662] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:52.526486 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44735a9f-f960-435a-b07e-a57b5224f89d service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:52.531244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-44735a9f-f960-435a-b07e-a57b5224f89d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:52.570659 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44735a9f-f960-435a-b07e-a57b5224f89d service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:52.679431 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 832/1663] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:52.682696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92856e0-b2ef-4296-bc50-b1ed93b01ac3 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:52.682993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92856e0-b2ef-4296-bc50-b1ed93b01ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:52.684899 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92856e0-b2ef-4296-bc50-b1ed93b01ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:52.745453 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d92856e0-b2ef-4296-bc50-b1ed93b01ac3 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:52.746757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d92856e0-b2ef-4296-bc50-b1ed93b01ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:52.790899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea1dd4-164b-4dc6-90bd-fc9d88b81093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:52.791806 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea1dd4-164b-4dc6-90bd-fc9d88b81093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:52.792142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea1dd4-164b-4dc6-90bd-fc9d88b81093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:52.792359 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea1dd4-164b-4dc6-90bd-fc9d88b81093 admin admin] PATH_INFO: `/v3/projects/5ee911f05869464b936cc4516a115f80` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:52.800731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea1dd4-164b-4dc6-90bd-fc9d88b81093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee911f05869464b936cc4516a115f80)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:52.802757 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea1dd4-164b-4dc6-90bd-fc9d88b81093 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:52.892243 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:52.937188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:52.977444 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 833/1664] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:52.978358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92856e0-b2ef-4296-bc50-b1ed93b01ac3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:52.986610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-68ea1dd4-164b-4dc6-90bd-fc9d88b81093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee911f05869464b936cc4516a115f80', 'request_id': 'req-68ea1dd4-164b-4dc6-90bd-fc9d88b81093'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:52.993908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d92856e0-b2ef-4296-bc50-b1ed93b01ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:53.014908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-68ea1dd4-164b-4dc6-90bd-fc9d88b81093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee911f05869464b936cc4516a115f80', 'request_id': 'req-68ea1dd4-164b-4dc6-90bd-fc9d88b81093'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:53.033977 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-68ea1dd4-164b-4dc6-90bd-fc9d88b81093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee911f05869464b936cc4516a115f80', 'request_id': 'req-68ea1dd4-164b-4dc6-90bd-fc9d88b81093'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:53.071351 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-68ea1dd4-164b-4dc6-90bd-fc9d88b81093 admin admin] The token cache is being invalidate because project 5ee911f05869464b936cc4516a115f80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:27:53.071644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-68ea1dd4-164b-4dc6-90bd-fc9d88b81093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:53.073700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-68ea1dd4-164b-4dc6-90bd-fc9d88b81093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:53.078565 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 832/1665] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:27:52 2022] DELETE /identity/v3/projects/5ee911f05869464b936cc4516a115f80 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:53.082895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea1dd4-164b-4dc6-90bd-fc9d88b81093 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:53.085101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-68ea1dd4-164b-4dc6-90bd-fc9d88b81093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:53.162826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92856e0-b2ef-4296-bc50-b1ed93b01ac3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:53.244052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e999a26-ba11-4c9c-96a7-93ed4a589fef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:53.245689 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e999a26-ba11-4c9c-96a7-93ed4a589fef service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:53.246208 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e999a26-ba11-4c9c-96a7-93ed4a589fef service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:53.246569 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e999a26-ba11-4c9c-96a7-93ed4a589fef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:53.249371 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5e999a26-ba11-4c9c-96a7-93ed4a589fef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:53.264617 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea1dd4-164b-4dc6-90bd-fc9d88b81093 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:53.279594 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a9d37-2af1-4887-80a6-7b6a979b8fbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:53.280322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a9d37-2af1-4887-80a6-7b6a979b8fbe service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:53.280671 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a9d37-2af1-4887-80a6-7b6a979b8fbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:53.280866 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a9d37-2af1-4887-80a6-7b6a979b8fbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:53.285817 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d73a9d37-2af1-4887-80a6-7b6a979b8fbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:53.412975 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e999a26-ba11-4c9c-96a7-93ed4a589fef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:53.414767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e999a26-ba11-4c9c-96a7-93ed4a589fef service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:53.426293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 834/1666] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:53.427425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333c566-69e6-482e-b9a4-bce3a6fec7b9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:53.427713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333c566-69e6-482e-b9a4-bce3a6fec7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:53.427995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333c566-69e6-482e-b9a4-bce3a6fec7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:53.451444 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8333c566-69e6-482e-b9a4-bce3a6fec7b9 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:53.453171 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8333c566-69e6-482e-b9a4-bce3a6fec7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:53.457748 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a9d37-2af1-4887-80a6-7b6a979b8fbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:53.459525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a9d37-2af1-4887-80a6-7b6a979b8fbe service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:53.471920 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 835/1667] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:53.479262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c562ea1-5599-4d00-b124-c8c01ca42aa8 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:53.479558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c562ea1-5599-4d00-b124-c8c01ca42aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:53.479839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c562ea1-5599-4d00-b124-c8c01ca42aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:53.486504 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 833/1668] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:53.557466 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9c562ea1-5599-4d00-b124-c8c01ca42aa8 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:53.565715 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9c562ea1-5599-4d00-b124-c8c01ca42aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:53.613986 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 836/1669] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:53.615235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a9d37-2af1-4887-80a6-7b6a979b8fbe service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:53.634326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a9d37-2af1-4887-80a6-7b6a979b8fbe service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:53.643426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a873a-bb4f-4899-b834-e614a66c6dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:53.644258 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a873a-bb4f-4899-b834-e614a66c6dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:53.644639 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a873a-bb4f-4899-b834-e614a66c6dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:53.645000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a873a-bb4f-4899-b834-e614a66c6dbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:53.646138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a873a-bb4f-4899-b834-e614a66c6dbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:53.646507 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a873a-bb4f-4899-b834-e614a66c6dbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:53.648821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a873a-bb4f-4899-b834-e614a66c6dbd admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:53.674817 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 834/1670] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:53.676038 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c562ea1-5599-4d00-b124-c8c01ca42aa8 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:53.688945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c562ea1-5599-4d00-b124-c8c01ca42aa8 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:53.695787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae25216-2089-4332-8c31-177033bdf9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:53.696606 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae25216-2089-4332-8c31-177033bdf9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:53.696879 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae25216-2089-4332-8c31-177033bdf9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:53.703753 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae25216-2089-4332-8c31-177033bdf9c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:53.705232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae25216-2089-4332-8c31-177033bdf9c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:53.707536 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae25216-2089-4332-8c31-177033bdf9c4 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:53.745315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:53.774047 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 837/1671] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:53 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:53.778294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a873a-bb4f-4899-b834-e614a66c6dbd admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:53.796594 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a873a-bb4f-4899-b834-e614a66c6dbd admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:53.909034 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:53.954296 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3d53a-48e3-470e-8489-76649b2b41ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:53.955463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3d53a-48e3-470e-8489-76649b2b41ab admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:53.955749 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3d53a-48e3-470e-8489-76649b2b41ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:53.956160 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3d53a-48e3-470e-8489-76649b2b41ab admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:53.956936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3d53a-48e3-470e-8489-76649b2b41ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:53.961515 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3d53a-48e3-470e-8489-76649b2b41ab admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:54.010990 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 835/1672] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:53 2022] POST /identity/v3/users => generated 294 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:54.015709 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae25216-2089-4332-8c31-177033bdf9c4 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:54.030889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae25216-2089-4332-8c31-177033bdf9c4 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:54.046841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722be5f-11ea-4983-8cca-fd07209d26ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:54.047254 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722be5f-11ea-4983-8cca-fd07209d26ac admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:54.048073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722be5f-11ea-4983-8cca-fd07209d26ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:54.048350 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722be5f-11ea-4983-8cca-fd07209d26ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:54.049088 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722be5f-11ea-4983-8cca-fd07209d26ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:54.050763 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722be5f-11ea-4983-8cca-fd07209d26ac admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:54.096654 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 838/1673] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:54.101983 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3d53a-48e3-470e-8489-76649b2b41ab admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:54.133839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3d53a-48e3-470e-8489-76649b2b41ab admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:54.150866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722be5f-11ea-4983-8cca-fd07209d26ac admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:54.153651 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a96e0-c650-4014-ba8f-324ec7c1721d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:54.154597 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9722be5f-11ea-4983-8cca-fd07209d26ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:54.155219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a96e0-c650-4014-ba8f-324ec7c1721d admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:54.157451 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a96e0-c650-4014-ba8f-324ec7c1721d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:54.157824 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a96e0-c650-4014-ba8f-324ec7c1721d admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:54.158642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a96e0-c650-4014-ba8f-324ec7c1721d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:54.164591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a96e0-c650-4014-ba8f-324ec7c1721d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:54.193883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722be5f-11ea-4983-8cca-fd07209d26ac admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:54.200284 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 836/1674] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:54.202339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833c589-eb17-490c-b638-6cec384fc002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:54.203416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833c589-eb17-490c-b638-6cec384fc002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:54.204776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833c589-eb17-490c-b638-6cec384fc002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:54.209695 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833c589-eb17-490c-b638-6cec384fc002 admin admin] PATH_INFO: `/v3/projects/21de11b598a0498b9aa9563cb0d628d3` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:54.211484 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a96e0-c650-4014-ba8f-324ec7c1721d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:54.212473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833c589-eb17-490c-b638-6cec384fc002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21de11b598a0498b9aa9563cb0d628d3)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:54.215171 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833c589-eb17-490c-b638-6cec384fc002 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:54.280416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a96e0-c650-4014-ba8f-324ec7c1721d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:54.300922 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de85e53-f27c-4e98-8b9d-f13c3d96a925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:54.301839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de85e53-f27c-4e98-8b9d-f13c3d96a925 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:54.302148 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de85e53-f27c-4e98-8b9d-f13c3d96a925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:54.304291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de85e53-f27c-4e98-8b9d-f13c3d96a925 admin admin] PATH_INFO: `/v3/projects/13eba785203e485d8e9d368a02d619ba/users/2e2031671b3d4719bcf8e78522a7e1d0/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:54.340837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de85e53-f27c-4e98-8b9d-f13c3d96a925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13eba785203e485d8e9d368a02d619ba, user_id=2e2031671b3d4719bcf8e78522a7e1d0, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:54.351142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de85e53-f27c-4e98-8b9d-f13c3d96a925 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:54.426167 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 837/1675] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:54 2022] PUT /identity/v3/projects/13eba785203e485d8e9d368a02d619ba/users/2e2031671b3d4719bcf8e78522a7e1d0/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:54.427655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f833c589-eb17-490c-b638-6cec384fc002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21de11b598a0498b9aa9563cb0d628d3', 'request_id': 'req-f833c589-eb17-490c-b638-6cec384fc002'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:54.439741 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8339d79-d398-419d-9fb6-6125313fb2ca None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:54.441171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8339d79-d398-419d-9fb6-6125313fb2ca None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:54.441476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8339d79-d398-419d-9fb6-6125313fb2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:54.458376 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f833c589-eb17-490c-b638-6cec384fc002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21de11b598a0498b9aa9563cb0d628d3', 'request_id': 'req-f833c589-eb17-490c-b638-6cec384fc002'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:54.484245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f833c589-eb17-490c-b638-6cec384fc002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21de11b598a0498b9aa9563cb0d628d3', 'request_id': 'req-f833c589-eb17-490c-b638-6cec384fc002'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:54.544582 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f833c589-eb17-490c-b638-6cec384fc002 admin admin] The token cache is being invalidate because project 21de11b598a0498b9aa9563cb0d628d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:27:54.544886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f833c589-eb17-490c-b638-6cec384fc002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:54.556268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f833c589-eb17-490c-b638-6cec384fc002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:54.559667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 839/1676] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:27:54 2022] DELETE /identity/v3/projects/21de11b598a0498b9aa9563cb0d628d3 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:54.575662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e4967-8d34-44ec-a765-61cce94663ab None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:54.575962 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e4967-8d34-44ec-a765-61cce94663ab None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:54.576242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e4967-8d34-44ec-a765-61cce94663ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:54.579523 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e8339d79-d398-419d-9fb6-6125313fb2ca None None] MFA Rules not processed for user `2e2031671b3d4719bcf8e78522a7e1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:54.581185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e8339d79-d398-419d-9fb6-6125313fb2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:54.627860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7e7e4967-8d34-44ec-a765-61cce94663ab None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:54.629353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7e7e4967-8d34-44ec-a765-61cce94663ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:54.796656 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 838/1677] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:54.799652 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8339d79-d398-419d-9fb6-6125313fb2ca None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:54.808160 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e8339d79-d398-419d-9fb6-6125313fb2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:54.818632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 840/1678] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:54.820296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e4967-8d34-44ec-a765-61cce94663ab None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:54.823767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7e7e4967-8d34-44ec-a765-61cce94663ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:54.852893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e4967-8d34-44ec-a765-61cce94663ab None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:54.864066 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fce5b1-3680-4362-a555-fa56de054dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:54.866302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fce5b1-3680-4362-a555-fa56de054dde admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:54.866302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fce5b1-3680-4362-a555-fa56de054dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:54.866302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fce5b1-3680-4362-a555-fa56de054dde admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:54.866476 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fce5b1-3680-4362-a555-fa56de054dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:54.873541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fce5b1-3680-4362-a555-fa56de054dde admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:54.935558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 841/1679] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:54 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:54.935558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc039855-ee60-4e40-9e7c-b04902b255b2 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:54.935558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc039855-ee60-4e40-9e7c-b04902b255b2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:54.935558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc039855-ee60-4e40-9e7c-b04902b255b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:54.961033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8339d79-d398-419d-9fb6-6125313fb2ca None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:54.986672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-dc039855-ee60-4e40-9e7c-b04902b255b2 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:54.997496 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-dc039855-ee60-4e40-9e7c-b04902b255b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:55.027749 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:55.043286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53aba89-16bd-4a6b-bca5-6f5fae01ddc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:55.044994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53aba89-16bd-4a6b-bca5-6f5fae01ddc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:55.047085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53aba89-16bd-4a6b-bca5-6f5fae01ddc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:55.048764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53aba89-16bd-4a6b-bca5-6f5fae01ddc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:55.054926 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f53aba89-16bd-4a6b-bca5-6f5fae01ddc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:55.109964 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:55.152423 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 842/1680] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:55.153958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc039855-ee60-4e40-9e7c-b04902b255b2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:55.178870 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc039855-ee60-4e40-9e7c-b04902b255b2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:55.198095 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873aa3c-7104-4504-8fbb-2f864f73cf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:55.198796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873aa3c-7104-4504-8fbb-2f864f73cf09 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:55.199261 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873aa3c-7104-4504-8fbb-2f864f73cf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:55.200156 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873aa3c-7104-4504-8fbb-2f864f73cf09 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:55.200263 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873aa3c-7104-4504-8fbb-2f864f73cf09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:55.202537 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873aa3c-7104-4504-8fbb-2f864f73cf09 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:55.255262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 843/1681] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:55 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:55.255262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873aa3c-7104-4504-8fbb-2f864f73cf09 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:55.269745 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53aba89-16bd-4a6b-bca5-6f5fae01ddc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:55.271379 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53aba89-16bd-4a6b-bca5-6f5fae01ddc8 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:55.284860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873aa3c-7104-4504-8fbb-2f864f73cf09 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:55.300048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa311b-9fd7-41d1-9d9b-136ddb6496aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:55.300779 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa311b-9fd7-41d1-9d9b-136ddb6496aa admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:55.300899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 839/1682] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:55.301734 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53aba89-16bd-4a6b-bca5-6f5fae01ddc8 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:55.309305 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa311b-9fd7-41d1-9d9b-136ddb6496aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:55.310822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa311b-9fd7-41d1-9d9b-136ddb6496aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:55.312533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa311b-9fd7-41d1-9d9b-136ddb6496aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:55.314516 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa311b-9fd7-41d1-9d9b-136ddb6496aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:55.319324 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa311b-9fd7-41d1-9d9b-136ddb6496aa admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:55.350104 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53aba89-16bd-4a6b-bca5-6f5fae01ddc8 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:55.361961 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d5174-6f2d-445d-a947-24e4a56838f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:55.362683 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d5174-6f2d-445d-a947-24e4a56838f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:55.362937 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d5174-6f2d-445d-a947-24e4a56838f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:55.363259 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d5174-6f2d-445d-a947-24e4a56838f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:55.363948 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d5174-6f2d-445d-a947-24e4a56838f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:55.365795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d5174-6f2d-445d-a947-24e4a56838f1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:55.389976 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 844/1683] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:55.390945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa311b-9fd7-41d1-9d9b-136ddb6496aa admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:55.412157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa311b-9fd7-41d1-9d9b-136ddb6496aa admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:55.424782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 840/1684] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:55.434375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d5174-6f2d-445d-a947-24e4a56838f1 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:55.448819 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dcfbc-7140-44c8-b64d-e969bc838ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:55.449775 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dcfbc-7140-44c8-b64d-e969bc838ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:55.451898 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dcfbc-7140-44c8-b64d-e969bc838ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:55.452491 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dcfbc-7140-44c8-b64d-e969bc838ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:55.456174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dcfbc-7140-44c8-b64d-e969bc838ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:55.458295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d5174-6f2d-445d-a947-24e4a56838f1 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:55.459004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dcfbc-7140-44c8-b64d-e969bc838ac2 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:55.478435 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a8f9b-d75b-42e6-9596-9c2fb611ec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:55.479383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a8f9b-d75b-42e6-9596-9c2fb611ec73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:55.479683 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a8f9b-d75b-42e6-9596-9c2fb611ec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:55.479960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a8f9b-d75b-42e6-9596-9c2fb611ec73 admin admin] PATH_INFO: `/v3/projects/f7ff686b1b2f4072acdcdb2c90fb8afa/users/76d8d2f25a424c10ac9a5639ce760ccf/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:55.517125 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a8f9b-d75b-42e6-9596-9c2fb611ec73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ff686b1b2f4072acdcdb2c90fb8afa, user_id=76d8d2f25a424c10ac9a5639ce760ccf, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:55.520412 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a8f9b-d75b-42e6-9596-9c2fb611ec73 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:55.533060 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 845/1685] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:55 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:55.534860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dcfbc-7140-44c8-b64d-e969bc838ac2 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:55.562405 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 841/1686] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:55 2022] PUT /identity/v3/projects/f7ff686b1b2f4072acdcdb2c90fb8afa/users/76d8d2f25a424c10ac9a5639ce760ccf/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:55.566514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a8f9b-d75b-42e6-9596-9c2fb611ec73 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:55.721322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a8f9b-d75b-42e6-9596-9c2fb611ec73 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:55.737024 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fe11b-b0c7-44bc-af35-4dfdaeabc896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:55.738552 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fe11b-b0c7-44bc-af35-4dfdaeabc896 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:55.740171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fe11b-b0c7-44bc-af35-4dfdaeabc896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:55.740619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fe11b-b0c7-44bc-af35-4dfdaeabc896 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:55.742857 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fe11b-b0c7-44bc-af35-4dfdaeabc896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:55.750086 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fe11b-b0c7-44bc-af35-4dfdaeabc896 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:55.763569 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dcfbc-7140-44c8-b64d-e969bc838ac2 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:55.779749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137e981-107b-467d-9d9a-b0e06c6ec3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:55.788061 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 842/1687] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:55.789393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fe11b-b0c7-44bc-af35-4dfdaeabc896 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:55.796968 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137e981-107b-467d-9d9a-b0e06c6ec3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:55.797144 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137e981-107b-467d-9d9a-b0e06c6ec3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:55.798412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137e981-107b-467d-9d9a-b0e06c6ec3d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:55.799855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137e981-107b-467d-9d9a-b0e06c6ec3d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:55.803207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137e981-107b-467d-9d9a-b0e06c6ec3d1 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:55.816766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fe11b-b0c7-44bc-af35-4dfdaeabc896 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:55.831102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e835f49-2526-4a04-acd8-6224abde6d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:55.832314 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e835f49-2526-4a04-acd8-6224abde6d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:55.832708 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e835f49-2526-4a04-acd8-6224abde6d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:55.833094 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e835f49-2526-4a04-acd8-6224abde6d19 admin admin] PATH_INFO: `/v3/projects/f7ff686b1b2f4072acdcdb2c90fb8afa/users/76d8d2f25a424c10ac9a5639ce760ccf/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:55.837100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e835f49-2526-4a04-acd8-6224abde6d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ff686b1b2f4072acdcdb2c90fb8afa, user_id=76d8d2f25a424c10ac9a5639ce760ccf, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:55.839952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e835f49-2526-4a04-acd8-6224abde6d19 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:55.883813 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 846/1689] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:55 2022] POST /identity/v3/users => generated 294 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:55.893487 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 843/1689] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:55 2022] PUT /identity/v3/projects/f7ff686b1b2f4072acdcdb2c90fb8afa/users/76d8d2f25a424c10ac9a5639ce760ccf/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:55.896457 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000fd80-e1a3-452c-99a5-b7492c426ba8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:55.896719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137e981-107b-467d-9d9a-b0e06c6ec3d1 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:55.896829 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000fd80-e1a3-452c-99a5-b7492c426ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:55.897020 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000fd80-e1a3-452c-99a5-b7492c426ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:55.922191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137e981-107b-467d-9d9a-b0e06c6ec3d1 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:55.996001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-0000fd80-e1a3-452c-99a5-b7492c426ba8 None None] MFA Rules not processed for user `76d8d2f25a424c10ac9a5639ce760ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:55.997289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0000fd80-e1a3-452c-99a5-b7492c426ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:56.067295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:56.130632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577f8b6-79aa-4bf6-9257-b9c803dd4872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:56.131237 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577f8b6-79aa-4bf6-9257-b9c803dd4872 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:56.131685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577f8b6-79aa-4bf6-9257-b9c803dd4872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:56.137171 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577f8b6-79aa-4bf6-9257-b9c803dd4872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:56.139457 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577f8b6-79aa-4bf6-9257-b9c803dd4872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:56.141815 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577f8b6-79aa-4bf6-9257-b9c803dd4872 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:56.162585 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 847/1690] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:56.169600 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577f8b6-79aa-4bf6-9257-b9c803dd4872 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:56.176168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 844/1691] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:56.189770 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577f8b6-79aa-4bf6-9257-b9c803dd4872 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:56.201541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2154b8-919d-43cb-8745-9bd68a661e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:56.202554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2154b8-919d-43cb-8745-9bd68a661e18 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:56.202846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2154b8-919d-43cb-8745-9bd68a661e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:56.203171 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2154b8-919d-43cb-8745-9bd68a661e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:56.204464 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2154b8-919d-43cb-8745-9bd68a661e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:56.204576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000fd80-e1a3-452c-99a5-b7492c426ba8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:56.206073 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0000fd80-e1a3-452c-99a5-b7492c426ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:56.209542 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2154b8-919d-43cb-8745-9bd68a661e18 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:56.234704 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 848/1692] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:56.240353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2154b8-919d-43cb-8745-9bd68a661e18 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:56.272258 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2154b8-919d-43cb-8745-9bd68a661e18 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:56.281653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec5ab9-b1ca-4c20-97f7-c2618c551866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:56.283654 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec5ab9-b1ca-4c20-97f7-c2618c551866 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:56.283936 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec5ab9-b1ca-4c20-97f7-c2618c551866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:56.284212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec5ab9-b1ca-4c20-97f7-c2618c551866 admin admin] PATH_INFO: `/v3/projects/3de1f9a92a3141c0bda0c8795652bc04/users/caf7aa45c9b548d08aa4fa64aab29848/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:56.302900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:56.336433 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec5ab9-b1ca-4c20-97f7-c2618c551866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de1f9a92a3141c0bda0c8795652bc04, user_id=caf7aa45c9b548d08aa4fa64aab29848, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:56.340469 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec5ab9-b1ca-4c20-97f7-c2618c551866 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:56.355177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000fd80-e1a3-452c-99a5-b7492c426ba8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:56.365597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825267e1-9cf5-47fb-97bb-6f88668e85aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:56.366849 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825267e1-9cf5-47fb-97bb-6f88668e85aa service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:56.367243 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825267e1-9cf5-47fb-97bb-6f88668e85aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:56.368618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825267e1-9cf5-47fb-97bb-6f88668e85aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:56.377551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 849/1693] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:56 2022] PUT /identity/v3/projects/3de1f9a92a3141c0bda0c8795652bc04/users/caf7aa45c9b548d08aa4fa64aab29848/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:27:56.381567 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91af10-5db2-4ea8-9eb4-f43294e50468 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:56.381817 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91af10-5db2-4ea8-9eb4-f43294e50468 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:56.382109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91af10-5db2-4ea8-9eb4-f43294e50468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:56.410236 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825267e1-9cf5-47fb-97bb-6f88668e85aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:56.413530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825267e1-9cf5-47fb-97bb-6f88668e85aa service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:56.428566 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2f91af10-5db2-4ea8-9eb4-f43294e50468 None None] MFA Rules not processed for user `caf7aa45c9b548d08aa4fa64aab29848`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:56.431031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2f91af10-5db2-4ea8-9eb4-f43294e50468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:56.443418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 845/1694] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:27:56.502696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825267e1-9cf5-47fb-97bb-6f88668e85aa service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:56.525323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825267e1-9cf5-47fb-97bb-6f88668e85aa service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:56.679353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 850/1695] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:56.681178 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91af10-5db2-4ea8-9eb4-f43294e50468 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:56.693161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2f91af10-5db2-4ea8-9eb4-f43294e50468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:56.777370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af60a5-c4fd-4f4a-b61e-2e94df038cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:56.778853 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af60a5-c4fd-4f4a-b61e-2e94df038cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:56.779302 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af60a5-c4fd-4f4a-b61e-2e94df038cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:56.779715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af60a5-c4fd-4f4a-b61e-2e94df038cde admin admin] PATH_INFO: `/v3/users/2e2031671b3d4719bcf8e78522a7e1d0` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:56.781248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af60a5-c4fd-4f4a-b61e-2e94df038cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e2031671b3d4719bcf8e78522a7e1d0)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:56.783962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af60a5-c4fd-4f4a-b61e-2e94df038cde admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:56.895555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91af10-5db2-4ea8-9eb4-f43294e50468 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:56.913714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d35715-7999-4d10-bf0b-b9e0144f6f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:56.913941 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-45af60a5-c4fd-4f4a-b61e-2e94df038cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e2031671b3d4719bcf8e78522a7e1d0'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:56.917011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d35715-7999-4d10-bf0b-b9e0144f6f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:56.918759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d35715-7999-4d10-bf0b-b9e0144f6f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:56.919184 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d35715-7999-4d10-bf0b-b9e0144f6f05 admin admin] PATH_INFO: `/v3/users/b2fd5d3dfbca4944bb180ce8b7fcae19` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:56.919816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-45af60a5-c4fd-4f4a-b61e-2e94df038cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e2031671b3d4719bcf8e78522a7e1d0'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:56.925378 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d35715-7999-4d10-bf0b-b9e0144f6f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2fd5d3dfbca4944bb180ce8b7fcae19)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:56.928484 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d35715-7999-4d10-bf0b-b9e0144f6f05 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:56.936323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-45af60a5-c4fd-4f4a-b61e-2e94df038cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e2031671b3d4719bcf8e78522a7e1d0'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:56.937201 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-45af60a5-c4fd-4f4a-b61e-2e94df038cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e2031671b3d4719bcf8e78522a7e1d0'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:56.949571 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-45af60a5-c4fd-4f4a-b61e-2e94df038cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e2031671b3d4719bcf8e78522a7e1d0'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:56.968324 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:56.981513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 846/1696] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:56 2022] DELETE /identity/v3/users/2e2031671b3d4719bcf8e78522a7e1d0 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:56.989894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af60a5-c4fd-4f4a-b61e-2e94df038cde admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:56.993341 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-45af60a5-c4fd-4f4a-b61e-2e94df038cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:57.134444 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c9d35715-7999-4d10-bf0b-b9e0144f6f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2fd5d3dfbca4944bb180ce8b7fcae19'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:57.135329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c9d35715-7999-4d10-bf0b-b9e0144f6f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2fd5d3dfbca4944bb180ce8b7fcae19'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:57.169948 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af60a5-c4fd-4f4a-b61e-2e94df038cde admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:57.174314 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c9d35715-7999-4d10-bf0b-b9e0144f6f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2fd5d3dfbca4944bb180ce8b7fcae19'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:57.179588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929b058-d73b-4714-a3dd-061dce930253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:57.180634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929b058-d73b-4714-a3dd-061dce930253 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.181011 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929b058-d73b-4714-a3dd-061dce930253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.181420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929b058-d73b-4714-a3dd-061dce930253 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.182218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929b058-d73b-4714-a3dd-061dce930253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:57.186244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929b058-d73b-4714-a3dd-061dce930253 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:57.199465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c9d35715-7999-4d10-bf0b-b9e0144f6f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2fd5d3dfbca4944bb180ce8b7fcae19'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:57.200681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c9d35715-7999-4d10-bf0b-b9e0144f6f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2fd5d3dfbca4944bb180ce8b7fcae19'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:57.211273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:57.243841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 851/1697] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:56 2022] DELETE /identity/v3/users/b2fd5d3dfbca4944bb180ce8b7fcae19 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:57.245789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1d939-ebb6-4835-9996-d0c48ec9f51c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.246192 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1d939-ebb6-4835-9996-d0c48ec9f51c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.246565 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1d939-ebb6-4835-9996-d0c48ec9f51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.263943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 847/1698] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:56 2022] POST /identity/v3/projects => generated 387 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:57.267153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32d944-a67b-4580-bd5a-ab412e1aa112 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.270608 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32d944-a67b-4580-bd5a-ab412e1aa112 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.271153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32d944-a67b-4580-bd5a-ab412e1aa112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.311290 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2d32d944-a67b-4580-bd5a-ab412e1aa112 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:57.313618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2d32d944-a67b-4580-bd5a-ab412e1aa112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:57.315384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2bb1d939-ebb6-4835-9996-d0c48ec9f51c None None] MFA Rules not processed for user `b42aeef31b0449af97c3da52e27307fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:57.316778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2bb1d939-ebb6-4835-9996-d0c48ec9f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:57.469974 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 848/1699] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:57.472428 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0398b-9d4e-4acd-8cb8-1ab38b5acd83 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.473299 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0398b-9d4e-4acd-8cb8-1ab38b5acd83 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.474872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0398b-9d4e-4acd-8cb8-1ab38b5acd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.486132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 852/1700] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:57.487923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1d939-ebb6-4835-9996-d0c48ec9f51c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:57.490910 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2bb1d939-ebb6-4835-9996-d0c48ec9f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:57.515298 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e0e0398b-9d4e-4acd-8cb8-1ab38b5acd83 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:57.520875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e0e0398b-9d4e-4acd-8cb8-1ab38b5acd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:57.526494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1d939-ebb6-4835-9996-d0c48ec9f51c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:57.552879 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a86ded-7a6f-42d9-adaa-2dccc6e5fc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:57.564630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a86ded-7a6f-42d9-adaa-2dccc6e5fc89 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.564630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a86ded-7a6f-42d9-adaa-2dccc6e5fc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.564630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a86ded-7a6f-42d9-adaa-2dccc6e5fc89 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.564630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a86ded-7a6f-42d9-adaa-2dccc6e5fc89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:57.566541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 849/1701] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:57.568426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80602712-b4e7-4ca8-90f9-3c3438d8db6f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.574583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80602712-b4e7-4ca8-90f9-3c3438d8db6f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.575972 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80602712-b4e7-4ca8-90f9-3c3438d8db6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.577983 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a86ded-7a6f-42d9-adaa-2dccc6e5fc89 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:57.640616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-80602712-b4e7-4ca8-90f9-3c3438d8db6f None None] MFA Rules not processed for user `b42aeef31b0449af97c3da52e27307fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:57.647411 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-80602712-b4e7-4ca8-90f9-3c3438d8db6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:57.662513 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 853/1702] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:57 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:57.662513 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a86ded-7a6f-42d9-adaa-2dccc6e5fc89 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:57.667190 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-38a86ded-7a6f-42d9-adaa-2dccc6e5fc89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:57.681141 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 850/1703] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:57.691903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80602712-b4e7-4ca8-90f9-3c3438d8db6f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:57.698523 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-80602712-b4e7-4ca8-90f9-3c3438d8db6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:57.820917 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a86ded-7a6f-42d9-adaa-2dccc6e5fc89 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:57.825139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7794c-bf23-4c91-82f5-6d5d1f0a09b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:57.826203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7794c-bf23-4c91-82f5-6d5d1f0a09b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.826583 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7794c-bf23-4c91-82f5-6d5d1f0a09b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.826955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7794c-bf23-4c91-82f5-6d5d1f0a09b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.836641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80602712-b4e7-4ca8-90f9-3c3438d8db6f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:57.838649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7794c-bf23-4c91-82f5-6d5d1f0a09b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:57.840236 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7794c-bf23-4c91-82f5-6d5d1f0a09b3 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:57.850342 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d022af5-1a11-4f54-b686-7bab5766fe92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:57.851118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d022af5-1a11-4f54-b686-7bab5766fe92 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.851501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d022af5-1a11-4f54-b686-7bab5766fe92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.851881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d022af5-1a11-4f54-b686-7bab5766fe92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.856290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 854/1704] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:57.858414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5219ce1-89e3-4aff-8312-dc994fe54464 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.859325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5219ce1-89e3-4aff-8312-dc994fe54464 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.860883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5219ce1-89e3-4aff-8312-dc994fe54464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.870352 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d022af5-1a11-4f54-b686-7bab5766fe92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:57.872315 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d022af5-1a11-4f54-b686-7bab5766fe92 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:57.884949 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 851/1705] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:57.886331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d022af5-1a11-4f54-b686-7bab5766fe92 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:57.898789 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d022af5-1a11-4f54-b686-7bab5766fe92 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:57.908782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24ad59-9b5d-4420-a5b9-2d45b3ddea8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:57.909650 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24ad59-9b5d-4420-a5b9-2d45b3ddea8a admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.910053 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24ad59-9b5d-4420-a5b9-2d45b3ddea8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.910615 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24ad59-9b5d-4420-a5b9-2d45b3ddea8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.911248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24ad59-9b5d-4420-a5b9-2d45b3ddea8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:57.913763 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24ad59-9b5d-4420-a5b9-2d45b3ddea8a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:57.917983 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:57.935405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f5219ce1-89e3-4aff-8312-dc994fe54464 None None] MFA Rules not processed for user `1fc73723cc744362941270f74946b3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:57.942423 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f5219ce1-89e3-4aff-8312-dc994fe54464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:57.958505 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 852/1706] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:57.959692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24ad59-9b5d-4420-a5b9-2d45b3ddea8a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:57.963359 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0b24ad59-9b5d-4420-a5b9-2d45b3ddea8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:58.121176 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 855/1707] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:58.125047 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5219ce1-89e3-4aff-8312-dc994fe54464 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:58.152238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5219ce1-89e3-4aff-8312-dc994fe54464 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:58.167669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24ad59-9b5d-4420-a5b9-2d45b3ddea8a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:58.168216 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f4bd7-0002-47e2-b8f9-109d4e107361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:58.169319 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f4bd7-0002-47e2-b8f9-109d4e107361 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.169752 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f4bd7-0002-47e2-b8f9-109d4e107361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.170183 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f4bd7-0002-47e2-b8f9-109d4e107361 admin admin] PATH_INFO: `/v3/projects/92bd331ed5024e4c9c044ac44ce2f071/users/cf93f5127eef47abbd33e01b6549c336/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.179260 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630065ac-a041-4665-80e3-596f963a9375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:58.180100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630065ac-a041-4665-80e3-596f963a9375 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.180390 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630065ac-a041-4665-80e3-596f963a9375 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.180666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630065ac-a041-4665-80e3-596f963a9375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.193524 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:58.203691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f4bd7-0002-47e2-b8f9-109d4e107361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92bd331ed5024e4c9c044ac44ce2f071, user_id=cf93f5127eef47abbd33e01b6549c336, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:58.206860 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630065ac-a041-4665-80e3-596f963a9375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:58.209296 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630065ac-a041-4665-80e3-596f963a9375 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:58.216297 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f4bd7-0002-47e2-b8f9-109d4e107361 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:58.228382 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 853/1708] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:58.249036 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 856/1709] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:58 2022] PUT /identity/v3/projects/92bd331ed5024e4c9c044ac44ce2f071/users/cf93f5127eef47abbd33e01b6549c336/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:58.250936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630065ac-a041-4665-80e3-596f963a9375 service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:58.264678 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630065ac-a041-4665-80e3-596f963a9375 service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:58.465709 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3aa43-194e-42ac-a33e-3e428a2f145c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:58.467019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3aa43-194e-42ac-a33e-3e428a2f145c admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.467420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3aa43-194e-42ac-a33e-3e428a2f145c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.467774 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3aa43-194e-42ac-a33e-3e428a2f145c admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.468666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3aa43-194e-42ac-a33e-3e428a2f145c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:58.471044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3aa43-194e-42ac-a33e-3e428a2f145c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:58.487002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 854/1710] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:58.488204 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f4bd7-0002-47e2-b8f9-109d4e107361 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:58.502887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f4bd7-0002-47e2-b8f9-109d4e107361 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:58.508086 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461535c-4634-4d35-bd26-ae1f4dfc88d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:58.509116 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461535c-4634-4d35-bd26-ae1f4dfc88d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.509539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461535c-4634-4d35-bd26-ae1f4dfc88d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.509894 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461535c-4634-4d35-bd26-ae1f4dfc88d3 admin admin] PATH_INFO: `/v3/projects/92bd331ed5024e4c9c044ac44ce2f071/users/cf93f5127eef47abbd33e01b6549c336/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.512498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461535c-4634-4d35-bd26-ae1f4dfc88d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92bd331ed5024e4c9c044ac44ce2f071, user_id=cf93f5127eef47abbd33e01b6549c336, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:58.515394 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461535c-4634-4d35-bd26-ae1f4dfc88d3 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:58.540456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bdaf7-00af-4fc0-8612-dc74b4188cfb None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.540864 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bdaf7-00af-4fc0-8612-dc74b4188cfb None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.541247 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bdaf7-00af-4fc0-8612-dc74b4188cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.543383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 857/1711] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:58 2022] PUT /identity/v3/projects/92bd331ed5024e4c9c044ac44ce2f071/users/cf93f5127eef47abbd33e01b6549c336/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:58.586269 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-347bdaf7-00af-4fc0-8612-dc74b4188cfb None None] MFA Rules not processed for user `cf93f5127eef47abbd33e01b6549c336`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:58.587057 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-347bdaf7-00af-4fc0-8612-dc74b4188cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:58.709659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461535c-4634-4d35-bd26-ae1f4dfc88d3 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:58.711534 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4461535c-4634-4d35-bd26-ae1f4dfc88d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:58.721173 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 855/1712] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:58.824935 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461535c-4634-4d35-bd26-ae1f4dfc88d3 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:58.832232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a7130-353e-49e2-9052-7b301d54b27a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:58.833083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a7130-353e-49e2-9052-7b301d54b27a service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.833478 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a7130-353e-49e2-9052-7b301d54b27a service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.833936 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a7130-353e-49e2-9052-7b301d54b27a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.852667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a7130-353e-49e2-9052-7b301d54b27a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:58.856833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a7130-353e-49e2-9052-7b301d54b27a service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:58.872159 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 858/1713] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:59.008925 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a7130-353e-49e2-9052-7b301d54b27a service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:59.010202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cc50f-4f90-442d-bead-f4c0c51ccb85 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:59.010618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cc50f-4f90-442d-bead-f4c0c51ccb85 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:59.011698 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cc50f-4f90-442d-bead-f4c0c51ccb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:59.026335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:59.096748 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4d9cc50f-4f90-442d-bead-f4c0c51ccb85 None None] MFA Rules not processed for user `f16b40fe2b734406a6d1494f30e0c1e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:59.099377 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4d9cc50f-4f90-442d-bead-f4c0c51ccb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:59.233287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a7130-353e-49e2-9052-7b301d54b27a service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:59.243949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d985d-bde1-4e9f-a805-1618a47d8da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:59.244952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d985d-bde1-4e9f-a805-1618a47d8da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:59.245386 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d985d-bde1-4e9f-a805-1618a47d8da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:59.247682 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d985d-bde1-4e9f-a805-1618a47d8da7 admin admin] PATH_INFO: `/v3/users/caf7aa45c9b548d08aa4fa64aab29848` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:59.250158 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d985d-bde1-4e9f-a805-1618a47d8da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf7aa45c9b548d08aa4fa64aab29848)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:59.259475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d985d-bde1-4e9f-a805-1618a47d8da7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:59.381108 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 856/1714] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:59.395982 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376f21d-f3c1-4d1b-ba61-928603a4661b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:59.396295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376f21d-f3c1-4d1b-ba61-928603a4661b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:59.396581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376f21d-f3c1-4d1b-ba61-928603a4661b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:59.413683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d94d985d-bde1-4e9f-a805-1618a47d8da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf7aa45c9b548d08aa4fa64aab29848'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:59.417707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d94d985d-bde1-4e9f-a805-1618a47d8da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf7aa45c9b548d08aa4fa64aab29848'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:59.443695 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d94d985d-bde1-4e9f-a805-1618a47d8da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf7aa45c9b548d08aa4fa64aab29848'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:59.463678 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d94d985d-bde1-4e9f-a805-1618a47d8da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf7aa45c9b548d08aa4fa64aab29848'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:59.464768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d94d985d-bde1-4e9f-a805-1618a47d8da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf7aa45c9b548d08aa4fa64aab29848'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:59.468929 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d376f21d-f3c1-4d1b-ba61-928603a4661b None None] MFA Rules not processed for user `f16b40fe2b734406a6d1494f30e0c1e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:59.481614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d376f21d-f3c1-4d1b-ba61-928603a4661b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:59.485583 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:59.495889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 859/1715] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:59 2022] DELETE /identity/v3/users/caf7aa45c9b548d08aa4fa64aab29848 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:59.498375 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e52123-a92e-4e5b-9b32-251a72434839 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:59.498951 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e52123-a92e-4e5b-9b32-251a72434839 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:59.499542 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e52123-a92e-4e5b-9b32-251a72434839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:59.512761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 857/1716] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:59.547995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e7e52123-a92e-4e5b-9b32-251a72434839 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:59.549660 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e7e52123-a92e-4e5b-9b32-251a72434839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:59.699616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 860/1717] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:59.773109 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376f21d-f3c1-4d1b-ba61-928603a4661b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:59.776361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb98396-fa49-41a4-b803-970ba86cda6f None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:59.776890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb98396-fa49-41a4-b803-970ba86cda6f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:59.777684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb98396-fa49-41a4-b803-970ba86cda6f None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:59.780863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 861/1718] 10.222.0.57 () {54 vars in 912 bytes} [Tue Jul 12 18:27:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:27:59.786193 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d376f21d-f3c1-4d1b-ba61-928603a4661b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:59.794524 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fea110-ba67-4381-b4fd-c584c8b2696e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:59.794809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fea110-ba67-4381-b4fd-c584c8b2696e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:59.795255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fea110-ba67-4381-b4fd-c584c8b2696e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:59.900257 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b2fea110-ba67-4381-b4fd-c584c8b2696e None None] MFA Rules not processed for user `b6dc63ae259842209831040cbf45d316`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:59.905757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b2fea110-ba67-4381-b4fd-c584c8b2696e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:59.967095 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376f21d-f3c1-4d1b-ba61-928603a4661b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:00.036981 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 862/1719] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Jul 12 18:27:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:28:00.042864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160cace-517d-4674-9668-f940d15782d3 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:00.043174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160cace-517d-4674-9668-f940d15782d3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:00.043510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160cace-517d-4674-9668-f940d15782d3 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:00.045910 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 863/1720] 10.222.0.57 () {54 vars in 912 bytes} [Tue Jul 12 18:28:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:28:00.047700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160cace-517d-4674-9668-f940d15782d3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:00.049617 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d160cace-517d-4674-9668-f940d15782d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:00.070817 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9d099-d333-43da-8ed0-ad8b86fe81ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:00.071639 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9d099-d333-43da-8ed0-ad8b86fe81ba service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:00.072131 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9d099-d333-43da-8ed0-ad8b86fe81ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:00.072625 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9d099-d333-43da-8ed0-ad8b86fe81ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:00.073934 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160cace-517d-4674-9668-f940d15782d3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:00.079675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0db53-d868-4945-9318-75b23ff177f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:00.080660 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0db53-d868-4945-9318-75b23ff177f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:00.080942 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0db53-d868-4945-9318-75b23ff177f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:00.081215 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0db53-d868-4945-9318-75b23ff177f7 admin admin] PATH_INFO: `/v3/projects/13eba785203e485d8e9d368a02d619ba` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:00.083134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0db53-d868-4945-9318-75b23ff177f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13eba785203e485d8e9d368a02d619ba)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:00.084614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9d099-d333-43da-8ed0-ad8b86fe81ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:00.085218 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0db53-d868-4945-9318-75b23ff177f7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:00.086470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9d099-d333-43da-8ed0-ad8b86fe81ba service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:00.099656 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 858/1721] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:28:00.100635 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9d099-d333-43da-8ed0-ad8b86fe81ba service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:00.102711 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-fbb9d099-d333-43da-8ed0-ad8b86fe81ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:00.121454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9d099-d333-43da-8ed0-ad8b86fe81ba service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:00.129017 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462bf78-c1ac-453f-bd6a-c8be669ab121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:00.130147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462bf78-c1ac-453f-bd6a-c8be669ab121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:00.130590 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462bf78-c1ac-453f-bd6a-c8be669ab121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:00.131123 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462bf78-c1ac-453f-bd6a-c8be669ab121 admin admin] PATH_INFO: `/v3/projects/ff78abb5180841a6b084d82edee01fef` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:00.132798 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462bf78-c1ac-453f-bd6a-c8be669ab121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff78abb5180841a6b084d82edee01fef)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:00.135482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462bf78-c1ac-453f-bd6a-c8be669ab121 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:00.154548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d8d0db53-d868-4945-9318-75b23ff177f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13eba785203e485d8e9d368a02d619ba', 'request_id': 'req-d8d0db53-d868-4945-9318-75b23ff177f7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.171908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d8d0db53-d868-4945-9318-75b23ff177f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13eba785203e485d8e9d368a02d619ba', 'request_id': 'req-d8d0db53-d868-4945-9318-75b23ff177f7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.182130 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d8d0db53-d868-4945-9318-75b23ff177f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13eba785203e485d8e9d368a02d619ba', 'request_id': 'req-d8d0db53-d868-4945-9318-75b23ff177f7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.212081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d8d0db53-d868-4945-9318-75b23ff177f7 admin admin] The token cache is being invalidate because project 13eba785203e485d8e9d368a02d619ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:00.213230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:00.215052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d8d0db53-d868-4945-9318-75b23ff177f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.216227 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d8d0db53-d868-4945-9318-75b23ff177f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.220590 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 864/1722] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:00 2022] DELETE /identity/v3/projects/13eba785203e485d8e9d368a02d619ba => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:00.222209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0db53-d868-4945-9318-75b23ff177f7 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:00.224454 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d8d0db53-d868-4945-9318-75b23ff177f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:00.238888 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4462bf78-c1ac-453f-bd6a-c8be669ab121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff78abb5180841a6b084d82edee01fef', 'request_id': 'req-4462bf78-c1ac-453f-bd6a-c8be669ab121'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.247620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4462bf78-c1ac-453f-bd6a-c8be669ab121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff78abb5180841a6b084d82edee01fef', 'request_id': 'req-4462bf78-c1ac-453f-bd6a-c8be669ab121'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.266903 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:00.273430 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4462bf78-c1ac-453f-bd6a-c8be669ab121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff78abb5180841a6b084d82edee01fef', 'request_id': 'req-4462bf78-c1ac-453f-bd6a-c8be669ab121'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.297939 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4462bf78-c1ac-453f-bd6a-c8be669ab121 admin admin] The token cache is being invalidate because project ff78abb5180841a6b084d82edee01fef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:00.298584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4462bf78-c1ac-453f-bd6a-c8be669ab121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.299687 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4462bf78-c1ac-453f-bd6a-c8be669ab121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.306620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 859/1723] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:00 2022] DELETE /identity/v3/projects/ff78abb5180841a6b084d82edee01fef => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:00.306620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89ebf9-a692-4777-9b73-a54ac549d554 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:00.306620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89ebf9-a692-4777-9b73-a54ac549d554 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:00.306620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89ebf9-a692-4777-9b73-a54ac549d554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:00.330957 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0db53-d868-4945-9318-75b23ff177f7 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:00.336277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2c89ebf9-a692-4777-9b73-a54ac549d554 None None] MFA Rules not processed for user `b6dc63ae259842209831040cbf45d316`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:00.337709 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2c89ebf9-a692-4777-9b73-a54ac549d554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:00.403847 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 860/1724] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Jul 12 18:28:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:00.410464 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89ebf9-a692-4777-9b73-a54ac549d554 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:00.412147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2c89ebf9-a692-4777-9b73-a54ac549d554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:00.444877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c1691-d6ef-4802-b0d2-d5c5a0fd1d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:00.445582 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c1691-d6ef-4802-b0d2-d5c5a0fd1d45 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:00.445863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c1691-d6ef-4802-b0d2-d5c5a0fd1d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:00.446136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c1691-d6ef-4802-b0d2-d5c5a0fd1d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:00.452557 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-598c1691-d6ef-4802-b0d2-d5c5a0fd1d45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:00.480079 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c1691-d6ef-4802-b0d2-d5c5a0fd1d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:00.481921 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c1691-d6ef-4802-b0d2-d5c5a0fd1d45 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:00.493316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 865/1725] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:00.495720 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c1691-d6ef-4802-b0d2-d5c5a0fd1d45 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:00.507218 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-598c1691-d6ef-4802-b0d2-d5c5a0fd1d45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:00.540897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89ebf9-a692-4777-9b73-a54ac549d554 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:00.547216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd86406-4151-464f-bb42-56b2e1349812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:00.548645 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd86406-4151-464f-bb42-56b2e1349812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:00.548871 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd86406-4151-464f-bb42-56b2e1349812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:00.549153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd86406-4151-464f-bb42-56b2e1349812 admin admin] PATH_INFO: `/v3/users/76d8d2f25a424c10ac9a5639ce760ccf` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:00.550447 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd86406-4151-464f-bb42-56b2e1349812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d8d2f25a424c10ac9a5639ce760ccf)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:00.552469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd86406-4151-464f-bb42-56b2e1349812 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:00.623855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c1691-d6ef-4802-b0d2-d5c5a0fd1d45 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:00.631214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6d55c-1784-4f65-ac38-25015ba804d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:00.632718 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6d55c-1784-4f65-ac38-25015ba804d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:00.633221 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6d55c-1784-4f65-ac38-25015ba804d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:00.633756 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6d55c-1784-4f65-ac38-25015ba804d3 admin admin] PATH_INFO: `/v3/users/ed0effc7e86b459084745d73f0271a84` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:00.635736 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6d55c-1784-4f65-ac38-25015ba804d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed0effc7e86b459084745d73f0271a84)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:00.638068 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5cd86406-4151-464f-bb42-56b2e1349812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d8d2f25a424c10ac9a5639ce760ccf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.638668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6d55c-1784-4f65-ac38-25015ba804d3 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:00.639125 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5cd86406-4151-464f-bb42-56b2e1349812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d8d2f25a424c10ac9a5639ce760ccf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.651952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5cd86406-4151-464f-bb42-56b2e1349812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d8d2f25a424c10ac9a5639ce760ccf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.652734 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5cd86406-4151-464f-bb42-56b2e1349812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d8d2f25a424c10ac9a5639ce760ccf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.677858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5cd86406-4151-464f-bb42-56b2e1349812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d8d2f25a424c10ac9a5639ce760ccf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.707162 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:00.726417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 861/1726] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:00 2022] DELETE /identity/v3/users/76d8d2f25a424c10ac9a5639ce760ccf => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:00.728236 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569ab37-c327-40b3-a25d-5dc686c31205 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:00.729715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569ab37-c327-40b3-a25d-5dc686c31205 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:00.729998 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569ab37-c327-40b3-a25d-5dc686c31205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:00.755085 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f3c6d55c-1784-4f65-ac38-25015ba804d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed0effc7e86b459084745d73f0271a84'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.756449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f3c6d55c-1784-4f65-ac38-25015ba804d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed0effc7e86b459084745d73f0271a84'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.785561 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f3c6d55c-1784-4f65-ac38-25015ba804d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed0effc7e86b459084745d73f0271a84'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.785714 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6569ab37-c327-40b3-a25d-5dc686c31205 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:00.788443 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6569ab37-c327-40b3-a25d-5dc686c31205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:00.798387 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f3c6d55c-1784-4f65-ac38-25015ba804d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed0effc7e86b459084745d73f0271a84'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.801997 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f3c6d55c-1784-4f65-ac38-25015ba804d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed0effc7e86b459084745d73f0271a84'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:00.818353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:00.853741 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 866/1727] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:00 2022] DELETE /identity/v3/users/ed0effc7e86b459084745d73f0271a84 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:00.854625 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6d55c-1784-4f65-ac38-25015ba804d3 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:00.859461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f3c6d55c-1784-4f65-ac38-25015ba804d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:01.011411 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6d55c-1784-4f65-ac38-25015ba804d3 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:01.020596 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf44ee-3fde-4ab0-8bb8-e7bde4f4bce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:01.021275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf44ee-3fde-4ab0-8bb8-e7bde4f4bce0 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:01.021579 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf44ee-3fde-4ab0-8bb8-e7bde4f4bce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:01.022233 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf44ee-3fde-4ab0-8bb8-e7bde4f4bce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:01.031154 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2ebf44ee-3fde-4ab0-8bb8-e7bde4f4bce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:01.053827 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf44ee-3fde-4ab0-8bb8-e7bde4f4bce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:01.055210 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf44ee-3fde-4ab0-8bb8-e7bde4f4bce0 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:01.078620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 867/1728] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:01.086669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bad26-571e-4dfb-b8fe-86e0d86bb8ac None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:01.086812 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bad26-571e-4dfb-b8fe-86e0d86bb8ac None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:01.086903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 862/1729] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:01.087330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bad26-571e-4dfb-b8fe-86e0d86bb8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:01.088477 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569ab37-c327-40b3-a25d-5dc686c31205 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:01.096394 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6569ab37-c327-40b3-a25d-5dc686c31205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:01.133110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569ab37-c327-40b3-a25d-5dc686c31205 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:01.134342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c27bad26-571e-4dfb-b8fe-86e0d86bb8ac None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:01.135560 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c27bad26-571e-4dfb-b8fe-86e0d86bb8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:01.298781 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619ce30-ad8e-4675-9886-9965f5e32aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:01.300509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619ce30-ad8e-4675-9886-9965f5e32aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:01.300876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619ce30-ad8e-4675-9886-9965f5e32aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:01.303723 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619ce30-ad8e-4675-9886-9965f5e32aac admin admin] PATH_INFO: `/v3/projects/3de1f9a92a3141c0bda0c8795652bc04` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:01.306809 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619ce30-ad8e-4675-9886-9965f5e32aac admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de1f9a92a3141c0bda0c8795652bc04)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:01.322040 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619ce30-ad8e-4675-9886-9965f5e32aac admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:01.354928 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 868/1730] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:01.356531 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb3ec6-1723-473a-a390-fcac916245bb None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:01.356961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb3ec6-1723-473a-a390-fcac916245bb None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:01.357411 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb3ec6-1723-473a-a390-fcac916245bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:01.426809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2cfb3ec6-1723-473a-a390-fcac916245bb None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:01.427491 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2cfb3ec6-1723-473a-a390-fcac916245bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:01.458827 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 869/1731] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:01.458827 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb3ec6-1723-473a-a390-fcac916245bb None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:01.458827 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2cfb3ec6-1723-473a-a390-fcac916245bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:01.501797 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb3ec6-1723-473a-a390-fcac916245bb None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:01.519259 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c619ce30-ad8e-4675-9886-9965f5e32aac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de1f9a92a3141c0bda0c8795652bc04', 'request_id': 'req-c619ce30-ad8e-4675-9886-9965f5e32aac'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:01.527743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c619ce30-ad8e-4675-9886-9965f5e32aac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de1f9a92a3141c0bda0c8795652bc04', 'request_id': 'req-c619ce30-ad8e-4675-9886-9965f5e32aac'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:01.538945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c619ce30-ad8e-4675-9886-9965f5e32aac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de1f9a92a3141c0bda0c8795652bc04', 'request_id': 'req-c619ce30-ad8e-4675-9886-9965f5e32aac'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:01.575031 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c619ce30-ad8e-4675-9886-9965f5e32aac admin admin] The token cache is being invalidate because project 3de1f9a92a3141c0bda0c8795652bc04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:01.575643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c619ce30-ad8e-4675-9886-9965f5e32aac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:01.576718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c619ce30-ad8e-4675-9886-9965f5e32aac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:01.582489 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 863/1732] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:01 2022] DELETE /identity/v3/projects/3de1f9a92a3141c0bda0c8795652bc04 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:01.583521 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619ce30-ad8e-4675-9886-9965f5e32aac admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:01.585644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c619ce30-ad8e-4675-9886-9965f5e32aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:01.671822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:01.675706 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45fa17-a7e1-49da-8e9b-8422d4d7a37c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:01.678555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45fa17-a7e1-49da-8e9b-8422d4d7a37c service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:01.678555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45fa17-a7e1-49da-8e9b-8422d4d7a37c service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:01.681889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45fa17-a7e1-49da-8e9b-8422d4d7a37c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:01.686743 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-dc45fa17-a7e1-49da-8e9b-8422d4d7a37c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:01.724479 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619ce30-ad8e-4675-9886-9965f5e32aac admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:01.733223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007c034-62a1-46d9-af5e-4ad86421e322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:01.734187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007c034-62a1-46d9-af5e-4ad86421e322 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:01.735814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007c034-62a1-46d9-af5e-4ad86421e322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:01.736217 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007c034-62a1-46d9-af5e-4ad86421e322 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:01.737923 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007c034-62a1-46d9-af5e-4ad86421e322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:01.738908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007c034-62a1-46d9-af5e-4ad86421e322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:01.742962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007c034-62a1-46d9-af5e-4ad86421e322 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:01.777044 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:01.779688 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 864/1733] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:28:01.792604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007c034-62a1-46d9-af5e-4ad86421e322 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:01.796667 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3007c034-62a1-46d9-af5e-4ad86421e322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:01.814668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45fa17-a7e1-49da-8e9b-8422d4d7a37c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:01.816209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45fa17-a7e1-49da-8e9b-8422d4d7a37c service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:01.839622 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007c034-62a1-46d9-af5e-4ad86421e322 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:01.846944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 870/1734] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:01.847861 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45fa17-a7e1-49da-8e9b-8422d4d7a37c service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:01.848366 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3133222-6ed6-4849-990b-ce51b74a3915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:01.849611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3133222-6ed6-4849-990b-ce51b74a3915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:01.850014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3133222-6ed6-4849-990b-ce51b74a3915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:01.850420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3133222-6ed6-4849-990b-ce51b74a3915 admin admin] PATH_INFO: `/v3/projects/f7ff686b1b2f4072acdcdb2c90fb8afa` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:01.851373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-dc45fa17-a7e1-49da-8e9b-8422d4d7a37c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:01.851939 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3133222-6ed6-4849-990b-ce51b74a3915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7ff686b1b2f4072acdcdb2c90fb8afa)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:01.854240 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3133222-6ed6-4849-990b-ce51b74a3915 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:01.878211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45fa17-a7e1-49da-8e9b-8422d4d7a37c service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:01.893612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c245da-b453-4fde-a09f-e2110dce08f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:01.894822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c245da-b453-4fde-a09f-e2110dce08f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:01.895310 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c245da-b453-4fde-a09f-e2110dce08f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:01.895744 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c245da-b453-4fde-a09f-e2110dce08f8 admin admin] PATH_INFO: `/v3/users/cf93f5127eef47abbd33e01b6549c336` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:01.900108 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c245da-b453-4fde-a09f-e2110dce08f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf93f5127eef47abbd33e01b6549c336)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:01.902623 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c245da-b453-4fde-a09f-e2110dce08f8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:01.957106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a3133222-6ed6-4849-990b-ce51b74a3915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7ff686b1b2f4072acdcdb2c90fb8afa', 'request_id': 'req-a3133222-6ed6-4849-990b-ce51b74a3915'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:01.976352 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a3133222-6ed6-4849-990b-ce51b74a3915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7ff686b1b2f4072acdcdb2c90fb8afa', 'request_id': 'req-a3133222-6ed6-4849-990b-ce51b74a3915'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:01.995131 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a3133222-6ed6-4849-990b-ce51b74a3915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7ff686b1b2f4072acdcdb2c90fb8afa', 'request_id': 'req-a3133222-6ed6-4849-990b-ce51b74a3915'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:02.029672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a3133222-6ed6-4849-990b-ce51b74a3915 admin admin] The token cache is being invalidate because project f7ff686b1b2f4072acdcdb2c90fb8afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:02.030223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a3133222-6ed6-4849-990b-ce51b74a3915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:02.031563 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-22c245da-b453-4fde-a09f-e2110dce08f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf93f5127eef47abbd33e01b6549c336'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:02.031766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a3133222-6ed6-4849-990b-ce51b74a3915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:02.033966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-22c245da-b453-4fde-a09f-e2110dce08f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf93f5127eef47abbd33e01b6549c336'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:02.044773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 865/1735] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:01 2022] DELETE /identity/v3/projects/f7ff686b1b2f4072acdcdb2c90fb8afa => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:02.044773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3133222-6ed6-4849-990b-ce51b74a3915 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:02.047803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a3133222-6ed6-4849-990b-ce51b74a3915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:02.079651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-22c245da-b453-4fde-a09f-e2110dce08f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf93f5127eef47abbd33e01b6549c336'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:02.112754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-22c245da-b453-4fde-a09f-e2110dce08f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf93f5127eef47abbd33e01b6549c336'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:02.114393 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-22c245da-b453-4fde-a09f-e2110dce08f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf93f5127eef47abbd33e01b6549c336'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:02.147232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 871/1736] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:01 2022] DELETE /identity/v3/users/cf93f5127eef47abbd33e01b6549c336 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:02.148305 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c245da-b453-4fde-a09f-e2110dce08f8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:02.154516 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-22c245da-b453-4fde-a09f-e2110dce08f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:02.292544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3133222-6ed6-4849-990b-ce51b74a3915 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:02.323085 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c245da-b453-4fde-a09f-e2110dce08f8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:02.342346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27c6c2-a30b-4a92-b52e-b06bfc796823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:02.344692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27c6c2-a30b-4a92-b52e-b06bfc796823 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:02.344983 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27c6c2-a30b-4a92-b52e-b06bfc796823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:02.345280 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27c6c2-a30b-4a92-b52e-b06bfc796823 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:02.352225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27c6c2-a30b-4a92-b52e-b06bfc796823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:02.357917 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27c6c2-a30b-4a92-b52e-b06bfc796823 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:02.369425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:02.457574 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a012d7-dc76-427e-acaf-fc374c45021b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:02.458643 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 872/1737] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:02 2022] POST /identity/v3/projects => generated 405 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:02.460141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df2f4f-f19d-4372-b497-f9f3d6f62538 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:02.460439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df2f4f-f19d-4372-b497-f9f3d6f62538 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:02.460722 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df2f4f-f19d-4372-b497-f9f3d6f62538 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:02.462100 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 873/1738] 10.222.0.57 () {54 vars in 960 bytes} [Tue Jul 12 18:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:28:02.467257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a012d7-dc76-427e-acaf-fc374c45021b service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:02.468404 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a012d7-dc76-427e-acaf-fc374c45021b service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:02.469977 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a012d7-dc76-427e-acaf-fc374c45021b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:02.475862 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-03a012d7-dc76-427e-acaf-fc374c45021b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:02.478539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb6034-683e-4bed-9caf-d9ccbdd0ddb3 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:02.478844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb6034-683e-4bed-9caf-d9ccbdd0ddb3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:02.479124 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb6034-683e-4bed-9caf-d9ccbdd0ddb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:02.529833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-26bb6034-683e-4bed-9caf-d9ccbdd0ddb3 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:02.532794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-26bb6034-683e-4bed-9caf-d9ccbdd0ddb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:02.630490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:02.653921 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a012d7-dc76-427e-acaf-fc374c45021b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:02.656304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a012d7-dc76-427e-acaf-fc374c45021b service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:02.678926 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 874/1739] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:02.678926 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb6034-683e-4bed-9caf-d9ccbdd0ddb3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:02.680864 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 866/1740] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:02.682012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a012d7-dc76-427e-acaf-fc374c45021b service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:02.694279 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-26bb6034-683e-4bed-9caf-d9ccbdd0ddb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:02.697631 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a012d7-dc76-427e-acaf-fc374c45021b service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:02.704513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066fd3d-ca9d-465d-9d82-9661089498d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:02.705572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066fd3d-ca9d-465d-9d82-9661089498d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:02.706112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066fd3d-ca9d-465d-9d82-9661089498d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:02.706602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066fd3d-ca9d-465d-9d82-9661089498d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:02.708165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066fd3d-ca9d-465d-9d82-9661089498d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:02.711212 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066fd3d-ca9d-465d-9d82-9661089498d7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:02.742934 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 867/1741] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:02 2022] POST /identity/v3/users => generated 303 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:02.742934 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b45b3f-a26d-4488-aec2-9000c270c7b7 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:02.742934 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b45b3f-a26d-4488-aec2-9000c270c7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:02.742934 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b45b3f-a26d-4488-aec2-9000c270c7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:02.778441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e5b45b3f-a26d-4488-aec2-9000c270c7b7 None None] MFA Rules not processed for user `206242c775be40c7b96af6de635e2065`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:02.782406 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e5b45b3f-a26d-4488-aec2-9000c270c7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:02.864929 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 868/1742] 10.222.0.57 () {58 vars in 1057 bytes} [Tue Jul 12 18:28:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:02.865975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b45b3f-a26d-4488-aec2-9000c270c7b7 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:02.867352 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e5b45b3f-a26d-4488-aec2-9000c270c7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:02.882423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b45b3f-a26d-4488-aec2-9000c270c7b7 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:02.907289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38622bf9-0740-47e2-8c9d-c81b886a2e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:02.907513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38622bf9-0740-47e2-8c9d-c81b886a2e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:02.907802 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38622bf9-0740-47e2-8c9d-c81b886a2e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:02.908081 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38622bf9-0740-47e2-8c9d-c81b886a2e60 admin admin] PATH_INFO: `/v3/projects/b7749765e1e64a4bb14be8add3c162a5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:02.912578 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38622bf9-0740-47e2-8c9d-c81b886a2e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7749765e1e64a4bb14be8add3c162a5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:02.913247 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb6034-683e-4bed-9caf-d9ccbdd0ddb3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:02.914560 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38622bf9-0740-47e2-8c9d-c81b886a2e60 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:02.925010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1f623-96fb-41a6-bbd1-9381549f46f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206242c775be40c7b96af6de635e2065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:02.925797 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1f623-96fb-41a6-bbd1-9381549f46f4 service placement] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:02.926085 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1f623-96fb-41a6-bbd1-9381549f46f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:02.926371 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1f623-96fb-41a6-bbd1-9381549f46f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:02.937656 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-87e1f623-96fb-41a6-bbd1-9381549f46f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:02.975862 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1f623-96fb-41a6-bbd1-9381549f46f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:02.976255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1f623-96fb-41a6-bbd1-9381549f46f4 service placement] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:02.999393 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 875/1743] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:03.019851 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0033f-ac3a-4c9e-9b57-82b6bce92c9a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:03.020143 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0033f-ac3a-4c9e-9b57-82b6bce92c9a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:03.020406 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0033f-ac3a-4c9e-9b57-82b6bce92c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:03.100108 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-71f0033f-ac3a-4c9e-9b57-82b6bce92c9a None None] MFA Rules not processed for user `b42aeef31b0449af97c3da52e27307fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:03.101361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-71f0033f-ac3a-4c9e-9b57-82b6bce92c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:03.118080 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-38622bf9-0740-47e2-8c9d-c81b886a2e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7749765e1e64a4bb14be8add3c162a5', 'request_id': 'req-38622bf9-0740-47e2-8c9d-c81b886a2e60'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:03.122774 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:03.136390 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-38622bf9-0740-47e2-8c9d-c81b886a2e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7749765e1e64a4bb14be8add3c162a5', 'request_id': 'req-38622bf9-0740-47e2-8c9d-c81b886a2e60'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:03.156662 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-38622bf9-0740-47e2-8c9d-c81b886a2e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7749765e1e64a4bb14be8add3c162a5', 'request_id': 'req-38622bf9-0740-47e2-8c9d-c81b886a2e60'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:03.198543 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-38622bf9-0740-47e2-8c9d-c81b886a2e60 admin admin] The token cache is being invalidate because project b7749765e1e64a4bb14be8add3c162a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:03.198835 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-38622bf9-0740-47e2-8c9d-c81b886a2e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:03.205295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-38622bf9-0740-47e2-8c9d-c81b886a2e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:03.207211 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 869/1744] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:02 2022] DELETE /identity/v3/projects/b7749765e1e64a4bb14be8add3c162a5 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:03.209452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16c414-86fc-40c8-9728-a7b12e246be8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:03.210647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16c414-86fc-40c8-9728-a7b12e246be8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:03.210935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16c414-86fc-40c8-9728-a7b12e246be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:03.235367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-bf16c414-86fc-40c8-9728-a7b12e246be8 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:03.239534 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bf16c414-86fc-40c8-9728-a7b12e246be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:03.300886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 876/1745] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:03.300886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0033f-ac3a-4c9e-9b57-82b6bce92c9a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:03.300886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-71f0033f-ac3a-4c9e-9b57-82b6bce92c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:03.402679 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 870/1746] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:03.402679 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16c414-86fc-40c8-9728-a7b12e246be8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:03.408957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bf16c414-86fc-40c8-9728-a7b12e246be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:03.461671 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0033f-ac3a-4c9e-9b57-82b6bce92c9a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:03.468601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25002952-0899-43cd-848a-4c7636460432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:03.470025 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25002952-0899-43cd-848a-4c7636460432 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:03.470998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25002952-0899-43cd-848a-4c7636460432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:03.471308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25002952-0899-43cd-848a-4c7636460432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:03.472155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25002952-0899-43cd-848a-4c7636460432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:03.474502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25002952-0899-43cd-848a-4c7636460432 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:03.508109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 877/1747] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:03.511731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25002952-0899-43cd-848a-4c7636460432 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:03.522660 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-25002952-0899-43cd-848a-4c7636460432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:03.555317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25002952-0899-43cd-848a-4c7636460432 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:03.580719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82246fe-c236-4699-bfc6-3801c91adfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:03.581673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82246fe-c236-4699-bfc6-3801c91adfca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:03.581959 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82246fe-c236-4699-bfc6-3801c91adfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:03.582237 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82246fe-c236-4699-bfc6-3801c91adfca admin admin] PATH_INFO: `/v3/projects/92bd331ed5024e4c9c044ac44ce2f071` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:03.584750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82246fe-c236-4699-bfc6-3801c91adfca admin admin] RBAC: Authorizing `identity:delete_project(project_id=92bd331ed5024e4c9c044ac44ce2f071)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:03.588777 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82246fe-c236-4699-bfc6-3801c91adfca admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:03.613098 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:03.652918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16c414-86fc-40c8-9728-a7b12e246be8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:03.670819 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a0e4c-f2df-4081-bd66-4e2beb2dede5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206242c775be40c7b96af6de635e2065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:03.675387 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a0e4c-f2df-4081-bd66-4e2beb2dede5 service placement] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:03.676152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a0e4c-f2df-4081-bd66-4e2beb2dede5 service placement] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:03.676911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a0e4c-f2df-4081-bd66-4e2beb2dede5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:03.686178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e06a0e4c-f2df-4081-bd66-4e2beb2dede5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:03.734371 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c82246fe-c236-4699-bfc6-3801c91adfca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92bd331ed5024e4c9c044ac44ce2f071', 'request_id': 'req-c82246fe-c236-4699-bfc6-3801c91adfca'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:03.741393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a0e4c-f2df-4081-bd66-4e2beb2dede5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:03.747611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a0e4c-f2df-4081-bd66-4e2beb2dede5 service placement] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:03.770464 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c82246fe-c236-4699-bfc6-3801c91adfca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92bd331ed5024e4c9c044ac44ce2f071', 'request_id': 'req-c82246fe-c236-4699-bfc6-3801c91adfca'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:03.781039 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 871/1748] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:03.782564 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a0e4c-f2df-4081-bd66-4e2beb2dede5 service placement] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:03.784656 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e06a0e4c-f2df-4081-bd66-4e2beb2dede5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:03.785939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c82246fe-c236-4699-bfc6-3801c91adfca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92bd331ed5024e4c9c044ac44ce2f071', 'request_id': 'req-c82246fe-c236-4699-bfc6-3801c91adfca'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:03.807559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a0e4c-f2df-4081-bd66-4e2beb2dede5 service placement] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:03.818612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c82246fe-c236-4699-bfc6-3801c91adfca admin admin] The token cache is being invalidate because project 92bd331ed5024e4c9c044ac44ce2f071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:03.819384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c82246fe-c236-4699-bfc6-3801c91adfca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:03.821720 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c82246fe-c236-4699-bfc6-3801c91adfca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:03.827257 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 878/1749] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:03 2022] DELETE /identity/v3/projects/92bd331ed5024e4c9c044ac44ce2f071 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:03.830650 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82246fe-c236-4699-bfc6-3801c91adfca admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:03.835921 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c82246fe-c236-4699-bfc6-3801c91adfca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:03.977518 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9177e-e83f-4352-81fb-3b5a352906f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:03.978491 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9177e-e83f-4352-81fb-3b5a352906f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:03.978892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9177e-e83f-4352-81fb-3b5a352906f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:03.979085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9177e-e83f-4352-81fb-3b5a352906f3 admin admin] PATH_INFO: `/v3/users/a07d65441dd0470e82fe53491099de82` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:03.981594 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9177e-e83f-4352-81fb-3b5a352906f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07d65441dd0470e82fe53491099de82)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:03.989320 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9177e-e83f-4352-81fb-3b5a352906f3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:04.043832 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:04.056914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82246fe-c236-4699-bfc6-3801c91adfca admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:04.064536 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a8360-80b4-4af9-a071-f94168a968ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:04.065508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a8360-80b4-4af9-a071-f94168a968ad admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:04.068198 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a8360-80b4-4af9-a071-f94168a968ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:04.068606 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a8360-80b4-4af9-a071-f94168a968ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:04.070066 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a8360-80b4-4af9-a071-f94168a968ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:04.070517 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a8360-80b4-4af9-a071-f94168a968ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:04.072314 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a8360-80b4-4af9-a071-f94168a968ad admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:04.089838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 879/1750] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:28:04.091197 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a8360-80b4-4af9-a071-f94168a968ad admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:04.097417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-149a8360-80b4-4af9-a071-f94168a968ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:04.122206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a8360-80b4-4af9-a071-f94168a968ad admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:04.129744 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61671ab-9132-4c17-8101-7097fb9f15f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:04.130768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61671ab-9132-4c17-8101-7097fb9f15f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:04.131136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61671ab-9132-4c17-8101-7097fb9f15f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:04.131493 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61671ab-9132-4c17-8101-7097fb9f15f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:04.132362 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61671ab-9132-4c17-8101-7097fb9f15f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:04.135070 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61671ab-9132-4c17-8101-7097fb9f15f7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:04.141222 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fca9177e-e83f-4352-81fb-3b5a352906f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07d65441dd0470e82fe53491099de82'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:04.142591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fca9177e-e83f-4352-81fb-3b5a352906f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07d65441dd0470e82fe53491099de82'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:04.153050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 880/1751] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:04.153050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377ce42-1e75-482f-b070-ae3a501a5e36 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:04.153050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377ce42-1e75-482f-b070-ae3a501a5e36 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:04.153050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377ce42-1e75-482f-b070-ae3a501a5e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:04.159824 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fca9177e-e83f-4352-81fb-3b5a352906f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07d65441dd0470e82fe53491099de82'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:04.161338 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fca9177e-e83f-4352-81fb-3b5a352906f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07d65441dd0470e82fe53491099de82'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:04.175338 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fca9177e-e83f-4352-81fb-3b5a352906f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07d65441dd0470e82fe53491099de82'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:04.179112 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f377ce42-1e75-482f-b070-ae3a501a5e36 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:04.180223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f377ce42-1e75-482f-b070-ae3a501a5e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:04.201721 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 881/1752] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:04.202574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377ce42-1e75-482f-b070-ae3a501a5e36 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:04.204327 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f377ce42-1e75-482f-b070-ae3a501a5e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:04.221663 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377ce42-1e75-482f-b070-ae3a501a5e36 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:04.226492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8df7c2-145b-446b-934c-c0c0bfe1f158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:04.227228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8df7c2-145b-446b-934c-c0c0bfe1f158 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:04.227512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8df7c2-145b-446b-934c-c0c0bfe1f158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:04.227934 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8df7c2-145b-446b-934c-c0c0bfe1f158 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:04.229089 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8df7c2-145b-446b-934c-c0c0bfe1f158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:04.231361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8df7c2-145b-446b-934c-c0c0bfe1f158 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:04.234776 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 872/1753] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:03 2022] DELETE /identity/v3/users/a07d65441dd0470e82fe53491099de82 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:04.243422 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9177e-e83f-4352-81fb-3b5a352906f3 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:04.248355 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-fca9177e-e83f-4352-81fb-3b5a352906f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:04.307246 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 882/1754] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:04 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:04.316592 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7286c8c-e026-4cc4-82c0-5b475baed1d1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:04.316902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7286c8c-e026-4cc4-82c0-5b475baed1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:04.319217 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7286c8c-e026-4cc4-82c0-5b475baed1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:04.393379 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d7286c8c-e026-4cc4-82c0-5b475baed1d1 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:04.394650 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d7286c8c-e026-4cc4-82c0-5b475baed1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:04.499134 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9177e-e83f-4352-81fb-3b5a352906f3 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:04.597381 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:04.653785 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 883/1755] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:04.656270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7286c8c-e026-4cc4-82c0-5b475baed1d1 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:04.686090 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7286c8c-e026-4cc4-82c0-5b475baed1d1 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:04.705589 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b88c89-8c5c-47de-a512-ccbff345d267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:04.706591 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b88c89-8c5c-47de-a512-ccbff345d267 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:04.707868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b88c89-8c5c-47de-a512-ccbff345d267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:04.708300 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b88c89-8c5c-47de-a512-ccbff345d267 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:04.713603 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b88c89-8c5c-47de-a512-ccbff345d267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:04.722752 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b88c89-8c5c-47de-a512-ccbff345d267 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:04.768124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b48e3-894a-4a90-a54a-c02cc037b6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:04.770400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b48e3-894a-4a90-a54a-c02cc037b6ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:04.772629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b48e3-894a-4a90-a54a-c02cc037b6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:04.773902 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b48e3-894a-4a90-a54a-c02cc037b6ff admin admin] PATH_INFO: `/v3/projects/064e063be8bc4c15b58d607af0744d33/users/ca254e34434a40a0948fecf65c570ad1/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:04.800125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 884/1756] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:04 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:04.803081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b88c89-8c5c-47de-a512-ccbff345d267 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:04.821941 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b48e3-894a-4a90-a54a-c02cc037b6ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=064e063be8bc4c15b58d607af0744d33, user_id=ca254e34434a40a0948fecf65c570ad1, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:04.828662 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b48e3-894a-4a90-a54a-c02cc037b6ff admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:04.837363 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b88c89-8c5c-47de-a512-ccbff345d267 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:04.857296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7cb7a-9b31-4552-b724-19e5aff4b34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:04.858193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7cb7a-9b31-4552-b724-19e5aff4b34f admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:04.867678 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7cb7a-9b31-4552-b724-19e5aff4b34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:04.868054 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7cb7a-9b31-4552-b724-19e5aff4b34f admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:04.871995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7cb7a-9b31-4552-b724-19e5aff4b34f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:04.872316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7cb7a-9b31-4552-b724-19e5aff4b34f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:04.905247 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 873/1757] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:04 2022] PUT /identity/v3/projects/064e063be8bc4c15b58d607af0744d33/users/ca254e34434a40a0948fecf65c570ad1/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:04.906910 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7cb7a-9b31-4552-b724-19e5aff4b34f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:04.908435 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b48e3-894a-4a90-a54a-c02cc037b6ff admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:04.983689 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 885/1758] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:28:04.994941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e91fad-2c88-4a8a-8537-c7232d01bfd2 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:04.997602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e91fad-2c88-4a8a-8537-c7232d01bfd2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:04.997911 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e91fad-2c88-4a8a-8537-c7232d01bfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:05.036051 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:05.162083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f5e91fad-2c88-4a8a-8537-c7232d01bfd2 None None] MFA Rules not processed for user `ca254e34434a40a0948fecf65c570ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:05.167094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f5e91fad-2c88-4a8a-8537-c7232d01bfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:05.290943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b48e3-894a-4a90-a54a-c02cc037b6ff admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:05.328126 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2059ed-e713-468e-9551-c1adc8bba40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:05.330159 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2059ed-e713-468e-9551-c1adc8bba40e admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:05.330451 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2059ed-e713-468e-9551-c1adc8bba40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:05.330735 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2059ed-e713-468e-9551-c1adc8bba40e admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:05.331478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2059ed-e713-468e-9551-c1adc8bba40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:05.347085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2059ed-e713-468e-9551-c1adc8bba40e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:05.398530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 874/1759] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 493 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:05.403386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2059ed-e713-468e-9551-c1adc8bba40e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:05.423316 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2059ed-e713-468e-9551-c1adc8bba40e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:05.427944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 886/1760] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:04 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:05.428212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e91fad-2c88-4a8a-8537-c7232d01bfd2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:05.431690 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f5e91fad-2c88-4a8a-8537-c7232d01bfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:05.445984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab649b-2d79-4064-990e-e227aec67ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:05.446660 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab649b-2d79-4064-990e-e227aec67ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:05.446944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab649b-2d79-4064-990e-e227aec67ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:05.447221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab649b-2d79-4064-990e-e227aec67ee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:05.447968 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab649b-2d79-4064-990e-e227aec67ee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:05.450770 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab649b-2d79-4064-990e-e227aec67ee6 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:05.477230 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e91fad-2c88-4a8a-8537-c7232d01bfd2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:05.491140 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c034fe-3763-4b52-8647-202aa195af31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:05.493281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c034fe-3763-4b52-8647-202aa195af31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:05.493577 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c034fe-3763-4b52-8647-202aa195af31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:05.494347 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c034fe-3763-4b52-8647-202aa195af31 admin admin] PATH_INFO: `/v3/projects/09dfbdec8abe41b8a60b377d23e7085c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:05.499271 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c034fe-3763-4b52-8647-202aa195af31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09dfbdec8abe41b8a60b377d23e7085c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:05.509479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c034fe-3763-4b52-8647-202aa195af31 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:05.510451 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 875/1761] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:05 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:05.512477 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab649b-2d79-4064-990e-e227aec67ee6 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:05.667937 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-77c034fe-3763-4b52-8647-202aa195af31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09dfbdec8abe41b8a60b377d23e7085c', 'request_id': 'req-77c034fe-3763-4b52-8647-202aa195af31'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:05.696498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-77c034fe-3763-4b52-8647-202aa195af31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09dfbdec8abe41b8a60b377d23e7085c', 'request_id': 'req-77c034fe-3763-4b52-8647-202aa195af31'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:05.714364 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab649b-2d79-4064-990e-e227aec67ee6 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:05.719918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-77c034fe-3763-4b52-8647-202aa195af31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09dfbdec8abe41b8a60b377d23e7085c', 'request_id': 'req-77c034fe-3763-4b52-8647-202aa195af31'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:05.743863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-77c034fe-3763-4b52-8647-202aa195af31 admin admin] The token cache is being invalidate because project 09dfbdec8abe41b8a60b377d23e7085c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:05.744157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-77c034fe-3763-4b52-8647-202aa195af31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:05.744823 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-77c034fe-3763-4b52-8647-202aa195af31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:05.746435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 887/1762] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:05 2022] DELETE /identity/v3/projects/09dfbdec8abe41b8a60b377d23e7085c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:05.747172 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c034fe-3763-4b52-8647-202aa195af31 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:05.750845 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-77c034fe-3763-4b52-8647-202aa195af31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:05.828834 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:05.868983 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68ad11-01ae-41e7-abd0-df4dfa0e76eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:05.869724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68ad11-01ae-41e7-abd0-df4dfa0e76eb admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:05.870013 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68ad11-01ae-41e7-abd0-df4dfa0e76eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:05.872621 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68ad11-01ae-41e7-abd0-df4dfa0e76eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:05.873434 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68ad11-01ae-41e7-abd0-df4dfa0e76eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:05.875136 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68ad11-01ae-41e7-abd0-df4dfa0e76eb admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:05.889848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c034fe-3763-4b52-8647-202aa195af31 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:05.893322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 876/1763] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:05.897452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68ad11-01ae-41e7-abd0-df4dfa0e76eb admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:05.901789 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1b68ad11-01ae-41e7-abd0-df4dfa0e76eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:05.909109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a463881-3b3c-4133-b314-71c389eaaddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:05.910072 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a463881-3b3c-4133-b314-71c389eaaddb admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:05.910700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a463881-3b3c-4133-b314-71c389eaaddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:05.911232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a463881-3b3c-4133-b314-71c389eaaddb admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:05.913466 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a463881-3b3c-4133-b314-71c389eaaddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:05.917769 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a463881-3b3c-4133-b314-71c389eaaddb admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:05.918984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68ad11-01ae-41e7-abd0-df4dfa0e76eb admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:05.925938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648d654-7083-422f-b9eb-c2e461f2f912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:05.926620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648d654-7083-422f-b9eb-c2e461f2f912 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:05.926934 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648d654-7083-422f-b9eb-c2e461f2f912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:05.927352 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648d654-7083-422f-b9eb-c2e461f2f912 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:05.928064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648d654-7083-422f-b9eb-c2e461f2f912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:05.931785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648d654-7083-422f-b9eb-c2e461f2f912 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:05.980139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 877/1764] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:05 2022] POST /identity/v3/users => generated 291 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:05.981521 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648d654-7083-422f-b9eb-c2e461f2f912 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:05.981879 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 888/1765] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:05 2022] POST /identity/v3/projects => generated 405 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:05.983397 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a2dfe-7ef3-43bf-950f-9dd4c86bf9cc None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:05.983852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a2dfe-7ef3-43bf-950f-9dd4c86bf9cc None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:05.984031 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2648d654-7083-422f-b9eb-c2e461f2f912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:05.984422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a2dfe-7ef3-43bf-950f-9dd4c86bf9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:06.008340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648d654-7083-422f-b9eb-c2e461f2f912 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:06.028034 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f94a2dfe-7ef3-43bf-950f-9dd4c86bf9cc None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:06.029745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f94a2dfe-7ef3-43bf-950f-9dd4c86bf9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:06.072493 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:06.130292 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 889/1766] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:06.131310 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a2dfe-7ef3-43bf-950f-9dd4c86bf9cc None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:06.137764 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f94a2dfe-7ef3-43bf-950f-9dd4c86bf9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:06.155879 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a2dfe-7ef3-43bf-950f-9dd4c86bf9cc None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:06.156487 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225aa18-14f0-439f-8200-3183565f887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:06.157518 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225aa18-14f0-439f-8200-3183565f887f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:06.157807 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225aa18-14f0-439f-8200-3183565f887f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:06.158118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225aa18-14f0-439f-8200-3183565f887f admin admin] PATH_INFO: `/v3/users/c56ca5f1b01b4d2990e73c136b606ce1` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:06.159655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225aa18-14f0-439f-8200-3183565f887f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56ca5f1b01b4d2990e73c136b606ce1)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:06.162665 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9ad8d-da90-496a-bf52-bb1298f9acf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:06.163099 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225aa18-14f0-439f-8200-3183565f887f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:06.164145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9ad8d-da90-496a-bf52-bb1298f9acf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:06.165073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9ad8d-da90-496a-bf52-bb1298f9acf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:06.166150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9ad8d-da90-496a-bf52-bb1298f9acf8 admin admin] PATH_INFO: `/v3/projects/5d35c8b8430e4875aab0ac8cac2c0862/users/918abf8f5eba4b6793e19a3c9146bfed/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:06.193513 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9ad8d-da90-496a-bf52-bb1298f9acf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d35c8b8430e4875aab0ac8cac2c0862, user_id=918abf8f5eba4b6793e19a3c9146bfed, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:06.197935 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9ad8d-da90-496a-bf52-bb1298f9acf8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:06.217809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 890/1767] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:06 2022] PUT /identity/v3/projects/5d35c8b8430e4875aab0ac8cac2c0862/users/918abf8f5eba4b6793e19a3c9146bfed/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:06.227889 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2225aa18-14f0-439f-8200-3183565f887f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56ca5f1b01b4d2990e73c136b606ce1'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:06.228583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2225aa18-14f0-439f-8200-3183565f887f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56ca5f1b01b4d2990e73c136b606ce1'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:06.232273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9ad8d-da90-496a-bf52-bb1298f9acf8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:06.237943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2225aa18-14f0-439f-8200-3183565f887f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56ca5f1b01b4d2990e73c136b606ce1'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:06.238932 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2225aa18-14f0-439f-8200-3183565f887f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56ca5f1b01b4d2990e73c136b606ce1'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:06.243320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-84b9ad8d-da90-496a-bf52-bb1298f9acf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:06.249341 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2225aa18-14f0-439f-8200-3183565f887f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56ca5f1b01b4d2990e73c136b606ce1'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:06.276822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 878/1768] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:05 2022] DELETE /identity/v3/users/c56ca5f1b01b4d2990e73c136b606ce1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:06.278160 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225aa18-14f0-439f-8200-3183565f887f admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:06.280260 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2225aa18-14f0-439f-8200-3183565f887f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:06.332191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9ad8d-da90-496a-bf52-bb1298f9acf8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:06.373288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225aa18-14f0-439f-8200-3183565f887f admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:06.380895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18daec4-a6b1-488b-8aae-6d0e593f86d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:06.382055 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18daec4-a6b1-488b-8aae-6d0e593f86d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:06.382810 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18daec4-a6b1-488b-8aae-6d0e593f86d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:06.383374 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18daec4-a6b1-488b-8aae-6d0e593f86d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:06.384278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18daec4-a6b1-488b-8aae-6d0e593f86d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:06.386674 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18daec4-a6b1-488b-8aae-6d0e593f86d1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:06.398326 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:06.400295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 879/1769] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:06.402098 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09780b2-e612-42f8-9496-d5648ead678b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:06.402567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09780b2-e612-42f8-9496-d5648ead678b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:06.403054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09780b2-e612-42f8-9496-d5648ead678b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:06.424632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d09780b2-e612-42f8-9496-d5648ead678b None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:06.428128 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d09780b2-e612-42f8-9496-d5648ead678b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:06.430439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04444ead-fc39-442f-b56e-f4555fac6b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:06.431328 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04444ead-fc39-442f-b56e-f4555fac6b42 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:06.431720 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04444ead-fc39-442f-b56e-f4555fac6b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:06.432101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04444ead-fc39-442f-b56e-f4555fac6b42 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:06.432923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04444ead-fc39-442f-b56e-f4555fac6b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:06.435049 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04444ead-fc39-442f-b56e-f4555fac6b42 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:06.453999 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 880/1770] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:06.457943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068560b-7a7d-47ae-8d0c-ca8c4a597bce None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:06.457943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068560b-7a7d-47ae-8d0c-ca8c4a597bce None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:06.457943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068560b-7a7d-47ae-8d0c-ca8c4a597bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:06.475076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 891/1771] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:06 2022] POST /identity/v3/users => generated 309 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:06.476740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85d690-032d-4860-896b-ea28d171375f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:06.477142 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85d690-032d-4860-896b-ea28d171375f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:06.477551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85d690-032d-4860-896b-ea28d171375f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:06.504581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6b85d690-032d-4860-896b-ea28d171375f None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:06.506183 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6b85d690-032d-4860-896b-ea28d171375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:06.511335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a068560b-7a7d-47ae-8d0c-ca8c4a597bce None None] MFA Rules not processed for user `918abf8f5eba4b6793e19a3c9146bfed`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:06.512563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a068560b-7a7d-47ae-8d0c-ca8c4a597bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:06.517244 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 892/1772] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:06.518361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85d690-032d-4860-896b-ea28d171375f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:06.536640 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:06.537915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85d690-032d-4860-896b-ea28d171375f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:06.546079 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fb6ab-7446-444c-a1be-207dccc724fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:06.547044 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fb6ab-7446-444c-a1be-207dccc724fa admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:06.547848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fb6ab-7446-444c-a1be-207dccc724fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:06.548525 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fb6ab-7446-444c-a1be-207dccc724fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:06.549698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fb6ab-7446-444c-a1be-207dccc724fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:06.552194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fb6ab-7446-444c-a1be-207dccc724fa admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:06.570574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 893/1773] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:06.571373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fb6ab-7446-444c-a1be-207dccc724fa admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:06.587651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fb6ab-7446-444c-a1be-207dccc724fa admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:06.594835 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfeae2a-f9c8-4d67-9104-53231df1716f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:06.594835 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfeae2a-f9c8-4d67-9104-53231df1716f admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:06.594835 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfeae2a-f9c8-4d67-9104-53231df1716f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:06.594835 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfeae2a-f9c8-4d67-9104-53231df1716f admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:06.595863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfeae2a-f9c8-4d67-9104-53231df1716f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:06.596281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfeae2a-f9c8-4d67-9104-53231df1716f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:06.598276 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfeae2a-f9c8-4d67-9104-53231df1716f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:06.612623 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 894/1774] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:28:06.613706 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfeae2a-f9c8-4d67-9104-53231df1716f admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:06.626387 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 881/1775] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:06.627435 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068560b-7a7d-47ae-8d0c-ca8c4a597bce None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:06.628707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a068560b-7a7d-47ae-8d0c-ca8c4a597bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:06.630252 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfeae2a-f9c8-4d67-9104-53231df1716f admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:06.637432 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121b069-fa9a-4a95-a92f-252cb85fce7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:06.638533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121b069-fa9a-4a95-a92f-252cb85fce7b admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:06.638987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121b069-fa9a-4a95-a92f-252cb85fce7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:06.639433 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121b069-fa9a-4a95-a92f-252cb85fce7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:06.640220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121b069-fa9a-4a95-a92f-252cb85fce7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:06.642570 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121b069-fa9a-4a95-a92f-252cb85fce7b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:06.653882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 895/1776] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:06.658499 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121b069-fa9a-4a95-a92f-252cb85fce7b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:06.676841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121b069-fa9a-4a95-a92f-252cb85fce7b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:06.683897 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289df2f-c9b8-44e2-843f-07619e7e54e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:06.685120 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289df2f-c9b8-44e2-843f-07619e7e54e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:06.685445 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289df2f-c9b8-44e2-843f-07619e7e54e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:06.685714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289df2f-c9b8-44e2-843f-07619e7e54e9 admin admin] PATH_INFO: `/v3/projects/0755b1c3b7244163bb7409c6c008ec2e/users/1ec0ce2f3dab4ff7b2c931c2e9ed7523/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:06.699655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068560b-7a7d-47ae-8d0c-ca8c4a597bce None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:06.702972 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289df2f-c9b8-44e2-843f-07619e7e54e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0755b1c3b7244163bb7409c6c008ec2e, user_id=1ec0ce2f3dab4ff7b2c931c2e9ed7523, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:06.705818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289df2f-c9b8-44e2-843f-07619e7e54e9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:06.706603 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2460cd-8832-4e32-9ab1-eea2f76dd031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:06.707710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2460cd-8832-4e32-9ab1-eea2f76dd031 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:06.708203 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2460cd-8832-4e32-9ab1-eea2f76dd031 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:06.708876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2460cd-8832-4e32-9ab1-eea2f76dd031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:06.720157 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2460cd-8832-4e32-9ab1-eea2f76dd031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:06.721781 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2460cd-8832-4e32-9ab1-eea2f76dd031 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:06.722553 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 896/1777] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:06 2022] PUT /identity/v3/projects/0755b1c3b7244163bb7409c6c008ec2e/users/1ec0ce2f3dab4ff7b2c931c2e9ed7523/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:06.734309 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289df2f-c9b8-44e2-843f-07619e7e54e9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:06.742275 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 882/1778] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:06.746280 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2460cd-8832-4e32-9ab1-eea2f76dd031 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:06.752341 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2b2460cd-8832-4e32-9ab1-eea2f76dd031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:06.780804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2460cd-8832-4e32-9ab1-eea2f76dd031 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:06.849119 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289df2f-c9b8-44e2-843f-07619e7e54e9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:06.854720 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53bf85-4a15-4fc5-b671-175deeb08364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:06.855689 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53bf85-4a15-4fc5-b671-175deeb08364 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:06.856441 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53bf85-4a15-4fc5-b671-175deeb08364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:06.856441 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53bf85-4a15-4fc5-b671-175deeb08364 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:06.857353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53bf85-4a15-4fc5-b671-175deeb08364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:06.860188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53bf85-4a15-4fc5-b671-175deeb08364 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:06.881191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be910f17-a5b2-4afe-94a0-1245aacc784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:06.882968 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be910f17-a5b2-4afe-94a0-1245aacc784e admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:06.883373 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be910f17-a5b2-4afe-94a0-1245aacc784e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:06.883924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be910f17-a5b2-4afe-94a0-1245aacc784e admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:06.884778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be910f17-a5b2-4afe-94a0-1245aacc784e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:06.887026 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be910f17-a5b2-4afe-94a0-1245aacc784e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:06.901662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 897/1779] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:06 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:06.902574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53bf85-4a15-4fc5-b671-175deeb08364 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:06.918704 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 883/1780] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:06 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:06.920920 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd0290-d1ec-4d1c-b7f1-0ee96b25b1f4 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:06.921354 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd0290-d1ec-4d1c-b7f1-0ee96b25b1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:06.921778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd0290-d1ec-4d1c-b7f1-0ee96b25b1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:06.957876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-85dd0290-d1ec-4d1c-b7f1-0ee96b25b1f4 None None] MFA Rules not processed for user `1ec0ce2f3dab4ff7b2c931c2e9ed7523`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:06.958746 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-85dd0290-d1ec-4d1c-b7f1-0ee96b25b1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:07.033512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:07.048530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:07.088280 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53bf85-4a15-4fc5-b671-175deeb08364 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:07.186074 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43471fe7-10f7-415b-8165-4ffc65cef0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:07.189093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43471fe7-10f7-415b-8165-4ffc65cef0f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:07.189765 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43471fe7-10f7-415b-8165-4ffc65cef0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:07.190210 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43471fe7-10f7-415b-8165-4ffc65cef0f1 admin admin] PATH_INFO: `/v3/projects/41603dec001b48858b2a8389cd8b09be/users/276b85cd421d49429bec9c3cfe239a83/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:07.214527 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43471fe7-10f7-415b-8165-4ffc65cef0f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41603dec001b48858b2a8389cd8b09be, user_id=276b85cd421d49429bec9c3cfe239a83, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:07.230601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 884/1781] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:07.230834 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43471fe7-10f7-415b-8165-4ffc65cef0f1 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:07.232847 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd0290-d1ec-4d1c-b7f1-0ee96b25b1f4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:07.267104 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 898/1782] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:06 2022] PUT /identity/v3/projects/41603dec001b48858b2a8389cd8b09be/users/276b85cd421d49429bec9c3cfe239a83/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:07.269855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43471fe7-10f7-415b-8165-4ffc65cef0f1 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:07.271906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd0290-d1ec-4d1c-b7f1-0ee96b25b1f4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:07.418113 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d78a5-8851-42b0-8114-d92878bdfcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:07.418981 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d78a5-8851-42b0-8114-d92878bdfcba admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:07.419365 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d78a5-8851-42b0-8114-d92878bdfcba admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:07.419738 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d78a5-8851-42b0-8114-d92878bdfcba admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:07.423183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d78a5-8851-42b0-8114-d92878bdfcba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:07.426250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d78a5-8851-42b0-8114-d92878bdfcba admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:07.477339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43471fe7-10f7-415b-8165-4ffc65cef0f1 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:07.482118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 885/1783] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:07 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:07.482118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d78a5-8851-42b0-8114-d92878bdfcba admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:07.490023 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c15809-ad54-4f59-9398-ff2df70e81ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:07.490871 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c15809-ad54-4f59-9398-ff2df70e81ef admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:07.491164 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c15809-ad54-4f59-9398-ff2df70e81ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:07.491448 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c15809-ad54-4f59-9398-ff2df70e81ef admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:07.492157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c15809-ad54-4f59-9398-ff2df70e81ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:07.494314 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c15809-ad54-4f59-9398-ff2df70e81ef admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:07.513730 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d78a5-8851-42b0-8114-d92878bdfcba admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:07.522342 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1382da9-3bd1-4e11-bf03-8b7c0cee3bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:07.523376 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1382da9-3bd1-4e11-bf03-8b7c0cee3bff admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:07.524613 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1382da9-3bd1-4e11-bf03-8b7c0cee3bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:07.525100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1382da9-3bd1-4e11-bf03-8b7c0cee3bff admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:07.526040 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1382da9-3bd1-4e11-bf03-8b7c0cee3bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:07.528715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1382da9-3bd1-4e11-bf03-8b7c0cee3bff admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:07.552018 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 899/1784] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:07 2022] POST /identity/v3/users => generated 298 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:07.552813 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c15809-ad54-4f59-9398-ff2df70e81ef admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:07.579789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c15809-ad54-4f59-9398-ff2df70e81ef admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:07.584423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 886/1785] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:07 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:07.584942 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca77c5-6ef7-4661-a667-ad62f1384486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:07.585406 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1382da9-3bd1-4e11-bf03-8b7c0cee3bff admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:07.585678 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca77c5-6ef7-4661-a667-ad62f1384486 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:07.586082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca77c5-6ef7-4661-a667-ad62f1384486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:07.586358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca77c5-6ef7-4661-a667-ad62f1384486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:07.587104 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca77c5-6ef7-4661-a667-ad62f1384486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:07.587389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e1382da9-3bd1-4e11-bf03-8b7c0cee3bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:07.588742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca77c5-6ef7-4661-a667-ad62f1384486 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:07.604150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 900/1786] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:07.604150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca77c5-6ef7-4661-a667-ad62f1384486 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:07.628796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca77c5-6ef7-4661-a667-ad62f1384486 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:07.769150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:07.800346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7325af6-c36f-4d3c-b216-790297c67653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:07.802413 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1382da9-3bd1-4e11-bf03-8b7c0cee3bff admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:07.803824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7325af6-c36f-4d3c-b216-790297c67653 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:07.804605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7325af6-c36f-4d3c-b216-790297c67653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:07.805480 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7325af6-c36f-4d3c-b216-790297c67653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:07.807360 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7325af6-c36f-4d3c-b216-790297c67653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:07.820334 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7325af6-c36f-4d3c-b216-790297c67653 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:07.832304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271425a3-4ba5-4a24-84fa-e4dc4986bdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:07.833209 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271425a3-4ba5-4a24-84fa-e4dc4986bdfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:07.833523 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271425a3-4ba5-4a24-84fa-e4dc4986bdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:07.837898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271425a3-4ba5-4a24-84fa-e4dc4986bdfc admin admin] PATH_INFO: `/v3/projects/3bc90cefafe64b28a3e79b304290191f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:07.839323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271425a3-4ba5-4a24-84fa-e4dc4986bdfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bc90cefafe64b28a3e79b304290191f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:07.841497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271425a3-4ba5-4a24-84fa-e4dc4986bdfc admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:07.849849 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 901/1787] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:07.851071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7325af6-c36f-4d3c-b216-790297c67653 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:07.865191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7325af6-c36f-4d3c-b216-790297c67653 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:07.876639 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fec9b-ec96-457f-a548-0e68f8ea5712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:07.877483 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fec9b-ec96-457f-a548-0e68f8ea5712 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:07.878869 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fec9b-ec96-457f-a548-0e68f8ea5712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:07.879551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fec9b-ec96-457f-a548-0e68f8ea5712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:07.882134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fec9b-ec96-457f-a548-0e68f8ea5712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:07.884691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fec9b-ec96-457f-a548-0e68f8ea5712 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:07.900257 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 902/1788] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:07.914707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fec9b-ec96-457f-a548-0e68f8ea5712 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:07.964362 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fec9b-ec96-457f-a548-0e68f8ea5712 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:07.978928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:07.982410 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-271425a3-4ba5-4a24-84fa-e4dc4986bdfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bc90cefafe64b28a3e79b304290191f', 'request_id': 'req-271425a3-4ba5-4a24-84fa-e4dc4986bdfc'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:07.999132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-271425a3-4ba5-4a24-84fa-e4dc4986bdfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bc90cefafe64b28a3e79b304290191f', 'request_id': 'req-271425a3-4ba5-4a24-84fa-e4dc4986bdfc'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:08.007240 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-271425a3-4ba5-4a24-84fa-e4dc4986bdfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bc90cefafe64b28a3e79b304290191f', 'request_id': 'req-271425a3-4ba5-4a24-84fa-e4dc4986bdfc'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:08.044239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-271425a3-4ba5-4a24-84fa-e4dc4986bdfc admin admin] The token cache is being invalidate because project 3bc90cefafe64b28a3e79b304290191f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:08.044532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-271425a3-4ba5-4a24-84fa-e4dc4986bdfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:08.047544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-271425a3-4ba5-4a24-84fa-e4dc4986bdfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:08.052119 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 887/1789] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:07 2022] DELETE /identity/v3/projects/3bc90cefafe64b28a3e79b304290191f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:08.052993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271425a3-4ba5-4a24-84fa-e4dc4986bdfc admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:08.057946 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-271425a3-4ba5-4a24-84fa-e4dc4986bdfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:08.091252 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaea21a-067b-4184-aff4-8caa1979dcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:08.091984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaea21a-067b-4184-aff4-8caa1979dcaa admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:08.092335 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaea21a-067b-4184-aff4-8caa1979dcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:08.092624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaea21a-067b-4184-aff4-8caa1979dcaa admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:08.093413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaea21a-067b-4184-aff4-8caa1979dcaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:08.095664 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaea21a-067b-4184-aff4-8caa1979dcaa admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:08.149285 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 903/1790] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:07 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:08.151264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaea21a-067b-4184-aff4-8caa1979dcaa admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:08.153510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4aaea21a-067b-4184-aff4-8caa1979dcaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:08.169676 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaea21a-067b-4184-aff4-8caa1979dcaa admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:08.175293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78d895-79ff-4f64-a70d-fff555ae8314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:08.176271 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78d895-79ff-4f64-a70d-fff555ae8314 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:08.176799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78d895-79ff-4f64-a70d-fff555ae8314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:08.177227 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78d895-79ff-4f64-a70d-fff555ae8314 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:08.178226 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78d895-79ff-4f64-a70d-fff555ae8314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:08.180304 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78d895-79ff-4f64-a70d-fff555ae8314 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:08.199680 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 904/1791] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:08.201590 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78d895-79ff-4f64-a70d-fff555ae8314 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:08.203655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-be78d895-79ff-4f64-a70d-fff555ae8314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:08.217621 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78d895-79ff-4f64-a70d-fff555ae8314 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:08.222052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271425a3-4ba5-4a24-84fa-e4dc4986bdfc admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:08.223699 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385dde68-5205-4b6b-b2b8-497fb77ce2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:08.224699 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dde68-5205-4b6b-b2b8-497fb77ce2b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:08.225066 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dde68-5205-4b6b-b2b8-497fb77ce2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:08.225453 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dde68-5205-4b6b-b2b8-497fb77ce2b0 admin admin] PATH_INFO: `/v3/projects/f2df6452c4924231b8b6b52773d8b62d/users/e953ae24a7af4afdb57d2fac65a6d1d6/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:08.228696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ba6a1-a437-470f-bb79-b95466a91690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:08.229747 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ba6a1-a437-470f-bb79-b95466a91690 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:08.230106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ba6a1-a437-470f-bb79-b95466a91690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:08.230453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ba6a1-a437-470f-bb79-b95466a91690 admin admin] PATH_INFO: `/v3/projects/41603dec001b48858b2a8389cd8b09be/users/276b85cd421d49429bec9c3cfe239a83/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:08.233373 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ba6a1-a437-470f-bb79-b95466a91690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41603dec001b48858b2a8389cd8b09be, user_id=276b85cd421d49429bec9c3cfe239a83, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:08.237389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ba6a1-a437-470f-bb79-b95466a91690 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:08.246259 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385dde68-5205-4b6b-b2b8-497fb77ce2b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2df6452c4924231b8b6b52773d8b62d, user_id=e953ae24a7af4afdb57d2fac65a6d1d6, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:08.249675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385dde68-5205-4b6b-b2b8-497fb77ce2b0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:08.251414 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 888/1792] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:08 2022] PUT /identity/v3/projects/41603dec001b48858b2a8389cd8b09be/users/276b85cd421d49429bec9c3cfe239a83/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:08.252515 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ba6a1-a437-470f-bb79-b95466a91690 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:08.261635 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a10ba6a1-a437-470f-bb79-b95466a91690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:08.277674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 905/1793] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:08 2022] PUT /identity/v3/projects/f2df6452c4924231b8b6b52773d8b62d/users/e953ae24a7af4afdb57d2fac65a6d1d6/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:08.279665 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70472a5-d8bb-4924-bec1-07846902db24 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:08.280295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70472a5-d8bb-4924-bec1-07846902db24 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:08.280780 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70472a5-d8bb-4924-bec1-07846902db24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:08.348601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f70472a5-d8bb-4924-bec1-07846902db24 None None] MFA Rules not processed for user `54189575a60a4d9dbaabb78d44e9c31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:08.350706 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f70472a5-d8bb-4924-bec1-07846902db24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:08.378001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ba6a1-a437-470f-bb79-b95466a91690 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:08.443600 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 906/1794] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Jul 12 18:28:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:08.445919 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70472a5-d8bb-4924-bec1-07846902db24 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:08.447847 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f70472a5-d8bb-4924-bec1-07846902db24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:08.455694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71df3d-3845-4f06-b8b9-f537c3451a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:08.458138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71df3d-3845-4f06-b8b9-f537c3451a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:08.459419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71df3d-3845-4f06-b8b9-f537c3451a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:08.459714 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71df3d-3845-4f06-b8b9-f537c3451a79 admin admin] PATH_INFO: `/v3/users/42291ec3466d4f188bd8e6eb6413d996` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:08.461212 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71df3d-3845-4f06-b8b9-f537c3451a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42291ec3466d4f188bd8e6eb6413d996)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:08.463614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71df3d-3845-4f06-b8b9-f537c3451a79 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:08.468153 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70472a5-d8bb-4924-bec1-07846902db24 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:08.475310 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4819ef-65e7-44f6-9606-2b63e2ba9618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:08.476196 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4819ef-65e7-44f6-9606-2b63e2ba9618 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:08.476396 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4819ef-65e7-44f6-9606-2b63e2ba9618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:08.476814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4819ef-65e7-44f6-9606-2b63e2ba9618 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:08.477648 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4819ef-65e7-44f6-9606-2b63e2ba9618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:08.479347 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4819ef-65e7-44f6-9606-2b63e2ba9618 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:08.482819 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:08.503746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 907/1795] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:08.504621 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4819ef-65e7-44f6-9606-2b63e2ba9618 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:08.523763 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4819ef-65e7-44f6-9606-2b63e2ba9618 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:08.529600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:08.532672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7d4a4-d556-4688-8158-9ae81309f5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:08.533632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7d4a4-d556-4688-8158-9ae81309f5d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:08.533911 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7d4a4-d556-4688-8158-9ae81309f5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:08.534183 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7d4a4-d556-4688-8158-9ae81309f5d3 admin admin] PATH_INFO: `/v3/projects/bae80cd2aac7417fa2e3dc2ce152b812/users/bfb138d4208f459f81492b06b2f033dd/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:08.567289 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7d4a4-d556-4688-8158-9ae81309f5d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bae80cd2aac7417fa2e3dc2ce152b812, user_id=bfb138d4208f459f81492b06b2f033dd, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:08.571110 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7d4a4-d556-4688-8158-9ae81309f5d3 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:08.584834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2c71df3d-3845-4f06-b8b9-f537c3451a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42291ec3466d4f188bd8e6eb6413d996'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:08.585866 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2c71df3d-3845-4f06-b8b9-f537c3451a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42291ec3466d4f188bd8e6eb6413d996'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:08.593905 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 908/1796] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:08 2022] PUT /identity/v3/projects/bae80cd2aac7417fa2e3dc2ce152b812/users/bfb138d4208f459f81492b06b2f033dd/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:08.595312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5044a-c119-4e07-b3d7-930bc25cd875 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:08.595959 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5044a-c119-4e07-b3d7-930bc25cd875 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:08.597109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5044a-c119-4e07-b3d7-930bc25cd875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:08.602148 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2c71df3d-3845-4f06-b8b9-f537c3451a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42291ec3466d4f188bd8e6eb6413d996'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:08.603772 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2c71df3d-3845-4f06-b8b9-f537c3451a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42291ec3466d4f188bd8e6eb6413d996'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:08.614997 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2c71df3d-3845-4f06-b8b9-f537c3451a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42291ec3466d4f188bd8e6eb6413d996'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:08.632433 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-32e5044a-c119-4e07-b3d7-930bc25cd875 None None] MFA Rules not processed for user `276b85cd421d49429bec9c3cfe239a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:08.633572 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-32e5044a-c119-4e07-b3d7-930bc25cd875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:08.641760 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 889/1797] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:08 2022] DELETE /identity/v3/users/42291ec3466d4f188bd8e6eb6413d996 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:08.643213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71df3d-3845-4f06-b8b9-f537c3451a79 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:08.645435 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2c71df3d-3845-4f06-b8b9-f537c3451a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:08.737965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71df3d-3845-4f06-b8b9-f537c3451a79 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:08.743970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 909/1798] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:08 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:08.744889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5044a-c119-4e07-b3d7-930bc25cd875 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:08.747831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-32e5044a-c119-4e07-b3d7-930bc25cd875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:08.748314 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11996a-f990-41f6-b7bf-9a9622a4d297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:08.749011 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11996a-f990-41f6-b7bf-9a9622a4d297 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:08.749451 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11996a-f990-41f6-b7bf-9a9622a4d297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:08.750242 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11996a-f990-41f6-b7bf-9a9622a4d297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:08.750588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11996a-f990-41f6-b7bf-9a9622a4d297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:08.752215 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11996a-f990-41f6-b7bf-9a9622a4d297 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:08.771971 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 890/1799] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:08.774114 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0c273-2772-4eba-9fac-4d296c27bea2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:08.774523 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0c273-2772-4eba-9fac-4d296c27bea2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:08.774872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0c273-2772-4eba-9fac-4d296c27bea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:08.838889 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-bcd0c273-2772-4eba-9fac-4d296c27bea2 None None] MFA Rules not processed for user `bfb138d4208f459f81492b06b2f033dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:08.840056 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bcd0c273-2772-4eba-9fac-4d296c27bea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:08.874326 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5044a-c119-4e07-b3d7-930bc25cd875 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:08.884596 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a1fa7-6ace-4e46-a354-2796c03a4f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:08.885984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a1fa7-6ace-4e46-a354-2796c03a4f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:08.886704 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a1fa7-6ace-4e46-a354-2796c03a4f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:08.887098 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a1fa7-6ace-4e46-a354-2796c03a4f7a admin admin] PATH_INFO: `/v3/projects/dd9bc18f2502449fa06a518a56c4bd5c/users/3a003c292db3472684e11526fcd23c19/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:08.912343 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a1fa7-6ace-4e46-a354-2796c03a4f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd9bc18f2502449fa06a518a56c4bd5c, user_id=3a003c292db3472684e11526fcd23c19, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:08.915805 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a1fa7-6ace-4e46-a354-2796c03a4f7a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:08.934301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 910/1800] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:08 2022] PUT /identity/v3/projects/dd9bc18f2502449fa06a518a56c4bd5c/users/3a003c292db3472684e11526fcd23c19/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:08.934301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a1fa7-6ace-4e46-a354-2796c03a4f7a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:08.938916 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 891/1801] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:08.939001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0c273-2772-4eba-9fac-4d296c27bea2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:08.941457 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6d8a1fa7-6ace-4e46-a354-2796c03a4f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:08.942085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bcd0c273-2772-4eba-9fac-4d296c27bea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:08.983085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:09.020322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:09.052622 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0c273-2772-4eba-9fac-4d296c27bea2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:09.108067 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a1fa7-6ace-4e46-a354-2796c03a4f7a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:09.115441 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cdbfa-6881-43cd-8c0d-f3c74d75651f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ade969d7aa3d49c08782a68ec5997382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:09.116435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cdbfa-6881-43cd-8c0d-f3c74d75651f service swift] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:09.116725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cdbfa-6881-43cd-8c0d-f3c74d75651f service swift] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:09.117006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cdbfa-6881-43cd-8c0d-f3c74d75651f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:09.119678 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-997cdbfa-6881-43cd-8c0d-f3c74d75651f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:09.134328 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadb630-4382-4eb5-9b25-c96af2921fa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:09.135296 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadb630-4382-4eb5-9b25-c96af2921fa0 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:09.135699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadb630-4382-4eb5-9b25-c96af2921fa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:09.136156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadb630-4382-4eb5-9b25-c96af2921fa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:09.203260 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cdbfa-6881-43cd-8c0d-f3c74d75651f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:09.205617 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cdbfa-6881-43cd-8c0d-f3c74d75651f service swift] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:09.220404 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 911/1802] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Jul 12 18:28:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:28:09.221963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cdbfa-6881-43cd-8c0d-f3c74d75651f service swift] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:09.232064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadb630-4382-4eb5-9b25-c96af2921fa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:09.236100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadb630-4382-4eb5-9b25-c96af2921fa0 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:09.253712 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 892/1803] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:08 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:09.255050 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadb630-4382-4eb5-9b25-c96af2921fa0 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:09.354435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cdbfa-6881-43cd-8c0d-f3c74d75651f service swift] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:09.367770 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04773c41-4ddc-41fc-8c7e-3ff33b2db729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:09.373507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04773c41-4ddc-41fc-8c7e-3ff33b2db729 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:09.374941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04773c41-4ddc-41fc-8c7e-3ff33b2db729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:09.375659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04773c41-4ddc-41fc-8c7e-3ff33b2db729 admin admin] PATH_INFO: `/v3/projects/f2df6452c4924231b8b6b52773d8b62d/users/e953ae24a7af4afdb57d2fac65a6d1d6/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:09.381822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04773c41-4ddc-41fc-8c7e-3ff33b2db729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2df6452c4924231b8b6b52773d8b62d, user_id=e953ae24a7af4afdb57d2fac65a6d1d6, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:09.387484 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04773c41-4ddc-41fc-8c7e-3ff33b2db729 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:09.426241 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadb630-4382-4eb5-9b25-c96af2921fa0 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:09.438491 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 912/1804] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:09 2022] PUT /identity/v3/projects/f2df6452c4924231b8b6b52773d8b62d/users/e953ae24a7af4afdb57d2fac65a6d1d6/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:09.439275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04773c41-4ddc-41fc-8c7e-3ff33b2db729 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:09.448350 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-04773c41-4ddc-41fc-8c7e-3ff33b2db729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:09.541469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:09.620183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e656015-84bc-41ef-9479-01414127ec32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:09.623479 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e656015-84bc-41ef-9479-01414127ec32 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:09.625384 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e656015-84bc-41ef-9479-01414127ec32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:09.626461 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e656015-84bc-41ef-9479-01414127ec32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:09.630363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e656015-84bc-41ef-9479-01414127ec32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:09.633190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e656015-84bc-41ef-9479-01414127ec32 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:09.652015 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:09.658757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04773c41-4ddc-41fc-8c7e-3ff33b2db729 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:09.665201 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 893/1805] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:09.667612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0dd22-2666-432a-8028-04d7022bf261 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:09.668005 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0dd22-2666-432a-8028-04d7022bf261 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:09.668432 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0dd22-2666-432a-8028-04d7022bf261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:09.670359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79deebd-eb84-4c77-a65c-b611433d392f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:09.677093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79deebd-eb84-4c77-a65c-b611433d392f admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:09.677636 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79deebd-eb84-4c77-a65c-b611433d392f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:09.677934 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79deebd-eb84-4c77-a65c-b611433d392f admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:09.678798 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79deebd-eb84-4c77-a65c-b611433d392f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:09.680898 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79deebd-eb84-4c77-a65c-b611433d392f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:09.747454 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 913/1806] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:09 2022] POST /identity/v3/projects => generated 387 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:09.747454 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79deebd-eb84-4c77-a65c-b611433d392f admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:09.754104 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a79deebd-eb84-4c77-a65c-b611433d392f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:09.776378 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-24d0dd22-2666-432a-8028-04d7022bf261 None None] MFA Rules not processed for user `e953ae24a7af4afdb57d2fac65a6d1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:09.778261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-24d0dd22-2666-432a-8028-04d7022bf261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:09.972755 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79deebd-eb84-4c77-a65c-b611433d392f admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:10.009639 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75893034-47b5-4f9a-af3e-ffaa8758cd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:10.011245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75893034-47b5-4f9a-af3e-ffaa8758cd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:10.017768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75893034-47b5-4f9a-af3e-ffaa8758cd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:10.017768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75893034-47b5-4f9a-af3e-ffaa8758cd02 admin admin] PATH_INFO: `/v3/users/ca254e34434a40a0948fecf65c570ad1` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:10.017768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75893034-47b5-4f9a-af3e-ffaa8758cd02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca254e34434a40a0948fecf65c570ad1)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:10.020884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75893034-47b5-4f9a-af3e-ffaa8758cd02 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:10.025559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 894/1807] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:10.025559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0dd22-2666-432a-8028-04d7022bf261 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:10.064846 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0dd22-2666-432a-8028-04d7022bf261 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:10.074351 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42cd4a-4d99-43aa-9244-eae816c0ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:10.090573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42cd4a-4d99-43aa-9244-eae816c0ae1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:10.091046 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42cd4a-4d99-43aa-9244-eae816c0ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:10.091336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42cd4a-4d99-43aa-9244-eae816c0ae1e admin admin] PATH_INFO: `/v3/projects/dd9bc18f2502449fa06a518a56c4bd5c/users/3a003c292db3472684e11526fcd23c19/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:10.093605 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42cd4a-4d99-43aa-9244-eae816c0ae1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd9bc18f2502449fa06a518a56c4bd5c, user_id=3a003c292db3472684e11526fcd23c19, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:10.101697 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42cd4a-4d99-43aa-9244-eae816c0ae1e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:10.137585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 895/1808] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:10 2022] PUT /identity/v3/projects/dd9bc18f2502449fa06a518a56c4bd5c/users/3a003c292db3472684e11526fcd23c19/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:10.138625 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42cd4a-4d99-43aa-9244-eae816c0ae1e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:10.222082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-75893034-47b5-4f9a-af3e-ffaa8758cd02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca254e34434a40a0948fecf65c570ad1'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:10.223052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-75893034-47b5-4f9a-af3e-ffaa8758cd02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca254e34434a40a0948fecf65c570ad1'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:10.257016 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-75893034-47b5-4f9a-af3e-ffaa8758cd02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca254e34434a40a0948fecf65c570ad1'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:10.264385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-75893034-47b5-4f9a-af3e-ffaa8758cd02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca254e34434a40a0948fecf65c570ad1'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:10.272049 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-75893034-47b5-4f9a-af3e-ffaa8758cd02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca254e34434a40a0948fecf65c570ad1'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:10.272934 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42cd4a-4d99-43aa-9244-eae816c0ae1e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:10.278489 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5b16d-6dd1-44f0-ba5e-614ce0ec7db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:10.279697 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5b16d-6dd1-44f0-ba5e-614ce0ec7db4 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:10.280318 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5b16d-6dd1-44f0-ba5e-614ce0ec7db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:10.280840 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5b16d-6dd1-44f0-ba5e-614ce0ec7db4 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:10.281873 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5b16d-6dd1-44f0-ba5e-614ce0ec7db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:10.284309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5b16d-6dd1-44f0-ba5e-614ce0ec7db4 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:10.295529 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 914/1809] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:09 2022] DELETE /identity/v3/users/ca254e34434a40a0948fecf65c570ad1 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:10.300778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dee7db-6de8-439c-bbdc-70baf011b8ef None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:10.301061 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dee7db-6de8-439c-bbdc-70baf011b8ef None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:10.301342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dee7db-6de8-439c-bbdc-70baf011b8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:10.312013 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 896/1810] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:10 2022] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:10.314198 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5b16d-6dd1-44f0-ba5e-614ce0ec7db4 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:10.316329 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1fb5b16d-6dd1-44f0-ba5e-614ce0ec7db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:10.363848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-38dee7db-6de8-439c-bbdc-70baf011b8ef None None] MFA Rules not processed for user `b6dc63ae259842209831040cbf45d316`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:10.376118 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-38dee7db-6de8-439c-bbdc-70baf011b8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:10.499627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:10.552651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 915/1811] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Jul 12 18:28:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:10.554438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dee7db-6de8-439c-bbdc-70baf011b8ef None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:10.572418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-38dee7db-6de8-439c-bbdc-70baf011b8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:10.593214 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5b16d-6dd1-44f0-ba5e-614ce0ec7db4 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:10.597919 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:10.716272 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dee7db-6de8-439c-bbdc-70baf011b8ef None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:10.723762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f0051-c683-4ac4-8df3-30761a5b963b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:10.724912 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f0051-c683-4ac4-8df3-30761a5b963b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:10.725657 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f0051-c683-4ac4-8df3-30761a5b963b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:10.726110 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f0051-c683-4ac4-8df3-30761a5b963b admin admin] PATH_INFO: `/v3/projects/3bcf66bfa7114846a1b6b83245a43e81` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:10.727801 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f0051-c683-4ac4-8df3-30761a5b963b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bcf66bfa7114846a1b6b83245a43e81)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:10.753074 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f0051-c683-4ac4-8df3-30761a5b963b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:10.801240 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53f5a0-6e38-445f-bc1d-ce0bc62c3b83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:10.802367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53f5a0-6e38-445f-bc1d-ce0bc62c3b83 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:10.802727 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53f5a0-6e38-445f-bc1d-ce0bc62c3b83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:10.803071 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53f5a0-6e38-445f-bc1d-ce0bc62c3b83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:10.807455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9b53f5a0-6e38-445f-bc1d-ce0bc62c3b83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:10.890018 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d51f0051-c683-4ac4-8df3-30761a5b963b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bcf66bfa7114846a1b6b83245a43e81', 'request_id': 'req-d51f0051-c683-4ac4-8df3-30761a5b963b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:10.902733 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d51f0051-c683-4ac4-8df3-30761a5b963b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bcf66bfa7114846a1b6b83245a43e81', 'request_id': 'req-d51f0051-c683-4ac4-8df3-30761a5b963b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:10.918790 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d51f0051-c683-4ac4-8df3-30761a5b963b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bcf66bfa7114846a1b6b83245a43e81', 'request_id': 'req-d51f0051-c683-4ac4-8df3-30761a5b963b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:10.950723 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d51f0051-c683-4ac4-8df3-30761a5b963b admin admin] The token cache is being invalidate because project 3bcf66bfa7114846a1b6b83245a43e81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:10.951872 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d51f0051-c683-4ac4-8df3-30761a5b963b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:10.953428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d51f0051-c683-4ac4-8df3-30761a5b963b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:10.953550 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53f5a0-6e38-445f-bc1d-ce0bc62c3b83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:10.956132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 916/1812] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:10 2022] DELETE /identity/v3/projects/3bcf66bfa7114846a1b6b83245a43e81 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:10.958633 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf310de3-74ab-4f6f-9a2f-9e16983b505f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:10.959131 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53f5a0-6e38-445f-bc1d-ce0bc62c3b83 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:10.959443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf310de3-74ab-4f6f-9a2f-9e16983b505f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:10.960065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf310de3-74ab-4f6f-9a2f-9e16983b505f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:10.984967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 897/1813] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:10.989840 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba2363-69c4-4788-abd3-64c5bbf3add5 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:10.990068 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba2363-69c4-4788-abd3-64c5bbf3add5 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:10.990353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba2363-69c4-4788-abd3-64c5bbf3add5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:11.031952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-95ba2363-69c4-4788-abd3-64c5bbf3add5 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:11.034385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-bf310de3-74ab-4f6f-9a2f-9e16983b505f None None] MFA Rules not processed for user `3a003c292db3472684e11526fcd23c19`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:11.036733 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-bf310de3-74ab-4f6f-9a2f-9e16983b505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:11.037098 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-95ba2363-69c4-4788-abd3-64c5bbf3add5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:11.173496 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 898/1814] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:11.174445 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba2363-69c4-4788-abd3-64c5bbf3add5 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:11.175938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-95ba2363-69c4-4788-abd3-64c5bbf3add5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:11.196201 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba2363-69c4-4788-abd3-64c5bbf3add5 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:11.200277 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 917/1815] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:11.203704 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf310de3-74ab-4f6f-9a2f-9e16983b505f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:11.206957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f43396-0088-4546-ad5d-ca3cee920a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:11.208684 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f43396-0088-4546-ad5d-ca3cee920a2a admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:11.209348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f43396-0088-4546-ad5d-ca3cee920a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:11.209808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f43396-0088-4546-ad5d-ca3cee920a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:11.211046 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f43396-0088-4546-ad5d-ca3cee920a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:11.214146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f43396-0088-4546-ad5d-ca3cee920a2a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:11.221295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-bf310de3-74ab-4f6f-9a2f-9e16983b505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:11.234096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 899/1816] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:11.235237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f43396-0088-4546-ad5d-ca3cee920a2a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:11.237745 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-65f43396-0088-4546-ad5d-ca3cee920a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:11.276438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:11.287152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:11.311105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf310de3-74ab-4f6f-9a2f-9e16983b505f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:11.315934 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2e6de-d630-47fd-89ea-4a826fcec421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:11.316922 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2e6de-d630-47fd-89ea-4a826fcec421 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:11.317424 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2e6de-d630-47fd-89ea-4a826fcec421 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:11.317880 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2e6de-d630-47fd-89ea-4a826fcec421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:11.320105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5cf2e6de-d630-47fd-89ea-4a826fcec421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:11.326204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f43396-0088-4546-ad5d-ca3cee920a2a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:11.332493 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488c8cd-e34b-4593-8b11-b617f70d8c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:11.333140 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2e6de-d630-47fd-89ea-4a826fcec421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:11.333301 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488c8cd-e34b-4593-8b11-b617f70d8c71 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:11.333676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488c8cd-e34b-4593-8b11-b617f70d8c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:11.334094 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488c8cd-e34b-4593-8b11-b617f70d8c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:11.335633 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2e6de-d630-47fd-89ea-4a826fcec421 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:11.343564 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488c8cd-e34b-4593-8b11-b617f70d8c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:11.345872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488c8cd-e34b-4593-8b11-b617f70d8c71 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:11.349600 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 918/1817] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:11.352035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2e6de-d630-47fd-89ea-4a826fcec421 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:11.355782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 900/1818] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:11.357270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c3d65-fa3c-47b3-8453-ce5c57c6b0ca None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:11.357625 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c3d65-fa3c-47b3-8453-ce5c57c6b0ca None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:11.357986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c3d65-fa3c-47b3-8453-ce5c57c6b0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:11.382715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-013c3d65-fa3c-47b3-8453-ce5c57c6b0ca None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:11.384040 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-013c3d65-fa3c-47b3-8453-ce5c57c6b0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:11.395044 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2e6de-d630-47fd-89ea-4a826fcec421 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:11.403297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 901/1819] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:11.404400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c3d65-fa3c-47b3-8453-ce5c57c6b0ca None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:11.407173 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcedb1-fa87-4d79-bc91-bf00c1b46e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:11.413389 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcedb1-fa87-4d79-bc91-bf00c1b46e84 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:11.414810 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcedb1-fa87-4d79-bc91-bf00c1b46e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:11.415689 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcedb1-fa87-4d79-bc91-bf00c1b46e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:11.417200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c3d65-fa3c-47b3-8453-ce5c57c6b0ca None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:11.421398 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70240925-828f-43ce-8db8-17e73ae8fb13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:11.422269 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70240925-828f-43ce-8db8-17e73ae8fb13 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:11.422648 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70240925-828f-43ce-8db8-17e73ae8fb13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:11.422994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70240925-828f-43ce-8db8-17e73ae8fb13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:11.432727 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70240925-828f-43ce-8db8-17e73ae8fb13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:11.434750 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70240925-828f-43ce-8db8-17e73ae8fb13 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:11.442221 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcedb1-fa87-4d79-bc91-bf00c1b46e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:11.444556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcedb1-fa87-4d79-bc91-bf00c1b46e84 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:11.446749 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 902/1820] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:11.447680 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70240925-828f-43ce-8db8-17e73ae8fb13 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:11.455761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 919/1821] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:11.456661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcedb1-fa87-4d79-bc91-bf00c1b46e84 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:11.458696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-71fcedb1-fa87-4d79-bc91-bf00c1b46e84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:11.459998 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70240925-828f-43ce-8db8-17e73ae8fb13 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:11.464742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac4a50-00ff-4830-a6fa-107e7b401e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:11.465654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac4a50-00ff-4830-a6fa-107e7b401e6e service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:11.466092 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac4a50-00ff-4830-a6fa-107e7b401e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:11.466525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac4a50-00ff-4830-a6fa-107e7b401e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:11.480738 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac4a50-00ff-4830-a6fa-107e7b401e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:11.484000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac4a50-00ff-4830-a6fa-107e7b401e6e service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:11.500584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 903/1822] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:11.502871 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac4a50-00ff-4830-a6fa-107e7b401e6e service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:11.507175 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-11ac4a50-00ff-4830-a6fa-107e7b401e6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:11.614263 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac4a50-00ff-4830-a6fa-107e7b401e6e service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:11.619879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97a00d-b50f-4f2a-a276-5eecbbb99e7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:11.620646 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97a00d-b50f-4f2a-a276-5eecbbb99e7c service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:11.620932 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97a00d-b50f-4f2a-a276-5eecbbb99e7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:11.621206 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97a00d-b50f-4f2a-a276-5eecbbb99e7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:11.624178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-cd97a00d-b50f-4f2a-a276-5eecbbb99e7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:11.636290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcedb1-fa87-4d79-bc91-bf00c1b46e84 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:11.644136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96811381-afdc-47eb-b261-201635aa5aca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:11.644959 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96811381-afdc-47eb-b261-201635aa5aca service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:11.645075 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96811381-afdc-47eb-b261-201635aa5aca service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:11.645391 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96811381-afdc-47eb-b261-201635aa5aca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:11.666815 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96811381-afdc-47eb-b261-201635aa5aca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:11.668290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96811381-afdc-47eb-b261-201635aa5aca service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:11.706488 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 920/1823] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:11.707756 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96811381-afdc-47eb-b261-201635aa5aca service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:11.730482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97a00d-b50f-4f2a-a276-5eecbbb99e7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:11.732229 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97a00d-b50f-4f2a-a276-5eecbbb99e7c service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:11.744572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 904/1824] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:11.746283 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7f0e7-bd1b-489b-a394-c9e497fc2a46 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:11.746645 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7f0e7-bd1b-489b-a394-c9e497fc2a46 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:11.746987 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7f0e7-bd1b-489b-a394-c9e497fc2a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:11.747983 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96811381-afdc-47eb-b261-201635aa5aca service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:11.767062 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d5379-29c1-4206-9f10-c40398bb32fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:11.767758 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d5379-29c1-4206-9f10-c40398bb32fa admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:11.768045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d5379-29c1-4206-9f10-c40398bb32fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:11.768335 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d5379-29c1-4206-9f10-c40398bb32fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:11.769067 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d5379-29c1-4206-9f10-c40398bb32fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:11.774499 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-21e7f0e7-bd1b-489b-a394-c9e497fc2a46 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:11.775867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-21e7f0e7-bd1b-489b-a394-c9e497fc2a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:11.778324 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d5379-29c1-4206-9f10-c40398bb32fa admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:11.793134 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 905/1825] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:11.797952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7f0e7-bd1b-489b-a394-c9e497fc2a46 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:11.822071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 921/1826] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:11.824239 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d5379-29c1-4206-9f10-c40398bb32fa admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:11.824362 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7f0e7-bd1b-489b-a394-c9e497fc2a46 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:11.837869 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef13fcb-80cd-4f1a-9b85-afe67fc3eef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:11.839399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef13fcb-80cd-4f1a-9b85-afe67fc3eef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:11.840997 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef13fcb-80cd-4f1a-9b85-afe67fc3eef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:11.841902 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef13fcb-80cd-4f1a-9b85-afe67fc3eef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:11.844445 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef13fcb-80cd-4f1a-9b85-afe67fc3eef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:11.845207 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef13fcb-80cd-4f1a-9b85-afe67fc3eef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:11.849697 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef13fcb-80cd-4f1a-9b85-afe67fc3eef1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:11.853913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d5379-29c1-4206-9f10-c40398bb32fa admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:11.873734 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b79b4-7d3d-44f7-bc85-5ad3c2d17574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:11.874711 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b79b4-7d3d-44f7-bc85-5ad3c2d17574 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:11.875052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b79b4-7d3d-44f7-bc85-5ad3c2d17574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:11.875899 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b79b4-7d3d-44f7-bc85-5ad3c2d17574 admin admin] PATH_INFO: `/v3/projects/eb8dff91836a41b0868653ab571634a9/users/2d16c01e92ff4226b2ecbdfdab9b937e/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:11.883598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 906/1827] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:28:11.887877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef13fcb-80cd-4f1a-9b85-afe67fc3eef1 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:11.919648 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef13fcb-80cd-4f1a-9b85-afe67fc3eef1 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:11.932991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b79b4-7d3d-44f7-bc85-5ad3c2d17574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb8dff91836a41b0868653ab571634a9, user_id=2d16c01e92ff4226b2ecbdfdab9b937e, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:11.944189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b79b4-7d3d-44f7-bc85-5ad3c2d17574 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:11.951556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d371d-4b96-49fc-b825-64687fe9e734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:11.956780 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d371d-4b96-49fc-b825-64687fe9e734 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:11.957881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d371d-4b96-49fc-b825-64687fe9e734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:11.959773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d371d-4b96-49fc-b825-64687fe9e734 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:11.963320 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d371d-4b96-49fc-b825-64687fe9e734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:11.971721 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d371d-4b96-49fc-b825-64687fe9e734 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:11.986332 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 922/1828] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:11 2022] PUT /identity/v3/projects/eb8dff91836a41b0868653ab571634a9/users/2d16c01e92ff4226b2ecbdfdab9b937e/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:11.998405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5891b3b-0d1c-4154-a1e8-4a76203d7901 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:11.998964 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5891b3b-0d1c-4154-a1e8-4a76203d7901 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:11.999620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5891b3b-0d1c-4154-a1e8-4a76203d7901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:12.045868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 907/1829] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:11 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:28:12.050919 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d371d-4b96-49fc-b825-64687fe9e734 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:12.064452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:12.081577 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a5891b3b-0d1c-4154-a1e8-4a76203d7901 None None] MFA Rules not processed for user `2d16c01e92ff4226b2ecbdfdab9b937e`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:12.082986 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a5891b3b-0d1c-4154-a1e8-4a76203d7901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:12.145464 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d371d-4b96-49fc-b825-64687fe9e734 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:12.151528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38b871-b38f-4fa9-84fe-59edf8aba216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:12.152684 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38b871-b38f-4fa9-84fe-59edf8aba216 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:12.153069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38b871-b38f-4fa9-84fe-59edf8aba216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:12.153500 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38b871-b38f-4fa9-84fe-59edf8aba216 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:12.154318 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38b871-b38f-4fa9-84fe-59edf8aba216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:12.157426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38b871-b38f-4fa9-84fe-59edf8aba216 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:12.185205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 908/1830] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:12 2022] POST /identity/v3/users => generated 283 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:12.189728 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38b871-b38f-4fa9-84fe-59edf8aba216 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:12.212023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38b871-b38f-4fa9-84fe-59edf8aba216 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:12.222457 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4f7ae-0947-45dd-b333-70782b529a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:12.224500 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4f7ae-0947-45dd-b333-70782b529a2f admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:12.225667 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4f7ae-0947-45dd-b333-70782b529a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:12.225930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4f7ae-0947-45dd-b333-70782b529a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:12.226782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4f7ae-0947-45dd-b333-70782b529a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:12.229586 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4f7ae-0947-45dd-b333-70782b529a2f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:12.250353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 909/1831] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:12.254078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4f7ae-0947-45dd-b333-70782b529a2f admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:12.267124 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 923/1832] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:12.271532 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5891b3b-0d1c-4154-a1e8-4a76203d7901 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:12.272752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4f7ae-0947-45dd-b333-70782b529a2f admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:12.280078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a787cf0-5c39-4c52-aeb0-2d6aba596acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:12.282177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a787cf0-5c39-4c52-aeb0-2d6aba596acb admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:12.282561 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a787cf0-5c39-4c52-aeb0-2d6aba596acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:12.283087 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a787cf0-5c39-4c52-aeb0-2d6aba596acb admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:12.283927 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a787cf0-5c39-4c52-aeb0-2d6aba596acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:12.286239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a787cf0-5c39-4c52-aeb0-2d6aba596acb admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:12.298315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5891b3b-0d1c-4154-a1e8-4a76203d7901 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:12.304084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 910/1833] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:12.308378 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a787cf0-5c39-4c52-aeb0-2d6aba596acb admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:12.316048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3d1b6-3891-4f44-8d13-40368e0529e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:12.316764 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3d1b6-3891-4f44-8d13-40368e0529e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:12.317071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3d1b6-3891-4f44-8d13-40368e0529e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:12.317799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3d1b6-3891-4f44-8d13-40368e0529e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:12.319104 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3d1b6-3891-4f44-8d13-40368e0529e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:12.327848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a787cf0-5c39-4c52-aeb0-2d6aba596acb admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:12.328357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3d1b6-3891-4f44-8d13-40368e0529e9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:12.334374 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6592d-22f9-448b-bfa2-4807d9f08d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:12.335384 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6592d-22f9-448b-bfa2-4807d9f08d3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:12.335841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6592d-22f9-448b-bfa2-4807d9f08d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:12.336848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6592d-22f9-448b-bfa2-4807d9f08d3c admin admin] PATH_INFO: `/v3/projects/35f0af37ce0442898cf1fc92ceb28d51/users/2adb22ae78584c83af5858151564c615/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:12.348652 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:12.374025 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6592d-22f9-448b-bfa2-4807d9f08d3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f0af37ce0442898cf1fc92ceb28d51, user_id=2adb22ae78584c83af5858151564c615, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:12.378376 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6592d-22f9-448b-bfa2-4807d9f08d3c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:12.389794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 924/1834] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:12 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:28:12.393640 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3d1b6-3891-4f44-8d13-40368e0529e9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:12.407288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 911/1835] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:12 2022] PUT /identity/v3/projects/35f0af37ce0442898cf1fc92ceb28d51/users/2adb22ae78584c83af5858151564c615/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:12.425083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657d50d-4c8e-4b3e-93e7-e24dcd64cba9 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:12.425419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657d50d-4c8e-4b3e-93e7-e24dcd64cba9 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:12.425700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657d50d-4c8e-4b3e-93e7-e24dcd64cba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:12.560537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a657d50d-4c8e-4b3e-93e7-e24dcd64cba9 None None] MFA Rules not processed for user `2adb22ae78584c83af5858151564c615`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:12.563327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a657d50d-4c8e-4b3e-93e7-e24dcd64cba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:12.653534 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3d1b6-3891-4f44-8d13-40368e0529e9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:12.713308 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 912/1836] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:12.717912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657d50d-4c8e-4b3e-93e7-e24dcd64cba9 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:12.811809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85820cdf-2b34-42f2-b952-89ff0a021779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:12.816806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85820cdf-2b34-42f2-b952-89ff0a021779 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:12.817618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85820cdf-2b34-42f2-b952-89ff0a021779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:12.817994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85820cdf-2b34-42f2-b952-89ff0a021779 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:12.819469 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85820cdf-2b34-42f2-b952-89ff0a021779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:12.824668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85820cdf-2b34-42f2-b952-89ff0a021779 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:12.839083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:12.876056 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 925/1837] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:12 2022] POST /identity/v3/users => generated 300 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:28:12.876056 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85820cdf-2b34-42f2-b952-89ff0a021779 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:12.896845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657d50d-4c8e-4b3e-93e7-e24dcd64cba9 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:12.912778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e3a82-bf17-453c-a228-7085376ef8d5 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a003c292db3472684e11526fcd23c19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd9bc18f2502449fa06a518a56c4bd5c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:12.917307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85820cdf-2b34-42f2-b952-89ff0a021779 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:12.918713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e3a82-bf17-453c-a228-7085376ef8d5 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:12.919688 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e3a82-bf17-453c-a228-7085376ef8d5 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:12.919986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e3a82-bf17-453c-a228-7085376ef8d5 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:12.920734 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e3a82-bf17-453c-a228-7085376ef8d5 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:12.921524 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e3a82-bf17-453c-a228-7085376ef8d5 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:12.931352 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e3a82-bf17-453c-a228-7085376ef8d5 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:12.931845 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22210294-e4ee-4785-8598-02b8dc322e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:12.934589 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22210294-e4ee-4785-8598-02b8dc322e23 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:12.935945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22210294-e4ee-4785-8598-02b8dc322e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:12.937407 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22210294-e4ee-4785-8598-02b8dc322e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:12.941662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22210294-e4ee-4785-8598-02b8dc322e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:12.953396 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22210294-e4ee-4785-8598-02b8dc322e23 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:12.981668 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 913/1838] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:28:12.983427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e3a82-bf17-453c-a228-7085376ef8d5 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:12.998146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e3a82-bf17-453c-a228-7085376ef8d5 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:13.013345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56236291-50df-49bc-9e34-786fa36e63db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:13.015164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56236291-50df-49bc-9e34-786fa36e63db admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:13.015735 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56236291-50df-49bc-9e34-786fa36e63db admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:13.016574 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56236291-50df-49bc-9e34-786fa36e63db admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:13.017632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56236291-50df-49bc-9e34-786fa36e63db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:13.019627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56236291-50df-49bc-9e34-786fa36e63db admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:13.028800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 926/1839] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:12 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:13.030929 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22210294-e4ee-4785-8598-02b8dc322e23 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:13.043078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 914/1840] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:13.044576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56236291-50df-49bc-9e34-786fa36e63db admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:13.070105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56236291-50df-49bc-9e34-786fa36e63db admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:13.202225 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef335e9-00d9-4e39-9431-b8e0471e6dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:13.203077 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef335e9-00d9-4e39-9431-b8e0471e6dad admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:13.204304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef335e9-00d9-4e39-9431-b8e0471e6dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:13.204304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef335e9-00d9-4e39-9431-b8e0471e6dad admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:13.204478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef335e9-00d9-4e39-9431-b8e0471e6dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:13.206502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef335e9-00d9-4e39-9431-b8e0471e6dad admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:13.225819 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22210294-e4ee-4785-8598-02b8dc322e23 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:13.239567 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e5ff8-c230-4b5d-9cdb-770f15d1dac3 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a003c292db3472684e11526fcd23c19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd9bc18f2502449fa06a518a56c4bd5c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:13.240267 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e5ff8-c230-4b5d-9cdb-770f15d1dac3 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:13.240551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e5ff8-c230-4b5d-9cdb-770f15d1dac3 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:13.240837 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e5ff8-c230-4b5d-9cdb-770f15d1dac3 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:13.241575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e5ff8-c230-4b5d-9cdb-770f15d1dac3 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:13.254586 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 915/1841] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:13 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:13.256097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e5ff8-c230-4b5d-9cdb-770f15d1dac3 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:13.269676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef335e9-00d9-4e39-9431-b8e0471e6dad admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:13.290859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef335e9-00d9-4e39-9431-b8e0471e6dad admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:13.301134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:13.321578 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93c89d-7282-4237-8a10-cf2b546332de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:13.322608 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93c89d-7282-4237-8a10-cf2b546332de admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:13.322899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93c89d-7282-4237-8a10-cf2b546332de admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:13.323220 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93c89d-7282-4237-8a10-cf2b546332de admin admin] PATH_INFO: `/v3/projects/1f4872094ec74c668b3f41e85aa40133/users/c5b2d039545e43bfb78641c2fb2b3ac5/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:13.340645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 927/1842] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:13 2022] POST /identity/v3/projects => generated 354 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:13.340645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e5ff8-c230-4b5d-9cdb-770f15d1dac3 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:13.387883 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93c89d-7282-4237-8a10-cf2b546332de admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4872094ec74c668b3f41e85aa40133, user_id=c5b2d039545e43bfb78641c2fb2b3ac5, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:13.391590 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93c89d-7282-4237-8a10-cf2b546332de admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:13.432890 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 916/1843] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:13 2022] PUT /identity/v3/projects/1f4872094ec74c668b3f41e85aa40133/users/c5b2d039545e43bfb78641c2fb2b3ac5/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:13.433953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93c89d-7282-4237-8a10-cf2b546332de admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:13.491319 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e5ff8-c230-4b5d-9cdb-770f15d1dac3 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:13.601223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93c89d-7282-4237-8a10-cf2b546332de admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:13.620117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5feab5-699a-4416-86d5-ab4f279e3196 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a003c292db3472684e11526fcd23c19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd9bc18f2502449fa06a518a56c4bd5c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:13.623846 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5feab5-699a-4416-86d5-ab4f279e3196 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:13.625631 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5feab5-699a-4416-86d5-ab4f279e3196 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:13.626028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5feab5-699a-4416-86d5-ab4f279e3196 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:13.627092 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5feab5-699a-4416-86d5-ab4f279e3196 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:13.630034 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5feab5-699a-4416-86d5-ab4f279e3196 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:13.636213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5feab5-699a-4416-86d5-ab4f279e3196 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:13.704291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 917/1844] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:28:13.713922 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5feab5-699a-4416-86d5-ab4f279e3196 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:13.736416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272eaf8-1406-416a-a4fd-645ccb1d5a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:13.738257 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272eaf8-1406-416a-a4fd-645ccb1d5a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:13.741603 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272eaf8-1406-416a-a4fd-645ccb1d5a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:13.742158 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272eaf8-1406-416a-a4fd-645ccb1d5a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:13.745332 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272eaf8-1406-416a-a4fd-645ccb1d5a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:13.751089 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272eaf8-1406-416a-a4fd-645ccb1d5a43 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:13.790221 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 928/1845] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:13.801879 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272eaf8-1406-416a-a4fd-645ccb1d5a43 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:13.808889 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:13.822317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272eaf8-1406-416a-a4fd-645ccb1d5a43 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:13.862264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32054db9-d8d0-4f01-9572-e9c41189e384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:13.863408 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32054db9-d8d0-4f01-9572-e9c41189e384 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:13.863699 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32054db9-d8d0-4f01-9572-e9c41189e384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:13.863978 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32054db9-d8d0-4f01-9572-e9c41189e384 admin admin] PATH_INFO: `/v3/projects/ee6489822f1c4829a0457843c455b2e3/users/a0bbefb22aae4f16ade43e4d665703d7/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:13.902434 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32054db9-d8d0-4f01-9572-e9c41189e384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6489822f1c4829a0457843c455b2e3, user_id=a0bbefb22aae4f16ade43e4d665703d7, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:13.907235 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32054db9-d8d0-4f01-9572-e9c41189e384 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:13.946026 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5feab5-699a-4416-86d5-ab4f279e3196 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:13.951175 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 929/1846] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:13 2022] PUT /identity/v3/projects/ee6489822f1c4829a0457843c455b2e3/users/a0bbefb22aae4f16ade43e4d665703d7/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:13.954437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32054db9-d8d0-4f01-9572-e9c41189e384 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:14.161919 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124b4f0-44c0-4d09-9654-372731161ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:14.162630 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124b4f0-44c0-4d09-9654-372731161ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:14.162914 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124b4f0-44c0-4d09-9654-372731161ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:14.165672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124b4f0-44c0-4d09-9654-372731161ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:14.166469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124b4f0-44c0-4d09-9654-372731161ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:14.179464 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124b4f0-44c0-4d09-9654-372731161ac5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:14.182711 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32054db9-d8d0-4f01-9572-e9c41189e384 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:14.201133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872c7cd-fc60-4b67-a764-d3023a42ba36 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a003c292db3472684e11526fcd23c19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd9bc18f2502449fa06a518a56c4bd5c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:14.202646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872c7cd-fc60-4b67-a764-d3023a42ba36 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:14.202974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872c7cd-fc60-4b67-a764-d3023a42ba36 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:14.203265 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872c7cd-fc60-4b67-a764-d3023a42ba36 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] PATH_INFO: `/v3/projects/c1979f33bf1c4bf8a7b78028d5d39764` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:14.205988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872c7cd-fc60-4b67-a764-d3023a42ba36 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c1979f33bf1c4bf8a7b78028d5d39764)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:14.214833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 918/1847] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:14.214833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124b4f0-44c0-4d09-9654-372731161ac5 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:14.215105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872c7cd-fc60-4b67-a764-d3023a42ba36 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:14.252022 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124b4f0-44c0-4d09-9654-372731161ac5 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:14.269586 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:14.288064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1115f-80a8-4b3f-aa2d-053cc14d618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:14.307052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1115f-80a8-4b3f-aa2d-053cc14d618a admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:14.307373 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1115f-80a8-4b3f-aa2d-053cc14d618a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:14.308799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1115f-80a8-4b3f-aa2d-053cc14d618a admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:14.309625 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1115f-80a8-4b3f-aa2d-053cc14d618a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:14.314457 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1115f-80a8-4b3f-aa2d-053cc14d618a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:14.358646 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 919/1848] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:14.360602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1115f-80a8-4b3f-aa2d-053cc14d618a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:14.410377 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e872c7cd-fc60-4b67-a764-d3023a42ba36 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1979f33bf1c4bf8a7b78028d5d39764', 'request_id': 'req-e872c7cd-fc60-4b67-a764-d3023a42ba36'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:14.421545 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1115f-80a8-4b3f-aa2d-053cc14d618a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:14.445053 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e872c7cd-fc60-4b67-a764-d3023a42ba36 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1979f33bf1c4bf8a7b78028d5d39764', 'request_id': 'req-e872c7cd-fc60-4b67-a764-d3023a42ba36'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:14.458921 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e872c7cd-fc60-4b67-a764-d3023a42ba36 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1979f33bf1c4bf8a7b78028d5d39764', 'request_id': 'req-e872c7cd-fc60-4b67-a764-d3023a42ba36'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:14.503412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e872c7cd-fc60-4b67-a764-d3023a42ba36 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] The token cache is being invalidate because project c1979f33bf1c4bf8a7b78028d5d39764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:14.504085 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e872c7cd-fc60-4b67-a764-d3023a42ba36 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:14.505614 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e872c7cd-fc60-4b67-a764-d3023a42ba36 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:14.508154 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 930/1849] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:13 2022] DELETE /identity/v3/projects/c1979f33bf1c4bf8a7b78028d5d39764 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:14.522321 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872c7cd-fc60-4b67-a764-d3023a42ba36 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:14.528665 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e872c7cd-fc60-4b67-a764-d3023a42ba36 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:14.682625 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab827f5-28fa-42b1-ad24-673bdeef557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:14.694241 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab827f5-28fa-42b1-ad24-673bdeef557d admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:14.696994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab827f5-28fa-42b1-ad24-673bdeef557d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:14.697792 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab827f5-28fa-42b1-ad24-673bdeef557d admin admin] PATH_INFO: `/v3/projects/1f4872094ec74c668b3f41e85aa40133/users/c5b2d039545e43bfb78641c2fb2b3ac5/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:14.705959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab827f5-28fa-42b1-ad24-673bdeef557d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4872094ec74c668b3f41e85aa40133, user_id=c5b2d039545e43bfb78641c2fb2b3ac5, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:14.729930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab827f5-28fa-42b1-ad24-673bdeef557d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:14.770923 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 920/1850] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:14 2022] PUT /identity/v3/projects/1f4872094ec74c668b3f41e85aa40133/users/c5b2d039545e43bfb78641c2fb2b3ac5/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:14.780840 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab827f5-28fa-42b1-ad24-673bdeef557d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:14.789138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-dab827f5-28fa-42b1-ad24-673bdeef557d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:14.861107 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872c7cd-fc60-4b67-a764-d3023a42ba36 tempest-VolumeQuotaClassesTest-1189461417 tempest-VolumeQuotaClassesTest-1189461417-project-admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:15.054042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:15.092493 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab827f5-28fa-42b1-ad24-673bdeef557d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:15.132521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa88c7-4feb-4481-8b6f-0885e622b6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:15.139143 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa88c7-4feb-4481-8b6f-0885e622b6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:15.141204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250d89a-87b5-4c43-91d1-61f38c9518ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:15.151659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa88c7-4feb-4481-8b6f-0885e622b6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:15.153011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa88c7-4feb-4481-8b6f-0885e622b6c3 admin admin] PATH_INFO: `/v3/projects/ee6489822f1c4829a0457843c455b2e3/users/a0bbefb22aae4f16ade43e4d665703d7/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:15.153508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250d89a-87b5-4c43-91d1-61f38c9518ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:15.154764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250d89a-87b5-4c43-91d1-61f38c9518ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:15.155241 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250d89a-87b5-4c43-91d1-61f38c9518ce admin admin] PATH_INFO: `/v3/projects/064e063be8bc4c15b58d607af0744d33` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:15.162176 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa88c7-4feb-4481-8b6f-0885e622b6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6489822f1c4829a0457843c455b2e3, user_id=a0bbefb22aae4f16ade43e4d665703d7, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:15.163178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250d89a-87b5-4c43-91d1-61f38c9518ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=064e063be8bc4c15b58d607af0744d33)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:15.167764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250d89a-87b5-4c43-91d1-61f38c9518ce admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:15.190008 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa88c7-4feb-4481-8b6f-0885e622b6c3 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:15.276148 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 931/1851] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:14 2022] PUT /identity/v3/projects/ee6489822f1c4829a0457843c455b2e3/users/a0bbefb22aae4f16ade43e4d665703d7/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:15.298824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5f501-a23e-42bb-b180-8eb918ca86b6 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:15.299773 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5f501-a23e-42bb-b180-8eb918ca86b6 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:15.305740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5f501-a23e-42bb-b180-8eb918ca86b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:15.475968 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1fb5f501-a23e-42bb-b180-8eb918ca86b6 None None] MFA Rules not processed for user `c5b2d039545e43bfb78641c2fb2b3ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:15.477540 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1fb5f501-a23e-42bb-b180-8eb918ca86b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:15.502077 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f250d89a-87b5-4c43-91d1-61f38c9518ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064e063be8bc4c15b58d607af0744d33', 'request_id': 'req-f250d89a-87b5-4c43-91d1-61f38c9518ce'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:15.523767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f250d89a-87b5-4c43-91d1-61f38c9518ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064e063be8bc4c15b58d607af0744d33', 'request_id': 'req-f250d89a-87b5-4c43-91d1-61f38c9518ce'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:15.541466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f250d89a-87b5-4c43-91d1-61f38c9518ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064e063be8bc4c15b58d607af0744d33', 'request_id': 'req-f250d89a-87b5-4c43-91d1-61f38c9518ce'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:15.571204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f250d89a-87b5-4c43-91d1-61f38c9518ce admin admin] The token cache is being invalidate because project 064e063be8bc4c15b58d607af0744d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:15.571504 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f250d89a-87b5-4c43-91d1-61f38c9518ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:15.580839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f250d89a-87b5-4c43-91d1-61f38c9518ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:15.582687 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 921/1852] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:14 2022] DELETE /identity/v3/projects/064e063be8bc4c15b58d607af0744d33 => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:15.589345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fda2b-9f4e-4624-9269-1c76c9800a9c None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:15.600669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fda2b-9f4e-4624-9269-1c76c9800a9c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:15.601035 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fda2b-9f4e-4624-9269-1c76c9800a9c None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:15.604370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 922/1853] 10.222.0.57 () {54 vars in 921 bytes} [Tue Jul 12 18:28:15 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:28:15.604783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:15.605214 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fda2b-9f4e-4624-9269-1c76c9800a9c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:15.608266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-902fda2b-9f4e-4624-9269-1c76c9800a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:15.736475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 932/1854] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:15.736475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae054ed8-4e98-4b0f-8564-2712b6a446ce None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:15.736475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae054ed8-4e98-4b0f-8564-2712b6a446ce None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:15.736475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae054ed8-4e98-4b0f-8564-2712b6a446ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:15.865871 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ae054ed8-4e98-4b0f-8564-2712b6a446ce None None] MFA Rules not processed for user `a0bbefb22aae4f16ade43e4d665703d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:15.869874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fda2b-9f4e-4624-9269-1c76c9800a9c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:15.870501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ae054ed8-4e98-4b0f-8564-2712b6a446ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:15.883428 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471821a2-cc97-48fe-9528-d4440b31c6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:15.885939 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471821a2-cc97-48fe-9528-d4440b31c6f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:15.888726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471821a2-cc97-48fe-9528-d4440b31c6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:15.891223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471821a2-cc97-48fe-9528-d4440b31c6f6 admin admin] PATH_INFO: `/v3/users/918abf8f5eba4b6793e19a3c9146bfed` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:15.895933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471821a2-cc97-48fe-9528-d4440b31c6f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=918abf8f5eba4b6793e19a3c9146bfed)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:15.901013 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471821a2-cc97-48fe-9528-d4440b31c6f6 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:16.055197 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-471821a2-cc97-48fe-9528-d4440b31c6f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918abf8f5eba4b6793e19a3c9146bfed'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:16.055974 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-471821a2-cc97-48fe-9528-d4440b31c6f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918abf8f5eba4b6793e19a3c9146bfed'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:16.085704 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-471821a2-cc97-48fe-9528-d4440b31c6f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918abf8f5eba4b6793e19a3c9146bfed'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:16.090490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-471821a2-cc97-48fe-9528-d4440b31c6f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918abf8f5eba4b6793e19a3c9146bfed'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:16.108623 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-471821a2-cc97-48fe-9528-d4440b31c6f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918abf8f5eba4b6793e19a3c9146bfed'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:16.117561 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 933/1855] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:16.121807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae054ed8-4e98-4b0f-8564-2712b6a446ce None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:16.139643 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ae054ed8-4e98-4b0f-8564-2712b6a446ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:16.160705 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:16.163651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae054ed8-4e98-4b0f-8564-2712b6a446ce None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:16.188219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 923/1856] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:15 2022] DELETE /identity/v3/users/918abf8f5eba4b6793e19a3c9146bfed => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:16.190823 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb1a9d-8382-44d0-a276-40a1d634d88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:16.192199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb1a9d-8382-44d0-a276-40a1d634d88e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:16.192488 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb1a9d-8382-44d0-a276-40a1d634d88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:16.192770 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb1a9d-8382-44d0-a276-40a1d634d88e admin admin] PATH_INFO: `/v3/users/1ec0ce2f3dab4ff7b2c931c2e9ed7523` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:16.196849 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b18697-c24f-4130-9f28-d5a47f973645 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:16.197544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b18697-c24f-4130-9f28-d5a47f973645 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:16.198136 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b18697-c24f-4130-9f28-d5a47f973645 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:16.199923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb1a9d-8382-44d0-a276-40a1d634d88e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ec0ce2f3dab4ff7b2c931c2e9ed7523)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:16.202618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb1a9d-8382-44d0-a276-40a1d634d88e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:16.211259 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 924/1857] 10.222.0.57 () {54 vars in 921 bytes} [Tue Jul 12 18:28:16 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:28:16.212924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b18697-c24f-4130-9f28-d5a47f973645 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:16.222014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-16b18697-c24f-4130-9f28-d5a47f973645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:16.306053 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c4cb1a9d-8382-44d0-a276-40a1d634d88e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ec0ce2f3dab4ff7b2c931c2e9ed7523'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:16.307247 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c4cb1a9d-8382-44d0-a276-40a1d634d88e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ec0ce2f3dab4ff7b2c931c2e9ed7523'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:16.327577 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c4cb1a9d-8382-44d0-a276-40a1d634d88e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ec0ce2f3dab4ff7b2c931c2e9ed7523'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:16.338642 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c4cb1a9d-8382-44d0-a276-40a1d634d88e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ec0ce2f3dab4ff7b2c931c2e9ed7523'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:16.339841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c4cb1a9d-8382-44d0-a276-40a1d634d88e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ec0ce2f3dab4ff7b2c931c2e9ed7523'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:16.358492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 934/1858] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:16 2022] DELETE /identity/v3/users/1ec0ce2f3dab4ff7b2c931c2e9ed7523 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:16.361021 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933940d8-cba8-4965-91b0-e322d49af10f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:16.361606 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933940d8-cba8-4965-91b0-e322d49af10f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:16.362578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933940d8-cba8-4965-91b0-e322d49af10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:16.389195 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-933940d8-cba8-4965-91b0-e322d49af10f None None] MFA Rules not processed for user `a7c1bb51c2b642ffa4708122d826fc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:16.390939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-933940d8-cba8-4965-91b0-e322d49af10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:16.416874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:16.460118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b18697-c24f-4130-9f28-d5a47f973645 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:16.492501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 935/1859] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Jul 12 18:28:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:16.494128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933940d8-cba8-4965-91b0-e322d49af10f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:16.495862 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-933940d8-cba8-4965-91b0-e322d49af10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:16.595501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933940d8-cba8-4965-91b0-e322d49af10f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:16.601552 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36956e8-5f61-4100-9569-7e2cb0d683b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:16.602281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36956e8-5f61-4100-9569-7e2cb0d683b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:16.602572 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36956e8-5f61-4100-9569-7e2cb0d683b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:16.603048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36956e8-5f61-4100-9569-7e2cb0d683b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:16.606481 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f36956e8-5f61-4100-9569-7e2cb0d683b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:16.631455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed22ac8-4087-4bab-861d-b4a7fbfa6841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:16.632509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed22ac8-4087-4bab-861d-b4a7fbfa6841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:16.632907 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed22ac8-4087-4bab-861d-b4a7fbfa6841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:16.633314 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed22ac8-4087-4bab-861d-b4a7fbfa6841 admin admin] PATH_INFO: `/v3/users/276b85cd421d49429bec9c3cfe239a83` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:16.634783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed22ac8-4087-4bab-861d-b4a7fbfa6841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=276b85cd421d49429bec9c3cfe239a83)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:16.638978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed22ac8-4087-4bab-861d-b4a7fbfa6841 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:16.731775 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36956e8-5f61-4100-9569-7e2cb0d683b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:16.735370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36956e8-5f61-4100-9569-7e2cb0d683b3 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:16.746767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fed22ac8-4087-4bab-861d-b4a7fbfa6841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276b85cd421d49429bec9c3cfe239a83'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:16.747493 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fed22ac8-4087-4bab-861d-b4a7fbfa6841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276b85cd421d49429bec9c3cfe239a83'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:16.762081 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fed22ac8-4087-4bab-861d-b4a7fbfa6841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276b85cd421d49429bec9c3cfe239a83'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:16.763095 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fed22ac8-4087-4bab-861d-b4a7fbfa6841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276b85cd421d49429bec9c3cfe239a83'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:16.782985 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 936/1860] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:16.786078 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36956e8-5f61-4100-9569-7e2cb0d683b3 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:16.790855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f36956e8-5f61-4100-9569-7e2cb0d683b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:16.806246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fed22ac8-4087-4bab-861d-b4a7fbfa6841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276b85cd421d49429bec9c3cfe239a83'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:16.815127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36956e8-5f61-4100-9569-7e2cb0d683b3 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:16.837023 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9796158-1d3f-4d44-9aa4-e69535489d71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:16.837932 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9796158-1d3f-4d44-9aa4-e69535489d71 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:16.839050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9796158-1d3f-4d44-9aa4-e69535489d71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:16.839651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9796158-1d3f-4d44-9aa4-e69535489d71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:16.843451 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d9796158-1d3f-4d44-9aa4-e69535489d71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:16.899132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 925/1861] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:16 2022] DELETE /identity/v3/users/276b85cd421d49429bec9c3cfe239a83 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:16.899132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cb3d4-03b7-49ec-8ec8-03457aaade19 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:16.899132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cb3d4-03b7-49ec-8ec8-03457aaade19 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:16.899132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cb3d4-03b7-49ec-8ec8-03457aaade19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:16.954011 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c13cb3d4-03b7-49ec-8ec8-03457aaade19 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:16.955254 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c13cb3d4-03b7-49ec-8ec8-03457aaade19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:17.015626 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:17.017173 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9796158-1d3f-4d44-9aa4-e69535489d71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:17.041911 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9796158-1d3f-4d44-9aa4-e69535489d71 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:17.056419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:17.082884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 937/1862] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:17.084995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d41a4-2910-473e-9094-6e6bd9bfc9a5 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:17.085325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d41a4-2910-473e-9094-6e6bd9bfc9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:17.085607 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d41a4-2910-473e-9094-6e6bd9bfc9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:17.168817 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-302d41a4-2910-473e-9094-6e6bd9bfc9a5 None None] MFA Rules not processed for user `a7c1bb51c2b642ffa4708122d826fc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:17.172646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-302d41a4-2910-473e-9094-6e6bd9bfc9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:17.175556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 926/1863] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:17.177669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31d4b3-deef-4d7c-8230-7c0162f97b6e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:17.177924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31d4b3-deef-4d7c-8230-7c0162f97b6e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:17.178207 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31d4b3-deef-4d7c-8230-7c0162f97b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:17.207333 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-7e31d4b3-deef-4d7c-8230-7c0162f97b6e None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:17.208795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7e31d4b3-deef-4d7c-8230-7c0162f97b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:17.223355 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 927/1864] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:17.224314 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31d4b3-deef-4d7c-8230-7c0162f97b6e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:17.226266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7e31d4b3-deef-4d7c-8230-7c0162f97b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:17.320250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31d4b3-deef-4d7c-8230-7c0162f97b6e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:17.327260 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b35df-5c27-489c-b2ef-7f59ab1d3a76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:17.329320 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b35df-5c27-489c-b2ef-7f59ab1d3a76 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:17.329898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b35df-5c27-489c-b2ef-7f59ab1d3a76 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:17.330385 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b35df-5c27-489c-b2ef-7f59ab1d3a76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:17.332678 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-039b35df-5c27-489c-b2ef-7f59ab1d3a76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:17.349157 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b35df-5c27-489c-b2ef-7f59ab1d3a76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:17.351501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b35df-5c27-489c-b2ef-7f59ab1d3a76 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:17.358170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 938/1865] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Jul 12 18:28:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:17.359654 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d41a4-2910-473e-9094-6e6bd9bfc9a5 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:17.361401 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-302d41a4-2910-473e-9094-6e6bd9bfc9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:17.382142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 928/1866] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:17.384374 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b35df-5c27-489c-b2ef-7f59ab1d3a76 service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:17.387669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-039b35df-5c27-489c-b2ef-7f59ab1d3a76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:17.508326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b35df-5c27-489c-b2ef-7f59ab1d3a76 service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:17.508637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d41a4-2910-473e-9094-6e6bd9bfc9a5 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:17.520426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d81c3-2467-405c-aef5-eca391cc9347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:17.520663 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c66d55-2004-4c60-963d-4ddb2b871126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:17.521140 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d81c3-2467-405c-aef5-eca391cc9347 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:17.521410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c66d55-2004-4c60-963d-4ddb2b871126 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:17.521521 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d81c3-2467-405c-aef5-eca391cc9347 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:17.521610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c66d55-2004-4c60-963d-4ddb2b871126 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:17.521834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d81c3-2467-405c-aef5-eca391cc9347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:17.521929 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c66d55-2004-4c60-963d-4ddb2b871126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:17.534655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-80c66d55-2004-4c60-963d-4ddb2b871126 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:17.575976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d81c3-2467-405c-aef5-eca391cc9347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:17.581517 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d81c3-2467-405c-aef5-eca391cc9347 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:17.610893 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 929/1867] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:17.611778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d81c3-2467-405c-aef5-eca391cc9347 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:17.653449 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d81c3-2467-405c-aef5-eca391cc9347 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:17.680288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5076561-b5e0-4377-9e60-b4873a61949c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:17.683831 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5076561-b5e0-4377-9e60-b4873a61949c service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:17.684152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5076561-b5e0-4377-9e60-b4873a61949c service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:17.688556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5076561-b5e0-4377-9e60-b4873a61949c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:17.745389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5076561-b5e0-4377-9e60-b4873a61949c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:17.748904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c66d55-2004-4c60-963d-4ddb2b871126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:17.751466 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c66d55-2004-4c60-963d-4ddb2b871126 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:17.755939 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5076561-b5e0-4377-9e60-b4873a61949c service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:17.795114 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 939/1868] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:17.806452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 930/1869] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:18.031933 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c66d55-2004-4c60-963d-4ddb2b871126 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:18.033710 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-80c66d55-2004-4c60-963d-4ddb2b871126 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:18.050675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c66d55-2004-4c60-963d-4ddb2b871126 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:18.055290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa7752-d334-43aa-90a1-1deca24deb66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:18.056922 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa7752-d334-43aa-90a1-1deca24deb66 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:18.057370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa7752-d334-43aa-90a1-1deca24deb66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:18.057760 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa7752-d334-43aa-90a1-1deca24deb66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:18.060092 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d2aa7752-d334-43aa-90a1-1deca24deb66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:18.149180 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:18.168094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa7752-d334-43aa-90a1-1deca24deb66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:18.170700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa7752-d334-43aa-90a1-1deca24deb66 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:18.184609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 940/1870] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:18.715107 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5076561-b5e0-4377-9e60-b4873a61949c service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:18.737667 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5076561-b5e0-4377-9e60-b4873a61949c service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:18.752309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03406394-a981-4341-89a4-d2c8cff186ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:18.755263 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03406394-a981-4341-89a4-d2c8cff186ec service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:18.755263 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03406394-a981-4341-89a4-d2c8cff186ec service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:18.755263 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03406394-a981-4341-89a4-d2c8cff186ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:18.773743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03406394-a981-4341-89a4-d2c8cff186ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:18.775470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03406394-a981-4341-89a4-d2c8cff186ec service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:18.828731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 931/1871] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:18.882821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa7752-d334-43aa-90a1-1deca24deb66 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:18.885025 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d2aa7752-d334-43aa-90a1-1deca24deb66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:18.911283 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa7752-d334-43aa-90a1-1deca24deb66 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:18.923151 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226cf3d-0a5a-463b-8aa7-b96082a2a68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:18.924158 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226cf3d-0a5a-463b-8aa7-b96082a2a68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:18.924548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226cf3d-0a5a-463b-8aa7-b96082a2a68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:18.924955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226cf3d-0a5a-463b-8aa7-b96082a2a68a admin admin] PATH_INFO: `/v3/projects/41603dec001b48858b2a8389cd8b09be` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:18.927454 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226cf3d-0a5a-463b-8aa7-b96082a2a68a admin admin] RBAC: Authorizing `identity:delete_project(project_id=41603dec001b48858b2a8389cd8b09be)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:18.932258 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226cf3d-0a5a-463b-8aa7-b96082a2a68a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:19.028033 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c226cf3d-0a5a-463b-8aa7-b96082a2a68a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41603dec001b48858b2a8389cd8b09be', 'request_id': 'req-c226cf3d-0a5a-463b-8aa7-b96082a2a68a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:19.066835 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c226cf3d-0a5a-463b-8aa7-b96082a2a68a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41603dec001b48858b2a8389cd8b09be', 'request_id': 'req-c226cf3d-0a5a-463b-8aa7-b96082a2a68a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:19.088968 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c226cf3d-0a5a-463b-8aa7-b96082a2a68a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41603dec001b48858b2a8389cd8b09be', 'request_id': 'req-c226cf3d-0a5a-463b-8aa7-b96082a2a68a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:19.107438 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03406394-a981-4341-89a4-d2c8cff186ec service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:19.109344 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-03406394-a981-4341-89a4-d2c8cff186ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:19.122499 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c226cf3d-0a5a-463b-8aa7-b96082a2a68a admin admin] The token cache is being invalidate because project 41603dec001b48858b2a8389cd8b09be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:19.123210 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c226cf3d-0a5a-463b-8aa7-b96082a2a68a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:19.124179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c226cf3d-0a5a-463b-8aa7-b96082a2a68a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:19.127351 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 941/1872] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:18 2022] DELETE /identity/v3/projects/41603dec001b48858b2a8389cd8b09be => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:19.132502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79e8f1-c733-446a-8db9-25fb0b560404 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:19.132721 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79e8f1-c733-446a-8db9-25fb0b560404 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:19.141778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79e8f1-c733-446a-8db9-25fb0b560404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:19.159303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03406394-a981-4341-89a4-d2c8cff186ec service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:19.194334 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8e79e8f1-c733-446a-8db9-25fb0b560404 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:19.196538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8e79e8f1-c733-446a-8db9-25fb0b560404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:19.219078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:19.326996 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b5b9e-534d-41d9-86ad-de4e2820539c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:19.334099 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 942/1873] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:19.340449 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b5b9e-534d-41d9-86ad-de4e2820539c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:19.340756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b5b9e-534d-41d9-86ad-de4e2820539c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:19.341051 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b5b9e-534d-41d9-86ad-de4e2820539c admin admin] PATH_INFO: `/v3/projects/0755b1c3b7244163bb7409c6c008ec2e` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:19.342321 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554573a4-1276-4249-9dc7-6759c433d2f6 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:19.342583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b5b9e-534d-41d9-86ad-de4e2820539c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0755b1c3b7244163bb7409c6c008ec2e)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:19.342825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554573a4-1276-4249-9dc7-6759c433d2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:19.343231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554573a4-1276-4249-9dc7-6759c433d2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:19.344628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b5b9e-534d-41d9-86ad-de4e2820539c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:19.370171 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-554573a4-1276-4249-9dc7-6759c433d2f6 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:19.371565 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-554573a4-1276-4249-9dc7-6759c433d2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:19.384840 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 943/1874] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:28:19.389931 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554573a4-1276-4249-9dc7-6759c433d2f6 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:19.403109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554573a4-1276-4249-9dc7-6759c433d2f6 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:19.410256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce53d88-3970-47eb-835f-2161eb11ed2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:19.411129 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53d88-3970-47eb-835f-2161eb11ed2f admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:19.411518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53d88-3970-47eb-835f-2161eb11ed2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:19.411982 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53d88-3970-47eb-835f-2161eb11ed2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:19.412801 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce53d88-3970-47eb-835f-2161eb11ed2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:19.413216 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce53d88-3970-47eb-835f-2161eb11ed2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:19.415892 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce53d88-3970-47eb-835f-2161eb11ed2f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:19.448242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 944/1875] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:28:19.454155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce53d88-3970-47eb-835f-2161eb11ed2f admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:19.486097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce53d88-3970-47eb-835f-2161eb11ed2f admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:19.515646 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7f8b5b9e-534d-41d9-86ad-de4e2820539c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0755b1c3b7244163bb7409c6c008ec2e', 'request_id': 'req-7f8b5b9e-534d-41d9-86ad-de4e2820539c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:19.544714 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7f8b5b9e-534d-41d9-86ad-de4e2820539c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0755b1c3b7244163bb7409c6c008ec2e', 'request_id': 'req-7f8b5b9e-534d-41d9-86ad-de4e2820539c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:19.590518 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7f8b5b9e-534d-41d9-86ad-de4e2820539c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0755b1c3b7244163bb7409c6c008ec2e', 'request_id': 'req-7f8b5b9e-534d-41d9-86ad-de4e2820539c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:19.643535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:19.647859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7f8b5b9e-534d-41d9-86ad-de4e2820539c admin admin] The token cache is being invalidate because project 0755b1c3b7244163bb7409c6c008ec2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:19.648817 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7f8b5b9e-534d-41d9-86ad-de4e2820539c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:19.667652 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7f8b5b9e-534d-41d9-86ad-de4e2820539c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:19.677315 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 932/1876] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:19 2022] DELETE /identity/v3/projects/0755b1c3b7244163bb7409c6c008ec2e => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:19.679441 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2605559-93c1-4d14-8df4-8c89e38d6872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:19.680504 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2605559-93c1-4d14-8df4-8c89e38d6872 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:19.681018 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2605559-93c1-4d14-8df4-8c89e38d6872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:19.681226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b5b9e-534d-41d9-86ad-de4e2820539c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:19.681745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2605559-93c1-4d14-8df4-8c89e38d6872 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:19.682653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2605559-93c1-4d14-8df4-8c89e38d6872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:19.683232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7f8b5b9e-534d-41d9-86ad-de4e2820539c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:19.688499 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2605559-93c1-4d14-8df4-8c89e38d6872 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:19.736900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b5b9e-534d-41d9-86ad-de4e2820539c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:19.758114 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5c282-5215-4400-acfe-555f9e659f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:19.760695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5c282-5215-4400-acfe-555f9e659f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:19.761333 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5c282-5215-4400-acfe-555f9e659f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:19.762503 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5c282-5215-4400-acfe-555f9e659f71 admin admin] PATH_INFO: `/v3/projects/5d35c8b8430e4875aab0ac8cac2c0862` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:19.764332 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5c282-5215-4400-acfe-555f9e659f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d35c8b8430e4875aab0ac8cac2c0862)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:19.769632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5c282-5215-4400-acfe-555f9e659f71 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:19.797391 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 945/1877] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:19 2022] POST /identity/v3/projects => generated 365 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:28:19.798429 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2605559-93c1-4d14-8df4-8c89e38d6872 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:19.803212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b2605559-93c1-4d14-8df4-8c89e38d6872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:19.935710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0ca5c282-5215-4400-acfe-555f9e659f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d35c8b8430e4875aab0ac8cac2c0862', 'request_id': 'req-0ca5c282-5215-4400-acfe-555f9e659f71'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:19.974955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0ca5c282-5215-4400-acfe-555f9e659f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d35c8b8430e4875aab0ac8cac2c0862', 'request_id': 'req-0ca5c282-5215-4400-acfe-555f9e659f71'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.019685 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0ca5c282-5215-4400-acfe-555f9e659f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d35c8b8430e4875aab0ac8cac2c0862', 'request_id': 'req-0ca5c282-5215-4400-acfe-555f9e659f71'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.061648 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2605559-93c1-4d14-8df4-8c89e38d6872 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:20.090194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0ca5c282-5215-4400-acfe-555f9e659f71 admin admin] The token cache is being invalidate because project 5d35c8b8430e4875aab0ac8cac2c0862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:20.090485 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0ca5c282-5215-4400-acfe-555f9e659f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.099953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0ca5c282-5215-4400-acfe-555f9e659f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.103810 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 933/1878] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:19 2022] DELETE /identity/v3/projects/5d35c8b8430e4875aab0ac8cac2c0862 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:20.105015 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5c282-5215-4400-acfe-555f9e659f71 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:20.111829 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0ca5c282-5215-4400-acfe-555f9e659f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:20.226153 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68c936-3592-45ae-b8e8-b6d11533ddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:20.227389 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68c936-3592-45ae-b8e8-b6d11533ddfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:20.229284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68c936-3592-45ae-b8e8-b6d11533ddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:20.230604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68c936-3592-45ae-b8e8-b6d11533ddfe admin admin] PATH_INFO: `/v3/users/3a003c292db3472684e11526fcd23c19` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:20.233288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68c936-3592-45ae-b8e8-b6d11533ddfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a003c292db3472684e11526fcd23c19)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:20.236551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68c936-3592-45ae-b8e8-b6d11533ddfe admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:20.257354 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:20.329042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5c282-5215-4400-acfe-555f9e659f71 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:20.334792 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cf95e-d6ea-4fd8-b451-b896ccb1170d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:20.344044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cf95e-d6ea-4fd8-b451-b896ccb1170d admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:20.344044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cf95e-d6ea-4fd8-b451-b896ccb1170d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:20.344044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cf95e-d6ea-4fd8-b451-b896ccb1170d admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:20.344044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cf95e-d6ea-4fd8-b451-b896ccb1170d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:20.344044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cf95e-d6ea-4fd8-b451-b896ccb1170d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:20.377691 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 934/1879] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:20 2022] POST /identity/v3/users => generated 283 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:20.377691 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cf95e-d6ea-4fd8-b451-b896ccb1170d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:20.380761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-de68c936-3592-45ae-b8e8-b6d11533ddfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a003c292db3472684e11526fcd23c19'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.381462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a56cf95e-d6ea-4fd8-b451-b896ccb1170d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:20.383604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-de68c936-3592-45ae-b8e8-b6d11533ddfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a003c292db3472684e11526fcd23c19'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.418165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cf95e-d6ea-4fd8-b451-b896ccb1170d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:20.426225 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec136f-3cef-479e-8360-1c88f80c40b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:20.427297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec136f-3cef-479e-8360-1c88f80c40b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:20.427546 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec136f-3cef-479e-8360-1c88f80c40b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:20.428025 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec136f-3cef-479e-8360-1c88f80c40b1 admin admin] PATH_INFO: `/v3/users/e953ae24a7af4afdb57d2fac65a6d1d6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:20.430228 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec136f-3cef-479e-8360-1c88f80c40b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e953ae24a7af4afdb57d2fac65a6d1d6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:20.433853 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec136f-3cef-479e-8360-1c88f80c40b1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:20.440812 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-de68c936-3592-45ae-b8e8-b6d11533ddfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a003c292db3472684e11526fcd23c19'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.474052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-de68c936-3592-45ae-b8e8-b6d11533ddfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a003c292db3472684e11526fcd23c19'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.479074 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-de68c936-3592-45ae-b8e8-b6d11533ddfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a003c292db3472684e11526fcd23c19'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.525713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:20.531449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 946/1880] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:19 2022] DELETE /identity/v3/users/3a003c292db3472684e11526fcd23c19 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:20.544097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68c936-3592-45ae-b8e8-b6d11533ddfe admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:20.549408 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-de68c936-3592-45ae-b8e8-b6d11533ddfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:20.573537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7dec136f-3cef-479e-8360-1c88f80c40b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e953ae24a7af4afdb57d2fac65a6d1d6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.575927 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7dec136f-3cef-479e-8360-1c88f80c40b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e953ae24a7af4afdb57d2fac65a6d1d6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.588842 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7dec136f-3cef-479e-8360-1c88f80c40b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e953ae24a7af4afdb57d2fac65a6d1d6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.590543 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7dec136f-3cef-479e-8360-1c88f80c40b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e953ae24a7af4afdb57d2fac65a6d1d6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.608388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7dec136f-3cef-479e-8360-1c88f80c40b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e953ae24a7af4afdb57d2fac65a6d1d6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.657390 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 935/1881] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:20 2022] DELETE /identity/v3/users/e953ae24a7af4afdb57d2fac65a6d1d6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:20.723804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68c936-3592-45ae-b8e8-b6d11533ddfe admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:20.812976 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92040d-c659-4de6-94f5-750fa39872d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:20.813949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92040d-c659-4de6-94f5-750fa39872d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:20.814471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92040d-c659-4de6-94f5-750fa39872d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:20.814972 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92040d-c659-4de6-94f5-750fa39872d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:20.815781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92040d-c659-4de6-94f5-750fa39872d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:20.817594 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92040d-c659-4de6-94f5-750fa39872d5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:20.834752 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 947/1882] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:20.836619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec136f-3cef-479e-8360-1c88f80c40b1 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:20.838458 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7dec136f-3cef-479e-8360-1c88f80c40b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:20.864569 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec136f-3cef-479e-8360-1c88f80c40b1 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:20.885676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6512f-5e6c-44c9-b27c-79984d38d3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:20.886531 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6512f-5e6c-44c9-b27c-79984d38d3ea admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:20.887291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6512f-5e6c-44c9-b27c-79984d38d3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:20.887527 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6512f-5e6c-44c9-b27c-79984d38d3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:20.889537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6512f-5e6c-44c9-b27c-79984d38d3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:20.896699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6512f-5e6c-44c9-b27c-79984d38d3ea admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:20.915187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 936/1883] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:20.917148 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92040d-c659-4de6-94f5-750fa39872d5 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:20.940031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92040d-c659-4de6-94f5-750fa39872d5 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:20.971482 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d906466-a5e7-424c-9150-cb164c9baf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:20.975977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d906466-a5e7-424c-9150-cb164c9baf0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:20.976841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d906466-a5e7-424c-9150-cb164c9baf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:20.977492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d906466-a5e7-424c-9150-cb164c9baf0d admin admin] PATH_INFO: `/v3/projects/1901d4f88e1b4580a586fe62aba61f7e/users/78f37522278742538efa019d802b123e/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:21.026931 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d906466-a5e7-424c-9150-cb164c9baf0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1901d4f88e1b4580a586fe62aba61f7e, user_id=78f37522278742538efa019d802b123e, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:21.033764 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d906466-a5e7-424c-9150-cb164c9baf0d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:21.070581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce356b2f-0574-4957-8465-47c1bad3e3d2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:21.070916 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce356b2f-0574-4957-8465-47c1bad3e3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:21.071296 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce356b2f-0574-4957-8465-47c1bad3e3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:21.073059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 948/1884] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:20 2022] PUT /identity/v3/projects/1901d4f88e1b4580a586fe62aba61f7e/users/78f37522278742538efa019d802b123e/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:21.111510 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ce356b2f-0574-4957-8465-47c1bad3e3d2 None None] MFA Rules not processed for user `78f37522278742538efa019d802b123e`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:21.113342 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ce356b2f-0574-4957-8465-47c1bad3e3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:21.207575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d906466-a5e7-424c-9150-cb164c9baf0d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:21.208367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 937/1885] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:28:21.273111 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d906466-a5e7-424c-9150-cb164c9baf0d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:21.278142 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621b13e-a2fc-4896-aa96-d5e1de0dff1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:21.278873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621b13e-a2fc-4896-aa96-d5e1de0dff1e admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:21.279221 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621b13e-a2fc-4896-aa96-d5e1de0dff1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:21.279501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621b13e-a2fc-4896-aa96-d5e1de0dff1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:21.280185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621b13e-a2fc-4896-aa96-d5e1de0dff1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:21.282206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621b13e-a2fc-4896-aa96-d5e1de0dff1e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:21.310293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 949/1886] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:21 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:21.314806 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce356b2f-0574-4957-8465-47c1bad3e3d2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:21.325993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce356b2f-0574-4957-8465-47c1bad3e3d2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:21.338801 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:21.408572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc463b3-c309-42c0-b179-5ef6d38db680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:21.409599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc463b3-c309-42c0-b179-5ef6d38db680 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:21.410060 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc463b3-c309-42c0-b179-5ef6d38db680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:21.410347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc463b3-c309-42c0-b179-5ef6d38db680 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:21.411059 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc463b3-c309-42c0-b179-5ef6d38db680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:21.413187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc463b3-c309-42c0-b179-5ef6d38db680 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:21.449603 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 938/1887] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:21 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:28:21.451403 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621b13e-a2fc-4896-aa96-d5e1de0dff1e admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:21.458982 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:21.463238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621b13e-a2fc-4896-aa96-d5e1de0dff1e admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:21.470151 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783672ec-9939-4bf2-85f9-b851fe4a78f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:21.471001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783672ec-9939-4bf2-85f9-b851fe4a78f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:21.471385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783672ec-9939-4bf2-85f9-b851fe4a78f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:21.472184 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783672ec-9939-4bf2-85f9-b851fe4a78f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:21.472620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783672ec-9939-4bf2-85f9-b851fe4a78f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:21.474850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783672ec-9939-4bf2-85f9-b851fe4a78f8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:21.486130 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 950/1888] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:21.490163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc463b3-c309-42c0-b179-5ef6d38db680 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:21.500950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc463b3-c309-42c0-b179-5ef6d38db680 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:21.519512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70ba6b-7ffd-4308-9709-e6bef66edc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:21.520627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70ba6b-7ffd-4308-9709-e6bef66edc1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:21.521030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70ba6b-7ffd-4308-9709-e6bef66edc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:21.521923 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70ba6b-7ffd-4308-9709-e6bef66edc1a admin admin] PATH_INFO: `/v3/projects/920d8735f78d4f5f8a6877563a84d4d3/users/696daa4bc56c499fabbdfda18f296b0b/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:21.547777 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70ba6b-7ffd-4308-9709-e6bef66edc1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=920d8735f78d4f5f8a6877563a84d4d3, user_id=696daa4bc56c499fabbdfda18f296b0b, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:21.550660 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70ba6b-7ffd-4308-9709-e6bef66edc1a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:21.567674 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 939/1889] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:21 2022] PUT /identity/v3/projects/920d8735f78d4f5f8a6877563a84d4d3/users/696daa4bc56c499fabbdfda18f296b0b/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:21.573960 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783672ec-9939-4bf2-85f9-b851fe4a78f8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:21.598180 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783672ec-9939-4bf2-85f9-b851fe4a78f8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:21.672914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9befcf-5628-4535-a10d-9c5faec7ceef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:21.673630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9befcf-5628-4535-a10d-9c5faec7ceef admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:21.673910 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9befcf-5628-4535-a10d-9c5faec7ceef admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:21.674182 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9befcf-5628-4535-a10d-9c5faec7ceef admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:21.674896 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9befcf-5628-4535-a10d-9c5faec7ceef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:21.676541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9befcf-5628-4535-a10d-9c5faec7ceef admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:21.691952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 951/1890] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:21.693248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70ba6b-7ffd-4308-9709-e6bef66edc1a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:21.709608 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70ba6b-7ffd-4308-9709-e6bef66edc1a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:21.714550 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf558b-8821-4725-a5ff-3f669eccb263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:21.715439 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf558b-8821-4725-a5ff-3f669eccb263 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:21.715719 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf558b-8821-4725-a5ff-3f669eccb263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:21.715991 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf558b-8821-4725-a5ff-3f669eccb263 admin admin] PATH_INFO: `/v3/projects/920d8735f78d4f5f8a6877563a84d4d3/users/696daa4bc56c499fabbdfda18f296b0b/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:21.719552 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf558b-8821-4725-a5ff-3f669eccb263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=920d8735f78d4f5f8a6877563a84d4d3, user_id=696daa4bc56c499fabbdfda18f296b0b, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:21.723146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf558b-8821-4725-a5ff-3f669eccb263 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:21.748863 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 940/1891] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:21 2022] PUT /identity/v3/projects/920d8735f78d4f5f8a6877563a84d4d3/users/696daa4bc56c499fabbdfda18f296b0b/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:21.751340 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154ffeb-c8a8-441a-a327-13f098fc1a83 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:21.751628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154ffeb-c8a8-441a-a327-13f098fc1a83 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:21.751901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154ffeb-c8a8-441a-a327-13f098fc1a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:21.784363 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b154ffeb-c8a8-441a-a327-13f098fc1a83 None None] MFA Rules not processed for user `696daa4bc56c499fabbdfda18f296b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:21.785609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b154ffeb-c8a8-441a-a327-13f098fc1a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:21.931562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 952/1892] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:21 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:21.948025 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf558b-8821-4725-a5ff-3f669eccb263 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:21.949975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-eddf558b-8821-4725-a5ff-3f669eccb263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:21.961600 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154ffeb-c8a8-441a-a327-13f098fc1a83 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:21.964335 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b154ffeb-c8a8-441a-a327-13f098fc1a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:22.107525 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154ffeb-c8a8-441a-a327-13f098fc1a83 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:22.114741 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5503594-166d-4d80-ad91-70ed5831e73f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:22.115450 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5503594-166d-4d80-ad91-70ed5831e73f service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.115681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5503594-166d-4d80-ad91-70ed5831e73f service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.116091 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5503594-166d-4d80-ad91-70ed5831e73f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.125392 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf558b-8821-4725-a5ff-3f669eccb263 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:22.129767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5503594-166d-4d80-ad91-70ed5831e73f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:22.131160 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94222b6d-5faf-4dd5-ba2f-9420a978e038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:22.131905 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5503594-166d-4d80-ad91-70ed5831e73f service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:22.132203 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94222b6d-5faf-4dd5-ba2f-9420a978e038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.132552 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94222b6d-5faf-4dd5-ba2f-9420a978e038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.132893 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94222b6d-5faf-4dd5-ba2f-9420a978e038 admin admin] PATH_INFO: `/v3/projects/dd9bc18f2502449fa06a518a56c4bd5c` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.134679 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94222b6d-5faf-4dd5-ba2f-9420a978e038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd9bc18f2502449fa06a518a56c4bd5c)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:22.136829 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94222b6d-5faf-4dd5-ba2f-9420a978e038 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:22.148322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 953/1893] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:21 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:28:22.149327 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5503594-166d-4d80-ad91-70ed5831e73f service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:22.150720 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f5503594-166d-4d80-ad91-70ed5831e73f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:22.166745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5503594-166d-4d80-ad91-70ed5831e73f service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:22.174439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8a160-99f6-404b-98a1-964a5f254ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:22.175446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8a160-99f6-404b-98a1-964a5f254ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.175933 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8a160-99f6-404b-98a1-964a5f254ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.176336 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8a160-99f6-404b-98a1-964a5f254ca7 admin admin] PATH_INFO: `/v3/projects/f2df6452c4924231b8b6b52773d8b62d` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.177697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8a160-99f6-404b-98a1-964a5f254ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2df6452c4924231b8b6b52773d8b62d)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:22.180687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8a160-99f6-404b-98a1-964a5f254ca7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:22.199829 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:22.207344 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-94222b6d-5faf-4dd5-ba2f-9420a978e038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd9bc18f2502449fa06a518a56c4bd5c', 'request_id': 'req-94222b6d-5faf-4dd5-ba2f-9420a978e038'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.214280 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-94222b6d-5faf-4dd5-ba2f-9420a978e038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd9bc18f2502449fa06a518a56c4bd5c', 'request_id': 'req-94222b6d-5faf-4dd5-ba2f-9420a978e038'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.221161 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-94222b6d-5faf-4dd5-ba2f-9420a978e038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd9bc18f2502449fa06a518a56c4bd5c', 'request_id': 'req-94222b6d-5faf-4dd5-ba2f-9420a978e038'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.233078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:22.250731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-94222b6d-5faf-4dd5-ba2f-9420a978e038 admin admin] The token cache is being invalidate because project dd9bc18f2502449fa06a518a56c4bd5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:22.251496 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-94222b6d-5faf-4dd5-ba2f-9420a978e038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.253454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-94222b6d-5faf-4dd5-ba2f-9420a978e038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.257424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 941/1894] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:21 2022] DELETE /identity/v3/projects/dd9bc18f2502449fa06a518a56c4bd5c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:22.265191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180295d-c262-4559-810a-3154304fd138 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.265191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180295d-c262-4559-810a-3154304fd138 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.265191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180295d-c262-4559-810a-3154304fd138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.268846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e5e8a160-99f6-404b-98a1-964a5f254ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2df6452c4924231b8b6b52773d8b62d', 'request_id': 'req-e5e8a160-99f6-404b-98a1-964a5f254ca7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.281304 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e5e8a160-99f6-404b-98a1-964a5f254ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2df6452c4924231b8b6b52773d8b62d', 'request_id': 'req-e5e8a160-99f6-404b-98a1-964a5f254ca7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.288963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e5e8a160-99f6-404b-98a1-964a5f254ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2df6452c4924231b8b6b52773d8b62d', 'request_id': 'req-e5e8a160-99f6-404b-98a1-964a5f254ca7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.290259 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b180295d-c262-4559-810a-3154304fd138 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:22.291706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b180295d-c262-4559-810a-3154304fd138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:22.305806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e5e8a160-99f6-404b-98a1-964a5f254ca7 admin admin] The token cache is being invalidate because project f2df6452c4924231b8b6b52773d8b62d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:22.306234 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e5e8a160-99f6-404b-98a1-964a5f254ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.306931 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e5e8a160-99f6-404b-98a1-964a5f254ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.311886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 954/1895] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:22 2022] DELETE /identity/v3/projects/f2df6452c4924231b8b6b52773d8b62d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:22.314245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1418b7-6732-43f6-bc2b-7de05d8e73a5 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.314727 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1418b7-6732-43f6-bc2b-7de05d8e73a5 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.315097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1418b7-6732-43f6-bc2b-7de05d8e73a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.344270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-cc1418b7-6732-43f6-bc2b-7de05d8e73a5 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:22.345871 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-cc1418b7-6732-43f6-bc2b-7de05d8e73a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:22.393719 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 942/1896] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:22.401574 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f74a7-4484-4138-b7cb-830849bd50d8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.402152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f74a7-4484-4138-b7cb-830849bd50d8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.402886 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f74a7-4484-4138-b7cb-830849bd50d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.423283 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 955/1897] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:22.431510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bee59d-38c7-425f-b5b2-9dbc1aa26ae2 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.432061 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bee59d-38c7-425f-b5b2-9dbc1aa26ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.432516 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bee59d-38c7-425f-b5b2-9dbc1aa26ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.433277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-3f3f74a7-4484-4138-b7cb-830849bd50d8 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:22.446083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3f3f74a7-4484-4138-b7cb-830849bd50d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:22.458647 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-85bee59d-38c7-425f-b5b2-9dbc1aa26ae2 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:22.459843 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-85bee59d-38c7-425f-b5b2-9dbc1aa26ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:22.467801 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 943/1898] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:22.472561 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f74a7-4484-4138-b7cb-830849bd50d8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:22.473626 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 956/1899] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:28:22.478079 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bee59d-38c7-425f-b5b2-9dbc1aa26ae2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:22.483628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f74a7-4484-4138-b7cb-830849bd50d8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:22.491623 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c55e3-da1d-4d82-80ad-b0b6ad2ed170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:22.492297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c55e3-da1d-4d82-80ad-b0b6ad2ed170 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.492583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c55e3-da1d-4d82-80ad-b0b6ad2ed170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.492858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c55e3-da1d-4d82-80ad-b0b6ad2ed170 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.493623 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c55e3-da1d-4d82-80ad-b0b6ad2ed170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:22.493934 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c55e3-da1d-4d82-80ad-b0b6ad2ed170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:22.500707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bee59d-38c7-425f-b5b2-9dbc1aa26ae2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:22.505384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc8f03-bc5f-4e98-96df-3755f52557ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:22.506114 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc8f03-bc5f-4e98-96df-3755f52557ea admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.506403 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc8f03-bc5f-4e98-96df-3755f52557ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.506673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc8f03-bc5f-4e98-96df-3755f52557ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.506937 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c55e3-da1d-4d82-80ad-b0b6ad2ed170 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:22.507748 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc8f03-bc5f-4e98-96df-3755f52557ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:22.507974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc8f03-bc5f-4e98-96df-3755f52557ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:22.509756 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc8f03-bc5f-4e98-96df-3755f52557ea admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:22.524837 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 957/1900] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:28:22.529773 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc8f03-bc5f-4e98-96df-3755f52557ea admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:22.536393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 944/1901] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:28:22.541434 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c55e3-da1d-4d82-80ad-b0b6ad2ed170 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:22.558758 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc8f03-bc5f-4e98-96df-3755f52557ea admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:22.570466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c55e3-da1d-4d82-80ad-b0b6ad2ed170 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:22.584997 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25801e65-5711-4d8a-90b0-4856f545f384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:22.585734 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25801e65-5711-4d8a-90b0-4856f545f384 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.586021 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25801e65-5711-4d8a-90b0-4856f545f384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.586301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25801e65-5711-4d8a-90b0-4856f545f384 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.587004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25801e65-5711-4d8a-90b0-4856f545f384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:22.588946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25801e65-5711-4d8a-90b0-4856f545f384 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:22.589553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc3b25-c290-41ee-8ebd-a8601a016b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:22.590226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc3b25-c290-41ee-8ebd-a8601a016b6b admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.590512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc3b25-c290-41ee-8ebd-a8601a016b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.590795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc3b25-c290-41ee-8ebd-a8601a016b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.591490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc3b25-c290-41ee-8ebd-a8601a016b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:22.593462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc3b25-c290-41ee-8ebd-a8601a016b6b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:22.632661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 958/1902] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:22 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:22.632661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25801e65-5711-4d8a-90b0-4856f545f384 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:22.650932 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 945/1903] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:22 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:22.657993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc3b25-c290-41ee-8ebd-a8601a016b6b admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:22.768048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc3b25-c290-41ee-8ebd-a8601a016b6b admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:22.769007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25801e65-5711-4d8a-90b0-4856f545f384 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:22.778282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3699672-cd30-42fa-b7a8-7779ea8bc481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:22.779018 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3699672-cd30-42fa-b7a8-7779ea8bc481 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.779397 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3699672-cd30-42fa-b7a8-7779ea8bc481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.779556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3699672-cd30-42fa-b7a8-7779ea8bc481 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.780262 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3699672-cd30-42fa-b7a8-7779ea8bc481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:22.781628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e323b3b-402a-4465-98d0-97d39a14d742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:22.782320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e323b3b-402a-4465-98d0-97d39a14d742 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.782623 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e323b3b-402a-4465-98d0-97d39a14d742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.782764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3699672-cd30-42fa-b7a8-7779ea8bc481 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:22.783000 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e323b3b-402a-4465-98d0-97d39a14d742 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.783701 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e323b3b-402a-4465-98d0-97d39a14d742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:22.785692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e323b3b-402a-4465-98d0-97d39a14d742 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:22.792870 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:22.821470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 959/1904] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:22 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:22.822346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e323b3b-402a-4465-98d0-97d39a14d742 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:22.826395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2e323b3b-402a-4465-98d0-97d39a14d742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:22.829858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 946/1905] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:22 2022] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:22.830661 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3699672-cd30-42fa-b7a8-7779ea8bc481 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:22.838339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e323b3b-402a-4465-98d0-97d39a14d742 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:22.840686 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3699672-cd30-42fa-b7a8-7779ea8bc481 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:22.843234 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d109ba-4d5c-48ac-8627-0424a24916e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:22.844608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d109ba-4d5c-48ac-8627-0424a24916e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.844885 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d109ba-4d5c-48ac-8627-0424a24916e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.845149 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d109ba-4d5c-48ac-8627-0424a24916e0 admin admin] PATH_INFO: `/v3/users/2adb22ae78584c83af5858151564c615` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.846170 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd8118-59e9-4dcb-9b5d-e6206f8abb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:22.846372 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d109ba-4d5c-48ac-8627-0424a24916e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2adb22ae78584c83af5858151564c615)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:22.846959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd8118-59e9-4dcb-9b5d-e6206f8abb6f admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.847313 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd8118-59e9-4dcb-9b5d-e6206f8abb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.847660 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd8118-59e9-4dcb-9b5d-e6206f8abb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.848280 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d109ba-4d5c-48ac-8627-0424a24916e0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:22.848502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd8118-59e9-4dcb-9b5d-e6206f8abb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:22.850224 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd8118-59e9-4dcb-9b5d-e6206f8abb6f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:22.861521 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 947/1906] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:22.865135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd8118-59e9-4dcb-9b5d-e6206f8abb6f admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:22.866903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a6bd8118-59e9-4dcb-9b5d-e6206f8abb6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:22.881042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd8118-59e9-4dcb-9b5d-e6206f8abb6f admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:22.886581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc584c6-0519-4611-9c33-5d07c09b1766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:22.887651 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc584c6-0519-4611-9c33-5d07c09b1766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.888009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc584c6-0519-4611-9c33-5d07c09b1766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.888357 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc584c6-0519-4611-9c33-5d07c09b1766 admin admin] PATH_INFO: `/v3/users/78f37522278742538efa019d802b123e` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.889704 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc584c6-0519-4611-9c33-5d07c09b1766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f37522278742538efa019d802b123e)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:22.892018 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc584c6-0519-4611-9c33-5d07c09b1766 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:22.903452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-37d109ba-4d5c-48ac-8627-0424a24916e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2adb22ae78584c83af5858151564c615'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.904395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-37d109ba-4d5c-48ac-8627-0424a24916e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2adb22ae78584c83af5858151564c615'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.921341 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-37d109ba-4d5c-48ac-8627-0424a24916e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2adb22ae78584c83af5858151564c615'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.930466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:22.936547 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-37d109ba-4d5c-48ac-8627-0424a24916e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2adb22ae78584c83af5858151564c615'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.937449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-37d109ba-4d5c-48ac-8627-0424a24916e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2adb22ae78584c83af5858151564c615'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.948958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6bc584c6-0519-4611-9c33-5d07c09b1766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f37522278742538efa019d802b123e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.949745 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6bc584c6-0519-4611-9c33-5d07c09b1766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f37522278742538efa019d802b123e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.954535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 960/1907] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:22 2022] DELETE /identity/v3/users/2adb22ae78584c83af5858151564c615 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:22.955516 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d109ba-4d5c-48ac-8627-0424a24916e0 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:22.956850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-37d109ba-4d5c-48ac-8627-0424a24916e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:22.960117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6bc584c6-0519-4611-9c33-5d07c09b1766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f37522278742538efa019d802b123e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.960868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6bc584c6-0519-4611-9c33-5d07c09b1766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f37522278742538efa019d802b123e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.969518 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6bc584c6-0519-4611-9c33-5d07c09b1766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f37522278742538efa019d802b123e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:22.997628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 948/1908] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:22 2022] DELETE /identity/v3/users/78f37522278742538efa019d802b123e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:23.011874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc584c6-0519-4611-9c33-5d07c09b1766 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:23.024041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6bc584c6-0519-4611-9c33-5d07c09b1766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:23.060908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d109ba-4d5c-48ac-8627-0424a24916e0 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:23.111731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc584c6-0519-4611-9c33-5d07c09b1766 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:23.117587 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a379c-4820-4be8-9da1-18242825a014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:23.118747 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a379c-4820-4be8-9da1-18242825a014 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:23.119243 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a379c-4820-4be8-9da1-18242825a014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:23.119601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a379c-4820-4be8-9da1-18242825a014 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:23.120552 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a379c-4820-4be8-9da1-18242825a014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:23.122967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a379c-4820-4be8-9da1-18242825a014 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:23.129990 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbf941-4aa0-43ab-b6f3-8a38ca4d4509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:23.130729 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbf941-4aa0-43ab-b6f3-8a38ca4d4509 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:23.131010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbf941-4aa0-43ab-b6f3-8a38ca4d4509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:23.139240 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbf941-4aa0-43ab-b6f3-8a38ca4d4509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:23.139240 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbf941-4aa0-43ab-b6f3-8a38ca4d4509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:23.139240 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbf941-4aa0-43ab-b6f3-8a38ca4d4509 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:23.139499 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 949/1909] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:23.139499 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab141748-fc6b-4d0c-93e9-9aeea906b685 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:23.139499 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab141748-fc6b-4d0c-93e9-9aeea906b685 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:23.139499 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab141748-fc6b-4d0c-93e9-9aeea906b685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:23.151935 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 961/1910] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:23.153312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276b2a7-e0b7-46ca-82a6-216f7f4ad8da None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:23.153637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276b2a7-e0b7-46ca-82a6-216f7f4ad8da None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:23.153937 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276b2a7-e0b7-46ca-82a6-216f7f4ad8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:23.161378 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ab141748-fc6b-4d0c-93e9-9aeea906b685 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:23.161895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:23.162618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ab141748-fc6b-4d0c-93e9-9aeea906b685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:23.171088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 950/1911] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:23.172064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab141748-fc6b-4d0c-93e9-9aeea906b685 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:23.178635 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1276b2a7-e0b7-46ca-82a6-216f7f4ad8da None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:23.179946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1276b2a7-e0b7-46ca-82a6-216f7f4ad8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:23.182373 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab141748-fc6b-4d0c-93e9-9aeea906b685 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:23.187593 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7494ec-f7cf-4e83-bc65-905a362bf2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:23.188486 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7494ec-f7cf-4e83-bc65-905a362bf2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:23.188797 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7494ec-f7cf-4e83-bc65-905a362bf2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:23.189013 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 962/1912] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:23.189115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7494ec-f7cf-4e83-bc65-905a362bf2c1 admin admin] PATH_INFO: `/v3/projects/d3f51bc03c2a4f0e8b1d835d1408ee11/users/f79222ac95ab4a69a6e7bb28b5d35e13/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:23.189856 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276b2a7-e0b7-46ca-82a6-216f7f4ad8da None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:23.191132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1276b2a7-e0b7-46ca-82a6-216f7f4ad8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:23.205025 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276b2a7-e0b7-46ca-82a6-216f7f4ad8da None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:23.210370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37606a9c-4578-4248-adde-5fff37dee499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:23.211077 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37606a9c-4578-4248-adde-5fff37dee499 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:23.211323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37606a9c-4578-4248-adde-5fff37dee499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:23.211601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37606a9c-4578-4248-adde-5fff37dee499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:23.212385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37606a9c-4578-4248-adde-5fff37dee499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:23.214157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37606a9c-4578-4248-adde-5fff37dee499 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:23.222370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7494ec-f7cf-4e83-bc65-905a362bf2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f51bc03c2a4f0e8b1d835d1408ee11, user_id=f79222ac95ab4a69a6e7bb28b5d35e13, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:23.225026 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 963/1913] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:23.225158 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7494ec-f7cf-4e83-bc65-905a362bf2c1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:23.225863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37606a9c-4578-4248-adde-5fff37dee499 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:23.227525 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-37606a9c-4578-4248-adde-5fff37dee499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:23.238470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 951/1914] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:23 2022] PUT /identity/v3/projects/d3f51bc03c2a4f0e8b1d835d1408ee11/users/f79222ac95ab4a69a6e7bb28b5d35e13/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:23.239371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7494ec-f7cf-4e83-bc65-905a362bf2c1 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:23.240956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6e7494ec-f7cf-4e83-bc65-905a362bf2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:23.295966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37606a9c-4578-4248-adde-5fff37dee499 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:23.297682 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7494ec-f7cf-4e83-bc65-905a362bf2c1 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:23.299618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e985ffa-319c-46b7-ba2d-903c4386e061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:23.300255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e985ffa-319c-46b7-ba2d-903c4386e061 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:23.300539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e985ffa-319c-46b7-ba2d-903c4386e061 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:23.300810 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e985ffa-319c-46b7-ba2d-903c4386e061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:23.301713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865514d-5096-4228-9c7d-2b893e071d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:23.302384 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865514d-5096-4228-9c7d-2b893e071d63 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:23.302668 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865514d-5096-4228-9c7d-2b893e071d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:23.302942 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865514d-5096-4228-9c7d-2b893e071d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:23.329705 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:23.361767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e985ffa-319c-46b7-ba2d-903c4386e061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:23.363241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e985ffa-319c-46b7-ba2d-903c4386e061 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:23.364875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865514d-5096-4228-9c7d-2b893e071d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:23.366556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865514d-5096-4228-9c7d-2b893e071d63 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:23.375438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 964/1915] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:23.376250 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e985ffa-319c-46b7-ba2d-903c4386e061 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:23.377557 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2e985ffa-319c-46b7-ba2d-903c4386e061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:23.378828 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 952/1916] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:23.379736 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865514d-5096-4228-9c7d-2b893e071d63 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:23.389822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865514d-5096-4228-9c7d-2b893e071d63 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:23.395903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe7bc3-1a5a-4952-875b-931136d88ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:23.397332 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe7bc3-1a5a-4952-875b-931136d88ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:23.397747 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe7bc3-1a5a-4952-875b-931136d88ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:23.398124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe7bc3-1a5a-4952-875b-931136d88ea7 admin admin] PATH_INFO: `/v3/projects/5b5b986a089a46e8930e4bd50281659f/users/4c875a0543f74c718462780d7efd5201/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:23.416759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe7bc3-1a5a-4952-875b-931136d88ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5b986a089a46e8930e4bd50281659f, user_id=4c875a0543f74c718462780d7efd5201, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:23.419805 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe7bc3-1a5a-4952-875b-931136d88ea7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:23.446675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 953/1917] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:23 2022] PUT /identity/v3/projects/5b5b986a089a46e8930e4bd50281659f/users/4c875a0543f74c718462780d7efd5201/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:23.446675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf156fb-c766-42ca-8f5a-735efb04199b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:23.446675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf156fb-c766-42ca-8f5a-735efb04199b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:23.446675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf156fb-c766-42ca-8f5a-735efb04199b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:23.454726 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e985ffa-319c-46b7-ba2d-903c4386e061 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:23.477856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-0cf156fb-c766-42ca-8f5a-735efb04199b None None] MFA Rules not processed for user `f79222ac95ab4a69a6e7bb28b5d35e13`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:23.479109 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0cf156fb-c766-42ca-8f5a-735efb04199b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:23.525200 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bff0e7-b500-4def-be20-114fc9d66e2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:23.525892 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bff0e7-b500-4def-be20-114fc9d66e2b service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:23.526937 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bff0e7-b500-4def-be20-114fc9d66e2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:23.527225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bff0e7-b500-4def-be20-114fc9d66e2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:23.530263 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-79bff0e7-b500-4def-be20-114fc9d66e2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:23.539100 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:23.552793 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 954/1918] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:23.554233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37d8f1-6e5c-46cb-afc3-b9c286109eae None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:23.554599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37d8f1-6e5c-46cb-afc3-b9c286109eae None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:23.554945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37d8f1-6e5c-46cb-afc3-b9c286109eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:23.593365 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-3b37d8f1-6e5c-46cb-afc3-b9c286109eae None None] MFA Rules not processed for user `4c875a0543f74c718462780d7efd5201`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:23.594661 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3b37d8f1-6e5c-46cb-afc3-b9c286109eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:23.626911 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bff0e7-b500-4def-be20-114fc9d66e2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:23.629513 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bff0e7-b500-4def-be20-114fc9d66e2b service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:23.644344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 965/1919] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:23.646135 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bff0e7-b500-4def-be20-114fc9d66e2b service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:23.689527 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 955/1920] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:23.693655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37d8f1-6e5c-46cb-afc3-b9c286109eae None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:23.728494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:23.760873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bff0e7-b500-4def-be20-114fc9d66e2b service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:23.767392 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdc415-fb7e-497d-bc6e-400889dff81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:23.768217 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdc415-fb7e-497d-bc6e-400889dff81c admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:23.768502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdc415-fb7e-497d-bc6e-400889dff81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:23.768775 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdc415-fb7e-497d-bc6e-400889dff81c admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:23.769843 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdc415-fb7e-497d-bc6e-400889dff81c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:23.771772 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdc415-fb7e-497d-bc6e-400889dff81c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:23.815494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 966/1921] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:23 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:23.815704 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37d8f1-6e5c-46cb-afc3-b9c286109eae None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:23.816682 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdc415-fb7e-497d-bc6e-400889dff81c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:23.899210 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdc415-fb7e-497d-bc6e-400889dff81c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:23.904632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e0faa-f729-4593-9a35-3ff084bd4f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:23.905367 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e0faa-f729-4593-9a35-3ff084bd4f06 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:23.905699 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e0faa-f729-4593-9a35-3ff084bd4f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:23.906553 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e0faa-f729-4593-9a35-3ff084bd4f06 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:23.907392 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e0faa-f729-4593-9a35-3ff084bd4f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:23.909555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e0faa-f729-4593-9a35-3ff084bd4f06 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:23.919460 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1feb9-a3bf-4040-9a8e-d00dfabf88c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:23.920390 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1feb9-a3bf-4040-9a8e-d00dfabf88c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:23.920673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1feb9-a3bf-4040-9a8e-d00dfabf88c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:23.921118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1feb9-a3bf-4040-9a8e-d00dfabf88c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:23.923255 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1feb9-a3bf-4040-9a8e-d00dfabf88c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:23.926055 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1feb9-a3bf-4040-9a8e-d00dfabf88c7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:23.949398 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 967/1922] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:23 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:23.949398 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e0faa-f729-4593-9a35-3ff084bd4f06 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:23.954359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-fa4e0faa-f729-4593-9a35-3ff084bd4f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:23.976309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 956/1923] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:23 2022] POST /identity/v3/projects => generated 379 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:28:23.977226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1feb9-a3bf-4040-9a8e-d00dfabf88c7 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:23.988996 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e0faa-f729-4593-9a35-3ff084bd4f06 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:24.041478 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:24.116130 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1feb9-a3bf-4040-9a8e-d00dfabf88c7 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:24.122414 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ce5a2-a79c-4811-82e6-1b09460b9117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:24.123194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ce5a2-a79c-4811-82e6-1b09460b9117 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:24.123626 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ce5a2-a79c-4811-82e6-1b09460b9117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:24.124044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ce5a2-a79c-4811-82e6-1b09460b9117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:24.126244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ce5a2-a79c-4811-82e6-1b09460b9117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:24.128744 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ce5a2-a79c-4811-82e6-1b09460b9117 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:24.141274 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 957/1924] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:24.142325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ce5a2-a79c-4811-82e6-1b09460b9117 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:24.149473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a68ce2-0583-4814-83f3-70dac2b6dc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:24.150486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a68ce2-0583-4814-83f3-70dac2b6dc0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:24.151401 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a68ce2-0583-4814-83f3-70dac2b6dc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:24.151401 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a68ce2-0583-4814-83f3-70dac2b6dc0a admin admin] PATH_INFO: `/v3/projects/35f0af37ce0442898cf1fc92ceb28d51` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:24.153974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a68ce2-0583-4814-83f3-70dac2b6dc0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f0af37ce0442898cf1fc92ceb28d51)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:24.155731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ce5a2-a79c-4811-82e6-1b09460b9117 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:24.156597 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a68ce2-0583-4814-83f3-70dac2b6dc0a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:24.163871 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7bdad-282c-4fd0-8c9c-97bba59e2871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:24.164738 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7bdad-282c-4fd0-8c9c-97bba59e2871 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:24.165098 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7bdad-282c-4fd0-8c9c-97bba59e2871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:24.165463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7bdad-282c-4fd0-8c9c-97bba59e2871 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:24.166375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7bdad-282c-4fd0-8c9c-97bba59e2871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:24.169637 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7bdad-282c-4fd0-8c9c-97bba59e2871 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:24.205327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 958/1925] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:24 2022] POST /identity/v3/users => generated 296 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:24.205327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7bdad-282c-4fd0-8c9c-97bba59e2871 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:24.207798 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0ce7bdad-282c-4fd0-8c9c-97bba59e2871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:24.227929 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7bdad-282c-4fd0-8c9c-97bba59e2871 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:24.261909 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e9a68ce2-0583-4814-83f3-70dac2b6dc0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f0af37ce0442898cf1fc92ceb28d51', 'request_id': 'req-e9a68ce2-0583-4814-83f3-70dac2b6dc0a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.277153 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e9a68ce2-0583-4814-83f3-70dac2b6dc0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f0af37ce0442898cf1fc92ceb28d51', 'request_id': 'req-e9a68ce2-0583-4814-83f3-70dac2b6dc0a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.283898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:24.299199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e9a68ce2-0583-4814-83f3-70dac2b6dc0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f0af37ce0442898cf1fc92ceb28d51', 'request_id': 'req-e9a68ce2-0583-4814-83f3-70dac2b6dc0a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.331015 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e9a68ce2-0583-4814-83f3-70dac2b6dc0a admin admin] The token cache is being invalidate because project 35f0af37ce0442898cf1fc92ceb28d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:24.331420 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e9a68ce2-0583-4814-83f3-70dac2b6dc0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.332307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e9a68ce2-0583-4814-83f3-70dac2b6dc0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.334628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 968/1926] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:23 2022] DELETE /identity/v3/projects/35f0af37ce0442898cf1fc92ceb28d51 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:24.335573 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a68ce2-0583-4814-83f3-70dac2b6dc0a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:24.337185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e9a68ce2-0583-4814-83f3-70dac2b6dc0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:24.339427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4941e59-dce8-4d5c-922d-84c9b1345288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:24.341228 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4941e59-dce8-4d5c-922d-84c9b1345288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:24.341725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4941e59-dce8-4d5c-922d-84c9b1345288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:24.342168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4941e59-dce8-4d5c-922d-84c9b1345288 admin admin] PATH_INFO: `/v3/projects/1901d4f88e1b4580a586fe62aba61f7e` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:24.345469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4941e59-dce8-4d5c-922d-84c9b1345288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1901d4f88e1b4580a586fe62aba61f7e)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:24.347752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4941e59-dce8-4d5c-922d-84c9b1345288 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:24.354033 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a68ce2-0583-4814-83f3-70dac2b6dc0a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:24.362324 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021321d-856f-4eae-bfe2-ded05dd157d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:24.363456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021321d-856f-4eae-bfe2-ded05dd157d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:24.364084 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021321d-856f-4eae-bfe2-ded05dd157d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:24.364464 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021321d-856f-4eae-bfe2-ded05dd157d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:24.365364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021321d-856f-4eae-bfe2-ded05dd157d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:24.367433 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021321d-856f-4eae-bfe2-ded05dd157d4 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:24.380872 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 969/1927] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:24.384854 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021321d-856f-4eae-bfe2-ded05dd157d4 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:24.386988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b021321d-856f-4eae-bfe2-ded05dd157d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:24.407635 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021321d-856f-4eae-bfe2-ded05dd157d4 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:24.424772 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e4941e59-dce8-4d5c-922d-84c9b1345288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1901d4f88e1b4580a586fe62aba61f7e', 'request_id': 'req-e4941e59-dce8-4d5c-922d-84c9b1345288'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.431264 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e4941e59-dce8-4d5c-922d-84c9b1345288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1901d4f88e1b4580a586fe62aba61f7e', 'request_id': 'req-e4941e59-dce8-4d5c-922d-84c9b1345288'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.438758 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e4941e59-dce8-4d5c-922d-84c9b1345288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1901d4f88e1b4580a586fe62aba61f7e', 'request_id': 'req-e4941e59-dce8-4d5c-922d-84c9b1345288'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.458813 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e4941e59-dce8-4d5c-922d-84c9b1345288 admin admin] The token cache is being invalidate because project 1901d4f88e1b4580a586fe62aba61f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:24.459179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e4941e59-dce8-4d5c-922d-84c9b1345288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.460051 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e4941e59-dce8-4d5c-922d-84c9b1345288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.462471 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 959/1928] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:24 2022] DELETE /identity/v3/projects/1901d4f88e1b4580a586fe62aba61f7e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:24.463464 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4941e59-dce8-4d5c-922d-84c9b1345288 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:24.470258 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e4941e59-dce8-4d5c-922d-84c9b1345288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:24.512099 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e9a62-7c56-4ede-a48b-e522a69c8546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:24.512775 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e9a62-7c56-4ede-a48b-e522a69c8546 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:24.513064 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e9a62-7c56-4ede-a48b-e522a69c8546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:24.513384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e9a62-7c56-4ede-a48b-e522a69c8546 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:24.514113 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e9a62-7c56-4ede-a48b-e522a69c8546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:24.516233 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e9a62-7c56-4ede-a48b-e522a69c8546 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:24.527346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 970/1929] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:24.528426 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e9a62-7c56-4ede-a48b-e522a69c8546 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:24.530505 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-da3e9a62-7c56-4ede-a48b-e522a69c8546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:24.543736 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e9a62-7c56-4ede-a48b-e522a69c8546 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:24.549385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d07b4-8aee-41e7-bb74-ad7a84f2c8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:24.550421 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d07b4-8aee-41e7-bb74-ad7a84f2c8d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:24.550731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d07b4-8aee-41e7-bb74-ad7a84f2c8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:24.551070 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d07b4-8aee-41e7-bb74-ad7a84f2c8d2 admin admin] PATH_INFO: `/v3/projects/e388b310cd024974b0f8e9fbd7765c20/users/96682dabf4c645918e55b1cefeaf68fd/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:24.567002 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d07b4-8aee-41e7-bb74-ad7a84f2c8d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e388b310cd024974b0f8e9fbd7765c20, user_id=96682dabf4c645918e55b1cefeaf68fd, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:24.569816 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d07b4-8aee-41e7-bb74-ad7a84f2c8d2 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:24.581085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4941e59-dce8-4d5c-922d-84c9b1345288 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:24.589016 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 971/1930] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:24 2022] PUT /identity/v3/projects/e388b310cd024974b0f8e9fbd7765c20/users/96682dabf4c645918e55b1cefeaf68fd/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:24.590125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d07b4-8aee-41e7-bb74-ad7a84f2c8d2 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:24.591823 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f57d07b4-8aee-41e7-bb74-ad7a84f2c8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:24.609950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:24.659142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c02df3-6067-4c01-ada3-1fa283d4a88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:24.660050 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c02df3-6067-4c01-ada3-1fa283d4a88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:24.660319 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c02df3-6067-4c01-ada3-1fa283d4a88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:24.660589 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c02df3-6067-4c01-ada3-1fa283d4a88c admin admin] PATH_INFO: `/v3/users/a0bbefb22aae4f16ade43e4d665703d7` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:24.664472 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c02df3-6067-4c01-ada3-1fa283d4a88c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0bbefb22aae4f16ade43e4d665703d7)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:24.666555 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c02df3-6067-4c01-ada3-1fa283d4a88c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:24.672626 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:24.679226 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d07b4-8aee-41e7-bb74-ad7a84f2c8d2 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:24.685668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41a9b6-5d42-43db-9c8b-7dce93cd7742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:24.686673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41a9b6-5d42-43db-9c8b-7dce93cd7742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:24.687072 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41a9b6-5d42-43db-9c8b-7dce93cd7742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:24.687336 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41a9b6-5d42-43db-9c8b-7dce93cd7742 admin admin] PATH_INFO: `/v3/users/696daa4bc56c499fabbdfda18f296b0b` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:24.688637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41a9b6-5d42-43db-9c8b-7dce93cd7742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=696daa4bc56c499fabbdfda18f296b0b)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:24.692021 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41a9b6-5d42-43db-9c8b-7dce93cd7742 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:24.720572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-93c02df3-6067-4c01-ada3-1fa283d4a88c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0bbefb22aae4f16ade43e4d665703d7'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.721353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-93c02df3-6067-4c01-ada3-1fa283d4a88c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0bbefb22aae4f16ade43e4d665703d7'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.730288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-93c02df3-6067-4c01-ada3-1fa283d4a88c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0bbefb22aae4f16ade43e4d665703d7'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.730961 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-93c02df3-6067-4c01-ada3-1fa283d4a88c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0bbefb22aae4f16ade43e4d665703d7'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.738851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-93c02df3-6067-4c01-ada3-1fa283d4a88c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0bbefb22aae4f16ade43e4d665703d7'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.745789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-4d41a9b6-5d42-43db-9c8b-7dce93cd7742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '696daa4bc56c499fabbdfda18f296b0b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.746694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-4d41a9b6-5d42-43db-9c8b-7dce93cd7742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '696daa4bc56c499fabbdfda18f296b0b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.756260 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 960/1931] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:24 2022] DELETE /identity/v3/users/a0bbefb22aae4f16ade43e4d665703d7 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:24.759384 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c02df3-6067-4c01-ada3-1fa283d4a88c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:24.760281 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-93c02df3-6067-4c01-ada3-1fa283d4a88c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:24.762623 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-4d41a9b6-5d42-43db-9c8b-7dce93cd7742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '696daa4bc56c499fabbdfda18f296b0b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.770782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-4d41a9b6-5d42-43db-9c8b-7dce93cd7742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '696daa4bc56c499fabbdfda18f296b0b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.771503 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-4d41a9b6-5d42-43db-9c8b-7dce93cd7742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '696daa4bc56c499fabbdfda18f296b0b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:24.790831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 972/1932] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:24 2022] DELETE /identity/v3/users/696daa4bc56c499fabbdfda18f296b0b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:24.790831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4eb141-b2e7-48b1-95eb-d9dfd394d495 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:24.790831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4eb141-b2e7-48b1-95eb-d9dfd394d495 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:24.790831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4eb141-b2e7-48b1-95eb-d9dfd394d495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:24.837895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1a4eb141-b2e7-48b1-95eb-d9dfd394d495 None None] MFA Rules not processed for user `96682dabf4c645918e55b1cefeaf68fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:24.839447 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1a4eb141-b2e7-48b1-95eb-d9dfd394d495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:24.847672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c02df3-6067-4c01-ada3-1fa283d4a88c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:24.944266 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 973/1933] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:24.949548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4eb141-b2e7-48b1-95eb-d9dfd394d495 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:24.953446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1a4eb141-b2e7-48b1-95eb-d9dfd394d495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:24.955794 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0778b-8823-4421-b66a-3e99654816cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:24.957435 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0778b-8823-4421-b66a-3e99654816cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:24.957973 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0778b-8823-4421-b66a-3e99654816cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:24.958270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0778b-8823-4421-b66a-3e99654816cb admin admin] PATH_INFO: `/v3/projects/2e4d07df454d4d7a8c548ff1836594e7/users/911caf93299248f1ba986732a79c1424/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:24.975816 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4eb141-b2e7-48b1-95eb-d9dfd394d495 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:24.981389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0778b-8823-4421-b66a-3e99654816cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e4d07df454d4d7a8c548ff1836594e7, user_id=911caf93299248f1ba986732a79c1424, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:24.984799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0778b-8823-4421-b66a-3e99654816cb admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:24.986223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f6082-823f-46cc-b002-0e700751770b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:24.987502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f6082-823f-46cc-b002-0e700751770b admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:24.987998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f6082-823f-46cc-b002-0e700751770b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:24.988977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f6082-823f-46cc-b002-0e700751770b admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:24.989923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f6082-823f-46cc-b002-0e700751770b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:24.992223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f6082-823f-46cc-b002-0e700751770b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:25.005823 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 961/1934] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:24 2022] PUT /identity/v3/projects/2e4d07df454d4d7a8c548ff1836594e7/users/911caf93299248f1ba986732a79c1424/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:25.009977 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0778b-8823-4421-b66a-3e99654816cb admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:25.019743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-18d0778b-8823-4421-b66a-3e99654816cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:25.024915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:25.036066 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 974/1935] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:24 2022] POST /identity/v3/projects => generated 379 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:25.046289 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f6082-823f-46cc-b002-0e700751770b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:25.066312 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:25.127291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0778b-8823-4421-b66a-3e99654816cb admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:25.132610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a738e-0c1b-4dcb-a066-327aca1640ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:25.133123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f6082-823f-46cc-b002-0e700751770b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:25.133506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a738e-0c1b-4dcb-a066-327aca1640ee admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:25.133845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a738e-0c1b-4dcb-a066-327aca1640ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:25.134103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a738e-0c1b-4dcb-a066-327aca1640ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:25.134831 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a738e-0c1b-4dcb-a066-327aca1640ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:25.136442 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a738e-0c1b-4dcb-a066-327aca1640ee admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:25.139498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804a702-7e30-4cf0-9d52-8cde1ebbbace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:25.140443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804a702-7e30-4cf0-9d52-8cde1ebbbace admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:25.140729 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804a702-7e30-4cf0-9d52-8cde1ebbbace admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:25.141012 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804a702-7e30-4cf0-9d52-8cde1ebbbace admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:25.141745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804a702-7e30-4cf0-9d52-8cde1ebbbace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:25.144143 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804a702-7e30-4cf0-9d52-8cde1ebbbace admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:25.147778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 962/1936] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:25.152175 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a738e-0c1b-4dcb-a066-327aca1640ee admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:25.163432 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a738e-0c1b-4dcb-a066-327aca1640ee admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:25.170188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 975/1937] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:25 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:25.171098 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40875a-b28b-43a2-8e45-cefa18ff3d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:25.171234 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804a702-7e30-4cf0-9d52-8cde1ebbbace admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:25.172702 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40875a-b28b-43a2-8e45-cefa18ff3d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:25.172991 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40875a-b28b-43a2-8e45-cefa18ff3d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:25.173294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40875a-b28b-43a2-8e45-cefa18ff3d17 admin admin] PATH_INFO: `/v3/projects/2e4d07df454d4d7a8c548ff1836594e7/users/911caf93299248f1ba986732a79c1424/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:25.175408 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40875a-b28b-43a2-8e45-cefa18ff3d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e4d07df454d4d7a8c548ff1836594e7, user_id=911caf93299248f1ba986732a79c1424, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:25.178109 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40875a-b28b-43a2-8e45-cefa18ff3d17 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:25.178234 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9804a702-7e30-4cf0-9d52-8cde1ebbbace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:25.189118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 963/1938] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:25 2022] PUT /identity/v3/projects/2e4d07df454d4d7a8c548ff1836594e7/users/911caf93299248f1ba986732a79c1424/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:25.189753 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40875a-b28b-43a2-8e45-cefa18ff3d17 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:25.204221 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804a702-7e30-4cf0-9d52-8cde1ebbbace admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:25.271416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f506f-9a6a-40a3-aade-52a7b2fcef1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:25.271575 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40875a-b28b-43a2-8e45-cefa18ff3d17 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:25.272301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f506f-9a6a-40a3-aade-52a7b2fcef1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:25.272583 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f506f-9a6a-40a3-aade-52a7b2fcef1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:25.272858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f506f-9a6a-40a3-aade-52a7b2fcef1a admin admin] PATH_INFO: `/v3/projects/ee6489822f1c4829a0457843c455b2e3` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:25.274077 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f506f-9a6a-40a3-aade-52a7b2fcef1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6489822f1c4829a0457843c455b2e3)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:25.276010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f506f-9a6a-40a3-aade-52a7b2fcef1a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:25.276787 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320e067-e02d-4135-a3d6-d0dc8b682476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:25.277586 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320e067-e02d-4135-a3d6-d0dc8b682476 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:25.277745 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320e067-e02d-4135-a3d6-d0dc8b682476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:25.278020 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320e067-e02d-4135-a3d6-d0dc8b682476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:25.278746 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320e067-e02d-4135-a3d6-d0dc8b682476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:25.280336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320e067-e02d-4135-a3d6-d0dc8b682476 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:25.295867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 964/1939] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:25.295867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68992e6-6be2-4a10-97fc-5b1862997eb5 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:25.295867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68992e6-6be2-4a10-97fc-5b1862997eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:25.295867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68992e6-6be2-4a10-97fc-5b1862997eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:25.329419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b68992e6-6be2-4a10-97fc-5b1862997eb5 None None] MFA Rules not processed for user `911caf93299248f1ba986732a79c1424`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:25.330792 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b68992e6-6be2-4a10-97fc-5b1862997eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:25.348966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ba8f506f-9a6a-40a3-aade-52a7b2fcef1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6489822f1c4829a0457843c455b2e3', 'request_id': 'req-ba8f506f-9a6a-40a3-aade-52a7b2fcef1a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:25.369318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ba8f506f-9a6a-40a3-aade-52a7b2fcef1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6489822f1c4829a0457843c455b2e3', 'request_id': 'req-ba8f506f-9a6a-40a3-aade-52a7b2fcef1a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:25.390778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ba8f506f-9a6a-40a3-aade-52a7b2fcef1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6489822f1c4829a0457843c455b2e3', 'request_id': 'req-ba8f506f-9a6a-40a3-aade-52a7b2fcef1a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:25.414002 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ba8f506f-9a6a-40a3-aade-52a7b2fcef1a admin admin] The token cache is being invalidate because project ee6489822f1c4829a0457843c455b2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:25.414557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 965/1940] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:25.414923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ba8f506f-9a6a-40a3-aade-52a7b2fcef1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:25.415426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68992e6-6be2-4a10-97fc-5b1862997eb5 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:25.416389 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ba8f506f-9a6a-40a3-aade-52a7b2fcef1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:25.416883 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b68992e6-6be2-4a10-97fc-5b1862997eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:25.420123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 976/1941] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:25 2022] DELETE /identity/v3/projects/ee6489822f1c4829a0457843c455b2e3 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:25.422382 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f506f-9a6a-40a3-aade-52a7b2fcef1a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:25.425137 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ba8f506f-9a6a-40a3-aade-52a7b2fcef1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:25.451331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:25.470339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:25.515289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68992e6-6be2-4a10-97fc-5b1862997eb5 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:25.523686 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d8062-1811-419c-8799-30df0cfba18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:25.524836 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d8062-1811-419c-8799-30df0cfba18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:25.525500 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d8062-1811-419c-8799-30df0cfba18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:25.525500 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d8062-1811-419c-8799-30df0cfba18e admin admin] PATH_INFO: `/v3/projects/920d8735f78d4f5f8a6877563a84d4d3` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:25.528340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d8062-1811-419c-8799-30df0cfba18e admin admin] RBAC: Authorizing `identity:delete_project(project_id=920d8735f78d4f5f8a6877563a84d4d3)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:25.530446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d8062-1811-419c-8799-30df0cfba18e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:25.535195 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f506f-9a6a-40a3-aade-52a7b2fcef1a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:25.542293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67f93e-7a71-4419-81b6-d154b04d9dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:25.543743 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67f93e-7a71-4419-81b6-d154b04d9dee admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:25.543743 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67f93e-7a71-4419-81b6-d154b04d9dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:25.544019 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67f93e-7a71-4419-81b6-d154b04d9dee admin admin] PATH_INFO: `/v3/projects/0f94446de5a34b80a314f100acd55bec/users/ad7558a804654441b28db81f9e9bb8e9/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:25.572320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67f93e-7a71-4419-81b6-d154b04d9dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f94446de5a34b80a314f100acd55bec, user_id=ad7558a804654441b28db81f9e9bb8e9, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:25.575084 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67f93e-7a71-4419-81b6-d154b04d9dee admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:25.593484 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 977/1942] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:25 2022] PUT /identity/v3/projects/0f94446de5a34b80a314f100acd55bec/users/ad7558a804654441b28db81f9e9bb8e9/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:25.594956 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b96ab-4bee-4a75-999b-c9e6aed1ccc1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:25.595255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b96ab-4bee-4a75-999b-c9e6aed1ccc1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:25.595535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b96ab-4bee-4a75-999b-c9e6aed1ccc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:25.616079 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a03b96ab-4bee-4a75-999b-c9e6aed1ccc1 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:25.617687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a03b96ab-4bee-4a75-999b-c9e6aed1ccc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:25.618547 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6b7d8062-1811-419c-8799-30df0cfba18e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '920d8735f78d4f5f8a6877563a84d4d3', 'request_id': 'req-6b7d8062-1811-419c-8799-30df0cfba18e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:25.627700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6b7d8062-1811-419c-8799-30df0cfba18e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '920d8735f78d4f5f8a6877563a84d4d3', 'request_id': 'req-6b7d8062-1811-419c-8799-30df0cfba18e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:25.635998 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6b7d8062-1811-419c-8799-30df0cfba18e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '920d8735f78d4f5f8a6877563a84d4d3', 'request_id': 'req-6b7d8062-1811-419c-8799-30df0cfba18e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:25.653406 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6b7d8062-1811-419c-8799-30df0cfba18e admin admin] The token cache is being invalidate because project 920d8735f78d4f5f8a6877563a84d4d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:25.653918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6b7d8062-1811-419c-8799-30df0cfba18e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:25.654462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6b7d8062-1811-419c-8799-30df0cfba18e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:25.660879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 966/1943] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:25 2022] DELETE /identity/v3/projects/920d8735f78d4f5f8a6877563a84d4d3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:25.660879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d8062-1811-419c-8799-30df0cfba18e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:25.660879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6b7d8062-1811-419c-8799-30df0cfba18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:25.714653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 978/1944] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:25.715698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b96ab-4bee-4a75-999b-c9e6aed1ccc1 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:25.717381 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a03b96ab-4bee-4a75-999b-c9e6aed1ccc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:25.732212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b96ab-4bee-4a75-999b-c9e6aed1ccc1 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:25.737339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3b3b8-e7c6-455e-b8ab-b9a9ae95a43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:25.738100 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3b3b8-e7c6-455e-b8ab-b9a9ae95a43f admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:25.738539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3b3b8-e7c6-455e-b8ab-b9a9ae95a43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:25.738890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3b3b8-e7c6-455e-b8ab-b9a9ae95a43f admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:25.739688 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3b3b8-e7c6-455e-b8ab-b9a9ae95a43f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:25.741496 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3b3b8-e7c6-455e-b8ab-b9a9ae95a43f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:25.757908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 979/1945] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:25.760135 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e4c2f-9f51-4b25-9d20-c233cce6773a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:25.760768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e4c2f-9f51-4b25-9d20-c233cce6773a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:25.761620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e4c2f-9f51-4b25-9d20-c233cce6773a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:25.769321 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d8062-1811-419c-8799-30df0cfba18e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:25.781352 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c633ea-7cb2-41d0-a36a-15e1e28db667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:25.782235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c633ea-7cb2-41d0-a36a-15e1e28db667 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:25.782699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c633ea-7cb2-41d0-a36a-15e1e28db667 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:25.782929 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f60e4c2f-9f51-4b25-9d20-c233cce6773a None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:25.783616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c633ea-7cb2-41d0-a36a-15e1e28db667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:25.784271 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f60e4c2f-9f51-4b25-9d20-c233cce6773a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:25.787765 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-16c633ea-7cb2-41d0-a36a-15e1e28db667 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:25.800931 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 980/1946] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:25.802642 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38849032-1a28-495e-b81b-c1ae4c92a5ab None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:25.803466 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38849032-1a28-495e-b81b-c1ae4c92a5ab None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:25.803466 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38849032-1a28-495e-b81b-c1ae4c92a5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:25.851090 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-38849032-1a28-495e-b81b-c1ae4c92a5ab None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:25.852314 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-38849032-1a28-495e-b81b-c1ae4c92a5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:25.870882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 981/1947] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:25.871698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38849032-1a28-495e-b81b-c1ae4c92a5ab None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:25.914894 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38849032-1a28-495e-b81b-c1ae4c92a5ab None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:25.934605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a30c3e-fcdb-415e-9c1c-079f60dc9011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:25.935533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a30c3e-fcdb-415e-9c1c-079f60dc9011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:25.935817 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a30c3e-fcdb-415e-9c1c-079f60dc9011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:25.936094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a30c3e-fcdb-415e-9c1c-079f60dc9011 admin admin] PATH_INFO: `/v3/projects/0f94446de5a34b80a314f100acd55bec/users/ad7558a804654441b28db81f9e9bb8e9/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:25.941659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a30c3e-fcdb-415e-9c1c-079f60dc9011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f94446de5a34b80a314f100acd55bec, user_id=ad7558a804654441b28db81f9e9bb8e9, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:25.944613 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a30c3e-fcdb-415e-9c1c-079f60dc9011 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:25.984598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 982/1948] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:25 2022] PUT /identity/v3/projects/0f94446de5a34b80a314f100acd55bec/users/ad7558a804654441b28db81f9e9bb8e9/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:25.986099 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c51f5-4bbd-4469-9dd8-438e88a6342f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:25.986784 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c51f5-4bbd-4469-9dd8-438e88a6342f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:25.987074 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c51f5-4bbd-4469-9dd8-438e88a6342f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:25.987415 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c633ea-7cb2-41d0-a36a-15e1e28db667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:25.990855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c633ea-7cb2-41d0-a36a-15e1e28db667 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:26.001329 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:26.017077 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 967/1949] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:26.017578 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c633ea-7cb2-41d0-a36a-15e1e28db667 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:26.051172 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c633ea-7cb2-41d0-a36a-15e1e28db667 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:26.060895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-0d5c51f5-4bbd-4469-9dd8-438e88a6342f None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:26.062218 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0d5c51f5-4bbd-4469-9dd8-438e88a6342f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:26.146247 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49056b74-03d1-48e5-b2d5-5b3db20de3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:26.146999 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49056b74-03d1-48e5-b2d5-5b3db20de3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:26.147241 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49056b74-03d1-48e5-b2d5-5b3db20de3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:26.147806 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49056b74-03d1-48e5-b2d5-5b3db20de3b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:26.148528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49056b74-03d1-48e5-b2d5-5b3db20de3b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:26.148824 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49056b74-03d1-48e5-b2d5-5b3db20de3b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:26.151008 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49056b74-03d1-48e5-b2d5-5b3db20de3b6 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:26.169004 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 968/1950] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:28:26.170476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada48809-7c94-42ce-b1b0-31bec5eb8a43 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:26.170771 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada48809-7c94-42ce-b1b0-31bec5eb8a43 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:26.171077 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada48809-7c94-42ce-b1b0-31bec5eb8a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:26.203492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ada48809-7c94-42ce-b1b0-31bec5eb8a43 None None] MFA Rules not processed for user `ad7558a804654441b28db81f9e9bb8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:26.204778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ada48809-7c94-42ce-b1b0-31bec5eb8a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:26.227710 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 983/1951] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:26.228553 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c51f5-4bbd-4469-9dd8-438e88a6342f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:26.255087 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c51f5-4bbd-4469-9dd8-438e88a6342f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:26.268465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c376d5-0dc4-4ca6-a46d-ab686718c022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:26.269521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c376d5-0dc4-4ca6-a46d-ab686718c022 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:26.269980 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c376d5-0dc4-4ca6-a46d-ab686718c022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:26.271310 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c376d5-0dc4-4ca6-a46d-ab686718c022 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:26.272323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c376d5-0dc4-4ca6-a46d-ab686718c022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:26.287633 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c376d5-0dc4-4ca6-a46d-ab686718c022 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:26.293681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:26.321471 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 969/1952] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:26.323061 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada48809-7c94-42ce-b1b0-31bec5eb8a43 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:26.329557 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 984/1953] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:26 2022] POST /identity/v3/projects => generated 407 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:26.334303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c376d5-0dc4-4ca6-a46d-ab686718c022 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:26.341236 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada48809-7c94-42ce-b1b0-31bec5eb8a43 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:26.412999 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718fb82-bc61-4b3d-97cd-7aedcffe76e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:26.413705 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c376d5-0dc4-4ca6-a46d-ab686718c022 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:26.413975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718fb82-bc61-4b3d-97cd-7aedcffe76e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:26.414332 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718fb82-bc61-4b3d-97cd-7aedcffe76e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:26.414680 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718fb82-bc61-4b3d-97cd-7aedcffe76e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:26.415611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718fb82-bc61-4b3d-97cd-7aedcffe76e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:26.416030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718fb82-bc61-4b3d-97cd-7aedcffe76e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:26.417719 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718fb82-bc61-4b3d-97cd-7aedcffe76e1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:26.419522 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130f25d-1fe1-40b1-b7c3-2fc1bad4e072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:26.420182 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130f25d-1fe1-40b1-b7c3-2fc1bad4e072 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:26.420472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130f25d-1fe1-40b1-b7c3-2fc1bad4e072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:26.420745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130f25d-1fe1-40b1-b7c3-2fc1bad4e072 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:26.421493 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130f25d-1fe1-40b1-b7c3-2fc1bad4e072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:26.423506 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130f25d-1fe1-40b1-b7c3-2fc1bad4e072 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:26.430830 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 970/1954] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:28:26.431643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718fb82-bc61-4b3d-97cd-7aedcffe76e1 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:26.451713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:26.463940 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 985/1955] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:26 2022] POST /identity/v3/users => generated 304 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:26.463940 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130f25d-1fe1-40b1-b7c3-2fc1bad4e072 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:26.486659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130f25d-1fe1-40b1-b7c3-2fc1bad4e072 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:26.493563 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32d0f-cd77-4251-8c02-387d4edd6afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:26.494668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32d0f-cd77-4251-8c02-387d4edd6afb admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:26.495215 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32d0f-cd77-4251-8c02-387d4edd6afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:26.495472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32d0f-cd77-4251-8c02-387d4edd6afb admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:26.500901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf32d0f-cd77-4251-8c02-387d4edd6afb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:26.500901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf32d0f-cd77-4251-8c02-387d4edd6afb admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:26.510505 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718fb82-bc61-4b3d-97cd-7aedcffe76e1 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:26.514242 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d0b19-400d-48ce-9178-1c9e9e52a7f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:26.515804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0b19-400d-48ce-9178-1c9e9e52a7f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:26.515804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0b19-400d-48ce-9178-1c9e9e52a7f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:26.516073 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0b19-400d-48ce-9178-1c9e9e52a7f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:26.536469 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 986/1956] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:26 2022] POST /identity/v3/projects => generated 357 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:26.536469 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32d0f-cd77-4251-8c02-387d4edd6afb admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:26.598002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d0b19-400d-48ce-9178-1c9e9e52a7f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:26.599585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d0b19-400d-48ce-9178-1c9e9e52a7f3 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:26.622741 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 971/1957] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:26.623294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d0b19-400d-48ce-9178-1c9e9e52a7f3 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:26.626681 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b31d0b19-400d-48ce-9178-1c9e9e52a7f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:26.628363 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32d0f-cd77-4251-8c02-387d4edd6afb admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:26.633659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbb10c-bc62-4cf6-881b-b729a069482b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:26.634501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbb10c-bc62-4cf6-881b-b729a069482b admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:26.634708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbb10c-bc62-4cf6-881b-b729a069482b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:26.634993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbb10c-bc62-4cf6-881b-b729a069482b admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:26.635733 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbb10c-bc62-4cf6-881b-b729a069482b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:26.637515 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbb10c-bc62-4cf6-881b-b729a069482b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:26.654070 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 987/1958] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:26.654977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbb10c-bc62-4cf6-881b-b729a069482b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:26.666641 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbb10c-bc62-4cf6-881b-b729a069482b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:26.676014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d0b19-400d-48ce-9178-1c9e9e52a7f3 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:26.681772 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e815b-8ca1-4d3d-ba73-a7351d17fe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:26.682777 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e815b-8ca1-4d3d-ba73-a7351d17fe9b admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:26.683341 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e815b-8ca1-4d3d-ba73-a7351d17fe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:26.683850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e815b-8ca1-4d3d-ba73-a7351d17fe9b admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:26.684796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e815b-8ca1-4d3d-ba73-a7351d17fe9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:26.687967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e815b-8ca1-4d3d-ba73-a7351d17fe9b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:26.690718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d5dc4-077a-44ea-bb3a-6daaf7840bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:26.691614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d5dc4-077a-44ea-bb3a-6daaf7840bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:26.693114 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d5dc4-077a-44ea-bb3a-6daaf7840bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:26.693114 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d5dc4-077a-44ea-bb3a-6daaf7840bb1 admin admin] PATH_INFO: `/v3/users/bfb138d4208f459f81492b06b2f033dd` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:26.693442 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d5dc4-077a-44ea-bb3a-6daaf7840bb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfb138d4208f459f81492b06b2f033dd)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:26.695380 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d5dc4-077a-44ea-bb3a-6daaf7840bb1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:26.727699 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 988/1959] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:26 2022] POST /identity/v3/users => generated 279 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:26.729071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e815b-8ca1-4d3d-ba73-a7351d17fe9b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:26.747143 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e815b-8ca1-4d3d-ba73-a7351d17fe9b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:26.756548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fbb34-feca-45ab-b0cd-a462069b5d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:26.757309 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fbb34-feca-45ab-b0cd-a462069b5d57 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:26.757604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fbb34-feca-45ab-b0cd-a462069b5d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:26.757890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fbb34-feca-45ab-b0cd-a462069b5d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:26.758627 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fbb34-feca-45ab-b0cd-a462069b5d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:26.760517 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fbb34-feca-45ab-b0cd-a462069b5d57 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:26.792320 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6b9d5dc4-077a-44ea-bb3a-6daaf7840bb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfb138d4208f459f81492b06b2f033dd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:26.797597 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 989/1960] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:26.798812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6b9d5dc4-077a-44ea-bb3a-6daaf7840bb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfb138d4208f459f81492b06b2f033dd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:26.799246 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fbb34-feca-45ab-b0cd-a462069b5d57 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:26.804769 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-de7fbb34-feca-45ab-b0cd-a462069b5d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:26.814219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6b9d5dc4-077a-44ea-bb3a-6daaf7840bb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfb138d4208f459f81492b06b2f033dd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:26.814968 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6b9d5dc4-077a-44ea-bb3a-6daaf7840bb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfb138d4208f459f81492b06b2f033dd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:26.836846 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6b9d5dc4-077a-44ea-bb3a-6daaf7840bb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfb138d4208f459f81492b06b2f033dd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:26.860896 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:26.869615 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 972/1961] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:26 2022] DELETE /identity/v3/users/bfb138d4208f459f81492b06b2f033dd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:26.870785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d5dc4-077a-44ea-bb3a-6daaf7840bb1 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:26.876037 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6b9d5dc4-077a-44ea-bb3a-6daaf7840bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:26.924893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fbb34-feca-45ab-b0cd-a462069b5d57 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:26.948371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:26.994266 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0097b-491e-43dd-82b9-1f76257d8588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:26.994878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d5dc4-077a-44ea-bb3a-6daaf7840bb1 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:26.995789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0097b-491e-43dd-82b9-1f76257d8588 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:26.996075 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0097b-491e-43dd-82b9-1f76257d8588 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:26.996499 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0097b-491e-43dd-82b9-1f76257d8588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:26.998891 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-daa0097b-491e-43dd-82b9-1f76257d8588 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:27.000180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83ef41-6559-48b4-9f4a-4832eead0d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:27.000859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83ef41-6559-48b4-9f4a-4832eead0d57 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:27.001283 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83ef41-6559-48b4-9f4a-4832eead0d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:27.001580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83ef41-6559-48b4-9f4a-4832eead0d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:27.002416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83ef41-6559-48b4-9f4a-4832eead0d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:27.004017 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83ef41-6559-48b4-9f4a-4832eead0d57 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:27.018316 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 973/1962] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:27.022463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83ef41-6559-48b4-9f4a-4832eead0d57 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:27.024598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5c83ef41-6559-48b4-9f4a-4832eead0d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:27.040755 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83ef41-6559-48b4-9f4a-4832eead0d57 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:27.046492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021d1d8-9e5e-4d89-a006-43939f6b5d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:27.047315 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021d1d8-9e5e-4d89-a006-43939f6b5d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:27.047885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021d1d8-9e5e-4d89-a006-43939f6b5d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:27.047885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021d1d8-9e5e-4d89-a006-43939f6b5d21 admin admin] PATH_INFO: `/v3/projects/db91b7a988b645b592eb6e6401c44dd6/users/5b58335a12ed420791872316d9b2782e/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:27.064784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021d1d8-9e5e-4d89-a006-43939f6b5d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db91b7a988b645b592eb6e6401c44dd6, user_id=5b58335a12ed420791872316d9b2782e, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:27.067673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021d1d8-9e5e-4d89-a006-43939f6b5d21 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:27.071245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0097b-491e-43dd-82b9-1f76257d8588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:27.072830 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0097b-491e-43dd-82b9-1f76257d8588 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:27.086041 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 990/1963] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:27.086618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 974/1964] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:27 2022] PUT /identity/v3/projects/db91b7a988b645b592eb6e6401c44dd6/users/5b58335a12ed420791872316d9b2782e/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:27.086895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0097b-491e-43dd-82b9-1f76257d8588 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:27.088334 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-daa0097b-491e-43dd-82b9-1f76257d8588 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:27.098238 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0be90-8676-4a27-93bf-f46e5f60dfcc None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:27.098535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0be90-8676-4a27-93bf-f46e5f60dfcc None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:27.098824 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0be90-8676-4a27-93bf-f46e5f60dfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:27.103800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0097b-491e-43dd-82b9-1f76257d8588 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:27.119495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c5e0be90-8676-4a27-93bf-f46e5f60dfcc None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:27.120884 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c5e0be90-8676-4a27-93bf-f46e5f60dfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:27.188786 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290b697-e18f-4493-a06a-21007d2b3106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:27.190756 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290b697-e18f-4493-a06a-21007d2b3106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:27.191263 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290b697-e18f-4493-a06a-21007d2b3106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:27.191851 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290b697-e18f-4493-a06a-21007d2b3106 admin admin] PATH_INFO: `/v3/users/4c875a0543f74c718462780d7efd5201` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:27.194662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290b697-e18f-4493-a06a-21007d2b3106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c875a0543f74c718462780d7efd5201)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:27.198555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290b697-e18f-4493-a06a-21007d2b3106 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:27.215829 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 975/1965] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:27.217556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0be90-8676-4a27-93bf-f46e5f60dfcc None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:27.228564 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0be90-8676-4a27-93bf-f46e5f60dfcc None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:27.234335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b51f0-eb33-4c37-87b5-fe599aa1caee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:27.235305 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b51f0-eb33-4c37-87b5-fe599aa1caee admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:27.235828 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b51f0-eb33-4c37-87b5-fe599aa1caee admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:27.236657 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b51f0-eb33-4c37-87b5-fe599aa1caee admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:27.238083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b51f0-eb33-4c37-87b5-fe599aa1caee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:27.239829 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b51f0-eb33-4c37-87b5-fe599aa1caee admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:27.259227 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 976/1966] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:27.260394 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a5d51-f244-4fd8-b096-d8dcc9e2645a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:27.261794 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a5d51-f244-4fd8-b096-d8dcc9e2645a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:27.262346 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a5d51-f244-4fd8-b096-d8dcc9e2645a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:27.270025 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:27.287913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d290b697-e18f-4493-a06a-21007d2b3106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c875a0543f74c718462780d7efd5201'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:27.288607 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d290b697-e18f-4493-a06a-21007d2b3106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c875a0543f74c718462780d7efd5201'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:27.302310 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d290b697-e18f-4493-a06a-21007d2b3106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c875a0543f74c718462780d7efd5201'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:27.308931 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-424a5d51-f244-4fd8-b096-d8dcc9e2645a None None] MFA Rules not processed for user `5b58335a12ed420791872316d9b2782e`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:27.310348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-424a5d51-f244-4fd8-b096-d8dcc9e2645a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:27.314026 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d290b697-e18f-4493-a06a-21007d2b3106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c875a0543f74c718462780d7efd5201'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:27.315000 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d290b697-e18f-4493-a06a-21007d2b3106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c875a0543f74c718462780d7efd5201'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:27.333001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 991/1967] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:27 2022] DELETE /identity/v3/users/4c875a0543f74c718462780d7efd5201 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:27.334072 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290b697-e18f-4493-a06a-21007d2b3106 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:27.336047 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d290b697-e18f-4493-a06a-21007d2b3106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:27.395688 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 977/1968] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:27.396737 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a5d51-f244-4fd8-b096-d8dcc9e2645a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:27.398049 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-424a5d51-f244-4fd8-b096-d8dcc9e2645a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:27.404964 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290b697-e18f-4493-a06a-21007d2b3106 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:27.409896 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8632edc-e195-44a2-b321-4f5113e592ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:27.410555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632edc-e195-44a2-b321-4f5113e592ff service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:27.410842 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632edc-e195-44a2-b321-4f5113e592ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:27.411119 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632edc-e195-44a2-b321-4f5113e592ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:27.412693 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a5d51-f244-4fd8-b096-d8dcc9e2645a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:27.413892 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e8632edc-e195-44a2-b321-4f5113e592ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:27.441471 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:27.503467 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b623956-8c02-458b-8f8e-4518213f83b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:27.504768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b623956-8c02-458b-8f8e-4518213f83b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:27.505556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b623956-8c02-458b-8f8e-4518213f83b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:27.506279 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b623956-8c02-458b-8f8e-4518213f83b7 admin admin] PATH_INFO: `/v3/projects/cf158029cacb409caf388cebb771b067/users/e250af22fd024a8d9d2ae3a18c2d5f67/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:27.522931 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b623956-8c02-458b-8f8e-4518213f83b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf158029cacb409caf388cebb771b067, user_id=e250af22fd024a8d9d2ae3a18c2d5f67, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:27.525822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b623956-8c02-458b-8f8e-4518213f83b7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:27.539239 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8632edc-e195-44a2-b321-4f5113e592ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:27.540874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8632edc-e195-44a2-b321-4f5113e592ff service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:27.542335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 978/1969] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:27 2022] PUT /identity/v3/projects/cf158029cacb409caf388cebb771b067/users/e250af22fd024a8d9d2ae3a18c2d5f67/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:27.543629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1a1aa-d26b-44c3-9651-a597afcf1e4e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:27.543980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1a1aa-d26b-44c3-9651-a597afcf1e4e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:27.544376 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1a1aa-d26b-44c3-9651-a597afcf1e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:27.564220 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1bf1a1aa-d26b-44c3-9651-a597afcf1e4e None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:27.565871 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1bf1a1aa-d26b-44c3-9651-a597afcf1e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:27.568863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 992/1970] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:27.569930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8632edc-e195-44a2-b321-4f5113e592ff service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:27.572178 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e8632edc-e195-44a2-b321-4f5113e592ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:27.590851 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8632edc-e195-44a2-b321-4f5113e592ff service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:27.654141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd9a3f-d010-4c3c-9e3f-8aa9995015de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:27.654508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 979/1971] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:27.655966 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1ccfb-c52c-4965-9d0a-6a6569441073 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:27.656263 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1ccfb-c52c-4965-9d0a-6a6569441073 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:27.656670 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1ccfb-c52c-4965-9d0a-6a6569441073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:27.658661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd9a3f-d010-4c3c-9e3f-8aa9995015de admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:27.658661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd9a3f-d010-4c3c-9e3f-8aa9995015de admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:27.658881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd9a3f-d010-4c3c-9e3f-8aa9995015de admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:27.659514 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd9a3f-d010-4c3c-9e3f-8aa9995015de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:27.661489 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd9a3f-d010-4c3c-9e3f-8aa9995015de admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:27.665284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:27.690587 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-79d1ccfb-c52c-4965-9d0a-6a6569441073 None None] MFA Rules not processed for user `e250af22fd024a8d9d2ae3a18c2d5f67`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:27.692233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-79d1ccfb-c52c-4965-9d0a-6a6569441073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:27.695030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 993/1972] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:27 2022] POST /identity/v3/projects => generated 407 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:27.695931 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd9a3f-d010-4c3c-9e3f-8aa9995015de admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:27.699208 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6bbd9a3f-d010-4c3c-9e3f-8aa9995015de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:27.770603 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd9a3f-d010-4c3c-9e3f-8aa9995015de admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:27.776977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11a9be-2fb1-45e6-97ba-c5faa33d4800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:27.777787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11a9be-2fb1-45e6-97ba-c5faa33d4800 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:27.778268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11a9be-2fb1-45e6-97ba-c5faa33d4800 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:27.778619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11a9be-2fb1-45e6-97ba-c5faa33d4800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:27.792781 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 980/1973] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:27 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:27.794141 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1ccfb-c52c-4965-9d0a-6a6569441073 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:27.853027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:27.911839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1ccfb-c52c-4965-9d0a-6a6569441073 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:27.930498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11a9be-2fb1-45e6-97ba-c5faa33d4800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:27.931442 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae850421-23bb-4726-ae98-adef9148775e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:27.931795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae850421-23bb-4726-ae98-adef9148775e admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:27.932076 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae850421-23bb-4726-ae98-adef9148775e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:27.932294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11a9be-2fb1-45e6-97ba-c5faa33d4800 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:27.932387 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae850421-23bb-4726-ae98-adef9148775e admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:27.933038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae850421-23bb-4726-ae98-adef9148775e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:27.935079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae850421-23bb-4726-ae98-adef9148775e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:27.951949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 994/1974] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:27.955265 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11a9be-2fb1-45e6-97ba-c5faa33d4800 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:27.983203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11a9be-2fb1-45e6-97ba-c5faa33d4800 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:27.996664 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f74cfc-3a05-422f-8344-54a4c168e450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:27.997654 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f74cfc-3a05-422f-8344-54a4c168e450 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:28.000704 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 981/1975] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:27 2022] POST /identity/v3/users => generated 310 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:28.000704 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae850421-23bb-4726-ae98-adef9148775e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:28.002082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f74cfc-3a05-422f-8344-54a4c168e450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:28.002555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f74cfc-3a05-422f-8344-54a4c168e450 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:28.002727 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ae850421-23bb-4726-ae98-adef9148775e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:28.003599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f74cfc-3a05-422f-8344-54a4c168e450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:28.009455 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f74cfc-3a05-422f-8344-54a4c168e450 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:28.022219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae850421-23bb-4726-ae98-adef9148775e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:28.029859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f646d0-17a8-4948-ab1a-a158fa781969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:28.032611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f646d0-17a8-4948-ab1a-a158fa781969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:28.033008 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f646d0-17a8-4948-ab1a-a158fa781969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:28.033405 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f646d0-17a8-4948-ab1a-a158fa781969 admin admin] PATH_INFO: `/v3/projects/bae80cd2aac7417fa2e3dc2ce152b812` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:28.034849 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f646d0-17a8-4948-ab1a-a158fa781969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bae80cd2aac7417fa2e3dc2ce152b812)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:28.037885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f646d0-17a8-4948-ab1a-a158fa781969 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:28.065081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 995/1976] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:27 2022] POST /identity/v3/projects => generated 357 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:28.065081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f74cfc-3a05-422f-8344-54a4c168e450 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:28.122853 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-04f646d0-17a8-4948-ab1a-a158fa781969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bae80cd2aac7417fa2e3dc2ce152b812', 'request_id': 'req-04f646d0-17a8-4948-ab1a-a158fa781969'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:28.132011 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-04f646d0-17a8-4948-ab1a-a158fa781969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bae80cd2aac7417fa2e3dc2ce152b812', 'request_id': 'req-04f646d0-17a8-4948-ab1a-a158fa781969'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:28.142012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-04f646d0-17a8-4948-ab1a-a158fa781969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bae80cd2aac7417fa2e3dc2ce152b812', 'request_id': 'req-04f646d0-17a8-4948-ab1a-a158fa781969'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:28.151674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f74cfc-3a05-422f-8344-54a4c168e450 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:28.165835 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-04f646d0-17a8-4948-ab1a-a158fa781969 admin admin] The token cache is being invalidate because project bae80cd2aac7417fa2e3dc2ce152b812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:28.166201 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-04f646d0-17a8-4948-ab1a-a158fa781969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:28.167282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-04f646d0-17a8-4948-ab1a-a158fa781969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:28.173072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 982/1977] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:27 2022] DELETE /identity/v3/projects/bae80cd2aac7417fa2e3dc2ce152b812 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:28.173072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f646d0-17a8-4948-ab1a-a158fa781969 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:28.175321 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-04f646d0-17a8-4948-ab1a-a158fa781969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:28.192110 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:28.284619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f646d0-17a8-4948-ab1a-a158fa781969 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:28.284931 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deefbec-9cc4-4603-9947-a711a8dcd712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:28.286441 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deefbec-9cc4-4603-9947-a711a8dcd712 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:28.287857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deefbec-9cc4-4603-9947-a711a8dcd712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:28.288150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deefbec-9cc4-4603-9947-a711a8dcd712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:28.288900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deefbec-9cc4-4603-9947-a711a8dcd712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:28.290229 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c11b7c-b928-4114-90f3-741b3b992df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:28.294014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deefbec-9cc4-4603-9947-a711a8dcd712 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:28.306712 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c11b7c-b928-4114-90f3-741b3b992df7 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:28.307983 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c11b7c-b928-4114-90f3-741b3b992df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:28.308272 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c11b7c-b928-4114-90f3-741b3b992df7 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:28.309034 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c11b7c-b928-4114-90f3-741b3b992df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:28.311898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c11b7c-b928-4114-90f3-741b3b992df7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:28.315221 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 996/1978] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:28.320260 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deefbec-9cc4-4603-9947-a711a8dcd712 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:28.323381 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2deefbec-9cc4-4603-9947-a711a8dcd712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:28.340755 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 983/1979] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:28 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:28.341804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c11b7c-b928-4114-90f3-741b3b992df7 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:28.345315 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-56c11b7c-b928-4114-90f3-741b3b992df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:28.354533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deefbec-9cc4-4603-9947-a711a8dcd712 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:28.360648 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd2a07-f03f-4bee-a506-993396f4b96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:28.362158 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd2a07-f03f-4bee-a506-993396f4b96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:28.362889 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c11b7c-b928-4114-90f3-741b3b992df7 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:28.363061 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd2a07-f03f-4bee-a506-993396f4b96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:28.363324 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd2a07-f03f-4bee-a506-993396f4b96a admin admin] PATH_INFO: `/v3/users/2d16c01e92ff4226b2ecbdfdab9b937e` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:28.364844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd2a07-f03f-4bee-a506-993396f4b96a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d16c01e92ff4226b2ecbdfdab9b937e)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:28.367038 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd2a07-f03f-4bee-a506-993396f4b96a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:28.370231 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2b141-8b8f-4c1c-a28d-a854e829bb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:28.371528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2b141-8b8f-4c1c-a28d-a854e829bb14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:28.371809 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2b141-8b8f-4c1c-a28d-a854e829bb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:28.372083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2b141-8b8f-4c1c-a28d-a854e829bb14 admin admin] PATH_INFO: `/v3/projects/d7bb683b74c7406d807147d19024b4c6/users/7dfd2fdeec4a459fb296dffbb20b083a/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:28.396843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2b141-8b8f-4c1c-a28d-a854e829bb14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7bb683b74c7406d807147d19024b4c6, user_id=7dfd2fdeec4a459fb296dffbb20b083a, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:28.402258 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2b141-8b8f-4c1c-a28d-a854e829bb14 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:28.423072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 984/1980] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:28 2022] PUT /identity/v3/projects/d7bb683b74c7406d807147d19024b4c6/users/7dfd2fdeec4a459fb296dffbb20b083a/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:28.424429 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2b141-8b8f-4c1c-a28d-a854e829bb14 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:28.437331 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0fcd2a07-f03f-4bee-a506-993396f4b96a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d16c01e92ff4226b2ecbdfdab9b937e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:28.438174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0fcd2a07-f03f-4bee-a506-993396f4b96a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d16c01e92ff4226b2ecbdfdab9b937e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:28.456490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0fcd2a07-f03f-4bee-a506-993396f4b96a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d16c01e92ff4226b2ecbdfdab9b937e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:28.457921 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=85,keystone:INSERT=8,keystone:DELETE=7 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:28.470784 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0fcd2a07-f03f-4bee-a506-993396f4b96a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d16c01e92ff4226b2ecbdfdab9b937e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:28.471604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0fcd2a07-f03f-4bee-a506-993396f4b96a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d16c01e92ff4226b2ecbdfdab9b937e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:28.515728 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 997/1981] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:28 2022] DELETE /identity/v3/users/2d16c01e92ff4226b2ecbdfdab9b937e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:28.516990 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd2a07-f03f-4bee-a506-993396f4b96a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:28.525901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0fcd2a07-f03f-4bee-a506-993396f4b96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:28.538205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2b141-8b8f-4c1c-a28d-a854e829bb14 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:28.639239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d113914-ffe1-41e0-adf4-b3b25fbfd214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:28.640713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d113914-ffe1-41e0-adf4-b3b25fbfd214 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:28.641065 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d113914-ffe1-41e0-adf4-b3b25fbfd214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:28.641519 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d113914-ffe1-41e0-adf4-b3b25fbfd214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:28.643445 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d113914-ffe1-41e0-adf4-b3b25fbfd214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:28.647085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d113914-ffe1-41e0-adf4-b3b25fbfd214 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:28.665448 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 985/1982] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:28.666419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d113914-ffe1-41e0-adf4-b3b25fbfd214 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:28.670751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8d113914-ffe1-41e0-adf4-b3b25fbfd214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:28.685412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd2a07-f03f-4bee-a506-993396f4b96a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:28.687909 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d113914-ffe1-41e0-adf4-b3b25fbfd214 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:28.696567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3233a9d-93e8-4413-b634-1654681010ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:28.697493 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3233a9d-93e8-4413-b634-1654681010ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:28.697781 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3233a9d-93e8-4413-b634-1654681010ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:28.698109 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3233a9d-93e8-4413-b634-1654681010ab admin admin] PATH_INFO: `/v3/projects/5b5b986a089a46e8930e4bd50281659f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:28.699417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3233a9d-93e8-4413-b634-1654681010ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b5b986a089a46e8930e4bd50281659f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:28.700713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f6bfc-e333-4cef-b4ee-79613191ee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:28.701779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3233a9d-93e8-4413-b634-1654681010ab admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:28.702330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f6bfc-e333-4cef-b4ee-79613191ee00 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:28.704528 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f6bfc-e333-4cef-b4ee-79613191ee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:28.705028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f6bfc-e333-4cef-b4ee-79613191ee00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:28.706117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f6bfc-e333-4cef-b4ee-79613191ee00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:28.708600 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f6bfc-e333-4cef-b4ee-79613191ee00 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:28.722096 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 998/1983] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:28.723667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f6bfc-e333-4cef-b4ee-79613191ee00 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:28.727206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b81f6bfc-e333-4cef-b4ee-79613191ee00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:28.754994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f6bfc-e333-4cef-b4ee-79613191ee00 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:28.763196 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae135b0-bdcb-4acf-b749-163885dabe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:28.764741 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae135b0-bdcb-4acf-b749-163885dabe43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:28.765999 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae135b0-bdcb-4acf-b749-163885dabe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:28.766777 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae135b0-bdcb-4acf-b749-163885dabe43 admin admin] PATH_INFO: `/v3/projects/0e52476f36d94e7fa2453febae1b4328/users/74642fddc4c84d9ab82762e412729bf3/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:28.793812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f3233a9d-93e8-4413-b634-1654681010ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b5b986a089a46e8930e4bd50281659f', 'request_id': 'req-f3233a9d-93e8-4413-b634-1654681010ab'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:28.797917 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae135b0-bdcb-4acf-b749-163885dabe43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e52476f36d94e7fa2453febae1b4328, user_id=74642fddc4c84d9ab82762e412729bf3, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:28.800496 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f3233a9d-93e8-4413-b634-1654681010ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b5b986a089a46e8930e4bd50281659f', 'request_id': 'req-f3233a9d-93e8-4413-b634-1654681010ab'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:28.801081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae135b0-bdcb-4acf-b749-163885dabe43 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:28.808401 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f3233a9d-93e8-4413-b634-1654681010ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b5b986a089a46e8930e4bd50281659f', 'request_id': 'req-f3233a9d-93e8-4413-b634-1654681010ab'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:28.815879 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:28.824461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 999/1984] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:28 2022] PUT /identity/v3/projects/0e52476f36d94e7fa2453febae1b4328/users/74642fddc4c84d9ab82762e412729bf3/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:28.825911 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae135b0-bdcb-4acf-b749-163885dabe43 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:28.835218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f3233a9d-93e8-4413-b634-1654681010ab admin admin] The token cache is being invalidate because project 5b5b986a089a46e8930e4bd50281659f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:28.835794 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f3233a9d-93e8-4413-b634-1654681010ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:28.836756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f3233a9d-93e8-4413-b634-1654681010ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:28.841903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 986/1985] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:28 2022] DELETE /identity/v3/projects/5b5b986a089a46e8930e4bd50281659f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:28.845105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a78a6-0c3c-4272-a1ff-d9a0577011a7 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:28.846172 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a78a6-0c3c-4272-a1ff-d9a0577011a7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:28.858037 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a78a6-0c3c-4272-a1ff-d9a0577011a7 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:28.861516 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 987/1986] 10.222.0.57 () {54 vars in 921 bytes} [Tue Jul 12 18:28:28 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:28:28.864549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a78a6-0c3c-4272-a1ff-d9a0577011a7 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:28.870214 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b27a78a6-0c3c-4272-a1ff-d9a0577011a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:28.941194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae135b0-bdcb-4acf-b749-163885dabe43 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:28.948864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e9a46-17f5-4fba-a6bb-6eeb05edadd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:28.951070 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e9a46-17f5-4fba-a6bb-6eeb05edadd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:28.951070 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e9a46-17f5-4fba-a6bb-6eeb05edadd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:28.951070 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e9a46-17f5-4fba-a6bb-6eeb05edadd5 admin admin] PATH_INFO: `/v3/projects/d7bb683b74c7406d807147d19024b4c6/users/7dfd2fdeec4a459fb296dffbb20b083a/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:28.954571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e9a46-17f5-4fba-a6bb-6eeb05edadd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7bb683b74c7406d807147d19024b4c6, user_id=7dfd2fdeec4a459fb296dffbb20b083a, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:28.957242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e9a46-17f5-4fba-a6bb-6eeb05edadd5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:28.971684 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:28.978004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1000/1987] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:28 2022] PUT /identity/v3/projects/d7bb683b74c7406d807147d19024b4c6/users/7dfd2fdeec4a459fb296dffbb20b083a/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:28.980256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e9a46-17f5-4fba-a6bb-6eeb05edadd5 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:28.990136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7b6e9a46-17f5-4fba-a6bb-6eeb05edadd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:29.022517 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a78a6-0c3c-4272-a1ff-d9a0577011a7 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:29.098365 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e9a46-17f5-4fba-a6bb-6eeb05edadd5 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:29.105441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f681ea-8206-4ce7-9e5f-5613453a2923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:29.106127 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f681ea-8206-4ce7-9e5f-5613453a2923 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:29.106416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f681ea-8206-4ce7-9e5f-5613453a2923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:29.106976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f681ea-8206-4ce7-9e5f-5613453a2923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:29.107425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f681ea-8206-4ce7-9e5f-5613453a2923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:29.109903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f681ea-8206-4ce7-9e5f-5613453a2923 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:29.117411 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12bfcc-c5d5-481e-a73a-d7b5de9809e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:29.118913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12bfcc-c5d5-481e-a73a-d7b5de9809e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:29.119219 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12bfcc-c5d5-481e-a73a-d7b5de9809e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:29.119573 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12bfcc-c5d5-481e-a73a-d7b5de9809e9 admin admin] PATH_INFO: `/v3/users/911caf93299248f1ba986732a79c1424` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:29.121536 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12bfcc-c5d5-481e-a73a-d7b5de9809e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=911caf93299248f1ba986732a79c1424)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:29.123687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12bfcc-c5d5-481e-a73a-d7b5de9809e9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:29.128209 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 988/1988] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:29.130016 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e2d96-2de3-460d-96ed-c21d76a23ac2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:29.130016 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e2d96-2de3-460d-96ed-c21d76a23ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:29.130237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e2d96-2de3-460d-96ed-c21d76a23ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:29.153165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-714e2d96-2de3-460d-96ed-c21d76a23ac2 None None] MFA Rules not processed for user `a7c1bb51c2b642ffa4708122d826fc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:29.154437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-714e2d96-2de3-460d-96ed-c21d76a23ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:29.226536 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2f12bfcc-c5d5-481e-a73a-d7b5de9809e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '911caf93299248f1ba986732a79c1424'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:29.228103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2f12bfcc-c5d5-481e-a73a-d7b5de9809e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '911caf93299248f1ba986732a79c1424'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:29.258838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2f12bfcc-c5d5-481e-a73a-d7b5de9809e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '911caf93299248f1ba986732a79c1424'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:29.259649 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 989/1989] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Jul 12 18:28:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:29.261167 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0728d62-14d0-4749-a717-7be3a9762797 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:29.261601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0728d62-14d0-4749-a717-7be3a9762797 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:29.261902 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0728d62-14d0-4749-a717-7be3a9762797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:29.273751 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2f12bfcc-c5d5-481e-a73a-d7b5de9809e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '911caf93299248f1ba986732a79c1424'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:29.274819 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2f12bfcc-c5d5-481e-a73a-d7b5de9809e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '911caf93299248f1ba986732a79c1424'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:29.294017 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1001/1990] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:28 2022] DELETE /identity/v3/users/911caf93299248f1ba986732a79c1424 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:29.295690 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12bfcc-c5d5-481e-a73a-d7b5de9809e9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:29.310211 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b0728d62-14d0-4749-a717-7be3a9762797 None None] MFA Rules not processed for user `7dfd2fdeec4a459fb296dffbb20b083a`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:29.310875 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2f12bfcc-c5d5-481e-a73a-d7b5de9809e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:29.311624 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b0728d62-14d0-4749-a717-7be3a9762797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:29.347825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:29.449301 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 990/1991] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:29 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:29.449301 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0728d62-14d0-4749-a717-7be3a9762797 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:29.449824 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b0728d62-14d0-4749-a717-7be3a9762797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:29.472843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:29.473282 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12bfcc-c5d5-481e-a73a-d7b5de9809e9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:29.481692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc20fe-57c1-4334-9c05-ad872fd61b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:29.483635 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc20fe-57c1-4334-9c05-ad872fd61b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:29.484977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc20fe-57c1-4334-9c05-ad872fd61b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:29.485469 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc20fe-57c1-4334-9c05-ad872fd61b93 admin admin] PATH_INFO: `/v3/projects/eb8dff91836a41b0868653ab571634a9` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:29.486960 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc20fe-57c1-4334-9c05-ad872fd61b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb8dff91836a41b0868653ab571634a9)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:29.492198 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc20fe-57c1-4334-9c05-ad872fd61b93 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:29.564150 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0728d62-14d0-4749-a717-7be3a9762797 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:29.568220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-04bc20fe-57c1-4334-9c05-ad872fd61b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb8dff91836a41b0868653ab571634a9', 'request_id': 'req-04bc20fe-57c1-4334-9c05-ad872fd61b93'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:29.586756 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-04bc20fe-57c1-4334-9c05-ad872fd61b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb8dff91836a41b0868653ab571634a9', 'request_id': 'req-04bc20fe-57c1-4334-9c05-ad872fd61b93'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:29.608518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-04bc20fe-57c1-4334-9c05-ad872fd61b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb8dff91836a41b0868653ab571634a9', 'request_id': 'req-04bc20fe-57c1-4334-9c05-ad872fd61b93'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:29.625226 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-04bc20fe-57c1-4334-9c05-ad872fd61b93 admin admin] The token cache is being invalidate because project eb8dff91836a41b0868653ab571634a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:29.626220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-04bc20fe-57c1-4334-9c05-ad872fd61b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:29.629593 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-04bc20fe-57c1-4334-9c05-ad872fd61b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:29.632594 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1002/1992] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:29 2022] DELETE /identity/v3/projects/eb8dff91836a41b0868653ab571634a9 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:29.633433 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc20fe-57c1-4334-9c05-ad872fd61b93 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:29.635039 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-04bc20fe-57c1-4334-9c05-ad872fd61b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:29.649926 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd99a3-244e-47ed-bf61-80d001299222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:29.651240 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd99a3-244e-47ed-bf61-80d001299222 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:29.651740 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd99a3-244e-47ed-bf61-80d001299222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:29.652271 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd99a3-244e-47ed-bf61-80d001299222 admin admin] PATH_INFO: `/v3/projects/0e52476f36d94e7fa2453febae1b4328/users/74642fddc4c84d9ab82762e412729bf3/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:29.654561 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd99a3-244e-47ed-bf61-80d001299222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e52476f36d94e7fa2453febae1b4328, user_id=74642fddc4c84d9ab82762e412729bf3, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:29.658328 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd99a3-244e-47ed-bf61-80d001299222 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:29.670599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 991/1993] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:29 2022] PUT /identity/v3/projects/0e52476f36d94e7fa2453febae1b4328/users/74642fddc4c84d9ab82762e412729bf3/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:29.672013 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd99a3-244e-47ed-bf61-80d001299222 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:29.673659 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-03cd99a3-244e-47ed-bf61-80d001299222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:29.747941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc20fe-57c1-4334-9c05-ad872fd61b93 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:29.760759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd99a3-244e-47ed-bf61-80d001299222 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:29.767014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a355f-04a7-49d9-8ec6-975ab6d98a55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:29.767885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a355f-04a7-49d9-8ec6-975ab6d98a55 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:29.774175 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a355f-04a7-49d9-8ec6-975ab6d98a55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:29.775553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a355f-04a7-49d9-8ec6-975ab6d98a55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:29.779429 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7a4a355f-04a7-49d9-8ec6-975ab6d98a55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:29.806180 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:29.834740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0d9ef-202a-4b37-946f-a1182f66d967 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:29.835405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0d9ef-202a-4b37-946f-a1182f66d967 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:29.835688 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0d9ef-202a-4b37-946f-a1182f66d967 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:29.835970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0d9ef-202a-4b37-946f-a1182f66d967 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:29.837811 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f7f0d9ef-202a-4b37-946f-a1182f66d967 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:29.850502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0d9ef-202a-4b37-946f-a1182f66d967 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:29.851471 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:29.852032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0d9ef-202a-4b37-946f-a1182f66d967 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:29.853932 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a355f-04a7-49d9-8ec6-975ab6d98a55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:29.855757 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a355f-04a7-49d9-8ec6-975ab6d98a55 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:29.863314 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1003/1994] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:29.864377 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0d9ef-202a-4b37-946f-a1182f66d967 service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:29.865893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f7f0d9ef-202a-4b37-946f-a1182f66d967 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:29.866935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 992/1995] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:29 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:29.868304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b3a2e-3d0d-43e0-82e0-41a3fd4a48a8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:29.869054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b3a2e-3d0d-43e0-82e0-41a3fd4a48a8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:29.869054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b3a2e-3d0d-43e0-82e0-41a3fd4a48a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:29.907969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8a0b3a2e-3d0d-43e0-82e0-41a3fd4a48a8 None None] MFA Rules not processed for user `74642fddc4c84d9ab82762e412729bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:29.909181 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8a0b3a2e-3d0d-43e0-82e0-41a3fd4a48a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:29.940103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0d9ef-202a-4b37-946f-a1182f66d967 service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:29.944803 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce2041-c0b3-44b0-aeb0-47348281f045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:29.945714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce2041-c0b3-44b0-aeb0-47348281f045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:29.946152 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce2041-c0b3-44b0-aeb0-47348281f045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:29.946437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce2041-c0b3-44b0-aeb0-47348281f045 admin admin] PATH_INFO: `/v3/users/c5b2d039545e43bfb78641c2fb2b3ac5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:29.947665 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce2041-c0b3-44b0-aeb0-47348281f045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b2d039545e43bfb78641c2fb2b3ac5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:29.950810 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce2041-c0b3-44b0-aeb0-47348281f045 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:30.004122 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 993/1996] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:29 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:30.004969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b3a2e-3d0d-43e0-82e0-41a3fd4a48a8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:30.006638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8a0b3a2e-3d0d-43e0-82e0-41a3fd4a48a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:30.009575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-90ce2041-c0b3-44b0-aeb0-47348281f045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b2d039545e43bfb78641c2fb2b3ac5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:30.010946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-90ce2041-c0b3-44b0-aeb0-47348281f045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b2d039545e43bfb78641c2fb2b3ac5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:30.027244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b3a2e-3d0d-43e0-82e0-41a3fd4a48a8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:30.028361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-90ce2041-c0b3-44b0-aeb0-47348281f045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b2d039545e43bfb78641c2fb2b3ac5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:30.033072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7bb49-656a-48ac-824a-7933da756bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:30.034051 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7bb49-656a-48ac-824a-7933da756bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:30.034326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7bb49-656a-48ac-824a-7933da756bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:30.034604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7bb49-656a-48ac-824a-7933da756bb2 admin admin] PATH_INFO: `/v3/projects/2e4d07df454d4d7a8c548ff1836594e7` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:30.035862 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7bb49-656a-48ac-824a-7933da756bb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e4d07df454d4d7a8c548ff1836594e7)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:30.037915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7bb49-656a-48ac-824a-7933da756bb2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:30.038700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-90ce2041-c0b3-44b0-aeb0-47348281f045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b2d039545e43bfb78641c2fb2b3ac5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:30.039480 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-90ce2041-c0b3-44b0-aeb0-47348281f045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b2d039545e43bfb78641c2fb2b3ac5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:30.054247 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1004/1997] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:29 2022] DELETE /identity/v3/users/c5b2d039545e43bfb78641c2fb2b3ac5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:30.055339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce2041-c0b3-44b0-aeb0-47348281f045 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:30.068428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-90ce2041-c0b3-44b0-aeb0-47348281f045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:30.100241 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f7e7bb49-656a-48ac-824a-7933da756bb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e4d07df454d4d7a8c548ff1836594e7', 'request_id': 'req-f7e7bb49-656a-48ac-824a-7933da756bb2'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:30.107739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f7e7bb49-656a-48ac-824a-7933da756bb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e4d07df454d4d7a8c548ff1836594e7', 'request_id': 'req-f7e7bb49-656a-48ac-824a-7933da756bb2'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:30.116607 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f7e7bb49-656a-48ac-824a-7933da756bb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e4d07df454d4d7a8c548ff1836594e7', 'request_id': 'req-f7e7bb49-656a-48ac-824a-7933da756bb2'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:30.135808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f7e7bb49-656a-48ac-824a-7933da756bb2 admin admin] The token cache is being invalidate because project 2e4d07df454d4d7a8c548ff1836594e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:30.136379 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f7e7bb49-656a-48ac-824a-7933da756bb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:30.137919 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f7e7bb49-656a-48ac-824a-7933da756bb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:30.157312 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 994/1998] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:30 2022] DELETE /identity/v3/projects/2e4d07df454d4d7a8c548ff1836594e7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:30.157312 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7bb49-656a-48ac-824a-7933da756bb2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:30.157312 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f7e7bb49-656a-48ac-824a-7933da756bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:30.164507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:30.173848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce2041-c0b3-44b0-aeb0-47348281f045 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:30.248713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d69eb-cc07-4b6d-ada1-422732ac2dc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:30.248713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d69eb-cc07-4b6d-ada1-422732ac2dc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:30.248713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d69eb-cc07-4b6d-ada1-422732ac2dc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:30.248713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d69eb-cc07-4b6d-ada1-422732ac2dc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:30.251598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b61d69eb-cc07-4b6d-ada1-422732ac2dc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:30.282898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7bb49-656a-48ac-824a-7933da756bb2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:30.289024 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7bfa9-e4b3-4506-ae3d-1ad0e9ca7373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:30.290292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7bfa9-e4b3-4506-ae3d-1ad0e9ca7373 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:30.290911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7bfa9-e4b3-4506-ae3d-1ad0e9ca7373 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:30.291433 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7bfa9-e4b3-4506-ae3d-1ad0e9ca7373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:30.294005 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-16d7bfa9-e4b3-4506-ae3d-1ad0e9ca7373 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:30.321917 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:30.351724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d69eb-cc07-4b6d-ada1-422732ac2dc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:30.353193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d69eb-cc07-4b6d-ada1-422732ac2dc3 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:30.365871 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1005/1999] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:30 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:30.368100 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf522da-fc69-44bc-87b2-fefd69cebfce None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:30.368691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf522da-fc69-44bc-87b2-fefd69cebfce None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:30.369013 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf522da-fc69-44bc-87b2-fefd69cebfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:30.394035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ccf522da-fc69-44bc-87b2-fefd69cebfce None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:30.396652 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ccf522da-fc69-44bc-87b2-fefd69cebfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:30.404859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7bfa9-e4b3-4506-ae3d-1ad0e9ca7373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:30.413798 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7bfa9-e4b3-4506-ae3d-1ad0e9ca7373 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:30.444074 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 995/2000] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:30 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:30.445509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7bfa9-e4b3-4506-ae3d-1ad0e9ca7373 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:30.448018 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-16d7bfa9-e4b3-4506-ae3d-1ad0e9ca7373 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:30.547286 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1006/2001] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:30.553224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342115e9-10c1-45a6-94ce-0522157bf052 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:30.554014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342115e9-10c1-45a6-94ce-0522157bf052 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:30.554014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342115e9-10c1-45a6-94ce-0522157bf052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:30.598931 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-342115e9-10c1-45a6-94ce-0522157bf052 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:30.600142 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-342115e9-10c1-45a6-94ce-0522157bf052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:30.629999 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1007/2002] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:30.633491 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342115e9-10c1-45a6-94ce-0522157bf052 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:30.637061 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-342115e9-10c1-45a6-94ce-0522157bf052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:30.676524 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342115e9-10c1-45a6-94ce-0522157bf052 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:30.686221 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef375d-7504-4b21-9f85-1660d7750633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:30.688147 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef375d-7504-4b21-9f85-1660d7750633 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:30.688486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef375d-7504-4b21-9f85-1660d7750633 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:30.694479 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7bfa9-e4b3-4506-ae3d-1ad0e9ca7373 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:30.697753 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef375d-7504-4b21-9f85-1660d7750633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:30.699825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-16ef375d-7504-4b21-9f85-1660d7750633 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:30.704420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93c71a-4bf9-465c-8fc3-71c9750334e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:30.705430 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93c71a-4bf9-465c-8fc3-71c9750334e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:30.705803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93c71a-4bf9-465c-8fc3-71c9750334e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:30.706067 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93c71a-4bf9-465c-8fc3-71c9750334e5 admin admin] PATH_INFO: `/v3/projects/1f4872094ec74c668b3f41e85aa40133` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:30.707321 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93c71a-4bf9-465c-8fc3-71c9750334e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4872094ec74c668b3f41e85aa40133)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:30.713166 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93c71a-4bf9-465c-8fc3-71c9750334e5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:30.782101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ba93c71a-4bf9-465c-8fc3-71c9750334e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4872094ec74c668b3f41e85aa40133', 'request_id': 'req-ba93c71a-4bf9-465c-8fc3-71c9750334e5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:30.788292 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:30.805024 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ba93c71a-4bf9-465c-8fc3-71c9750334e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4872094ec74c668b3f41e85aa40133', 'request_id': 'req-ba93c71a-4bf9-465c-8fc3-71c9750334e5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:30.813761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef375d-7504-4b21-9f85-1660d7750633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:30.817146 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef375d-7504-4b21-9f85-1660d7750633 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:30.833525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ba93c71a-4bf9-465c-8fc3-71c9750334e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4872094ec74c668b3f41e85aa40133', 'request_id': 'req-ba93c71a-4bf9-465c-8fc3-71c9750334e5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:30.836719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1008/2003] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:30 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:30.838663 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef375d-7504-4b21-9f85-1660d7750633 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:30.862769 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef375d-7504-4b21-9f85-1660d7750633 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:30.873457 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ba93c71a-4bf9-465c-8fc3-71c9750334e5 admin admin] The token cache is being invalidate because project 1f4872094ec74c668b3f41e85aa40133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:30.873640 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ba93c71a-4bf9-465c-8fc3-71c9750334e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:30.875405 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ba93c71a-4bf9-465c-8fc3-71c9750334e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:30.878292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 996/2004] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:30 2022] DELETE /identity/v3/projects/1f4872094ec74c668b3f41e85aa40133 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:30.885982 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13a1a9-28eb-424d-9f45-f92b6be7fad4 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:30.885982 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13a1a9-28eb-424d-9f45-f92b6be7fad4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:30.888278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13a1a9-28eb-424d-9f45-f92b6be7fad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:30.955241 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4e13a1a9-28eb-424d-9f45-f92b6be7fad4 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:30.959062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4e13a1a9-28eb-424d-9f45-f92b6be7fad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:30.993650 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15413c8a-6a73-447d-bafc-367ec15309be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:30.994665 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15413c8a-6a73-447d-bafc-367ec15309be admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:30.995013 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15413c8a-6a73-447d-bafc-367ec15309be admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:30.995304 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15413c8a-6a73-447d-bafc-367ec15309be admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:30.996194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15413c8a-6a73-447d-bafc-367ec15309be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:30.996576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15413c8a-6a73-447d-bafc-367ec15309be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:31.001302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15413c8a-6a73-447d-bafc-367ec15309be admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:31.019398 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1009/2005] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:28:31.031428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15413c8a-6a73-447d-bafc-367ec15309be admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:31.042768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-15413c8a-6a73-447d-bafc-367ec15309be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:31.060263 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15413c8a-6a73-447d-bafc-367ec15309be admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:31.073546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413d908-44d7-4006-a543-8007515c0414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:31.073546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413d908-44d7-4006-a543-8007515c0414 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:31.073546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413d908-44d7-4006-a543-8007515c0414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:31.073546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413d908-44d7-4006-a543-8007515c0414 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:31.074664 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413d908-44d7-4006-a543-8007515c0414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:31.078472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413d908-44d7-4006-a543-8007515c0414 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:31.089441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:31.132135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 997/2006] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:31.133530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13a1a9-28eb-424d-9f45-f92b6be7fad4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:31.136491 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4e13a1a9-28eb-424d-9f45-f92b6be7fad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:31.159179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1010/2007] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:31 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:28:31.160651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d6f9b-e356-4a0f-b659-5f5dda2b54b8 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:31.161003 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d6f9b-e356-4a0f-b659-5f5dda2b54b8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:31.161387 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d6f9b-e356-4a0f-b659-5f5dda2b54b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:31.173863 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13a1a9-28eb-424d-9f45-f92b6be7fad4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:31.214074 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-486d6f9b-e356-4a0f-b659-5f5dda2b54b8 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:31.215446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-486d6f9b-e356-4a0f-b659-5f5dda2b54b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:31.266665 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc862ca-0f64-4468-bcf9-11871cece61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:31.267702 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc862ca-0f64-4468-bcf9-11871cece61d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:31.267884 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc862ca-0f64-4468-bcf9-11871cece61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:31.268158 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc862ca-0f64-4468-bcf9-11871cece61d admin admin] PATH_INFO: `/v3/users/f79222ac95ab4a69a6e7bb28b5d35e13` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:31.269436 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc862ca-0f64-4468-bcf9-11871cece61d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f79222ac95ab4a69a6e7bb28b5d35e13)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:31.271435 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc862ca-0f64-4468-bcf9-11871cece61d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:31.313005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1011/2008] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:31.314054 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d6f9b-e356-4a0f-b659-5f5dda2b54b8 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:31.324738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d6f9b-e356-4a0f-b659-5f5dda2b54b8 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:31.329962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4bc862ca-0f64-4468-bcf9-11871cece61d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f79222ac95ab4a69a6e7bb28b5d35e13'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:31.330180 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e6276-9eac-4846-80fa-df6542473946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:31.330677 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4bc862ca-0f64-4468-bcf9-11871cece61d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f79222ac95ab4a69a6e7bb28b5d35e13'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:31.330842 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e6276-9eac-4846-80fa-df6542473946 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:31.331128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e6276-9eac-4846-80fa-df6542473946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:31.331406 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e6276-9eac-4846-80fa-df6542473946 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:31.332098 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e6276-9eac-4846-80fa-df6542473946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:31.334096 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e6276-9eac-4846-80fa-df6542473946 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:31.338482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4bc862ca-0f64-4468-bcf9-11871cece61d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f79222ac95ab4a69a6e7bb28b5d35e13'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:31.339113 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4bc862ca-0f64-4468-bcf9-11871cece61d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f79222ac95ab4a69a6e7bb28b5d35e13'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:31.348028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4bc862ca-0f64-4468-bcf9-11871cece61d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f79222ac95ab4a69a6e7bb28b5d35e13'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:31.354463 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1012/2009] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:31 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:31.354463 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e6276-9eac-4846-80fa-df6542473946 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:31.354463 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4b7e6276-9eac-4846-80fa-df6542473946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:31.370512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e6276-9eac-4846-80fa-df6542473946 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:31.372818 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 998/2010] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:31 2022] DELETE /identity/v3/users/f79222ac95ab4a69a6e7bb28b5d35e13 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:31.373618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc862ca-0f64-4468-bcf9-11871cece61d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:31.374964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4bc862ca-0f64-4468-bcf9-11871cece61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:31.412500 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:31.432848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832d2f5-4363-428f-a506-4ae86e5ebd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:31.433552 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832d2f5-4363-428f-a506-4ae86e5ebd1f admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:31.433837 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832d2f5-4363-428f-a506-4ae86e5ebd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:31.434115 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832d2f5-4363-428f-a506-4ae86e5ebd1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:31.434844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832d2f5-4363-428f-a506-4ae86e5ebd1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:31.435152 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832d2f5-4363-428f-a506-4ae86e5ebd1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:31.436769 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832d2f5-4363-428f-a506-4ae86e5ebd1f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:31.440980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc862ca-0f64-4468-bcf9-11871cece61d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:31.445881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9111239-ddfc-4ef4-bca8-7b0084c0cc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:31.446555 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9111239-ddfc-4ef4-bca8-7b0084c0cc2a admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:31.446837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9111239-ddfc-4ef4-bca8-7b0084c0cc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:31.447113 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9111239-ddfc-4ef4-bca8-7b0084c0cc2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:31.447841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9111239-ddfc-4ef4-bca8-7b0084c0cc2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:31.448600 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1013/2011] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:28:31.449881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe550cc-93f4-41bc-a230-baabd27e07db None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:31.450174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe550cc-93f4-41bc-a230-baabd27e07db None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:31.450710 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe550cc-93f4-41bc-a230-baabd27e07db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:31.453713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9111239-ddfc-4ef4-bca8-7b0084c0cc2a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:31.466868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 999/2012] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:31.466868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9111239-ddfc-4ef4-bca8-7b0084c0cc2a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:31.469041 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ebe550cc-93f4-41bc-a230-baabd27e07db None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:31.470339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ebe550cc-93f4-41bc-a230-baabd27e07db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:31.471773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:31.475643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9111239-ddfc-4ef4-bca8-7b0084c0cc2a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:31.479298 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1014/2013] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:31.480185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe550cc-93f4-41bc-a230-baabd27e07db None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:31.487993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ceabc2-6227-4c1d-b4f2-dee075793bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:31.488876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceabc2-6227-4c1d-b4f2-dee075793bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:31.489170 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceabc2-6227-4c1d-b4f2-dee075793bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:31.489604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceabc2-6227-4c1d-b4f2-dee075793bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:31.490410 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ceabc2-6227-4c1d-b4f2-dee075793bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:31.490529 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe550cc-93f4-41bc-a230-baabd27e07db None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:31.492397 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ceabc2-6227-4c1d-b4f2-dee075793bf7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:31.495103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131d1bf-4e7e-4c97-9472-a324a1179981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:31.495756 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131d1bf-4e7e-4c97-9472-a324a1179981 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:31.496040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131d1bf-4e7e-4c97-9472-a324a1179981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:31.496318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131d1bf-4e7e-4c97-9472-a324a1179981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:31.497049 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131d1bf-4e7e-4c97-9472-a324a1179981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:31.498681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131d1bf-4e7e-4c97-9472-a324a1179981 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:31.509018 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1015/2014] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:31.509883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131d1bf-4e7e-4c97-9472-a324a1179981 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:31.513741 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a131d1bf-4e7e-4c97-9472-a324a1179981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:31.520154 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1000/2015] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:31 2022] POST /identity/v3/projects => generated 401 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:31.520839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ceabc2-6227-4c1d-b4f2-dee075793bf7 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:31.574814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131d1bf-4e7e-4c97-9472-a324a1179981 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:31.589027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ceabc2-6227-4c1d-b4f2-dee075793bf7 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:31.594771 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6acbc7-f75f-44d5-a2a9-653436034bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:31.595666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6acbc7-f75f-44d5-a2a9-653436034bce admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:31.595953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6acbc7-f75f-44d5-a2a9-653436034bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:31.596229 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6acbc7-f75f-44d5-a2a9-653436034bce admin admin] PATH_INFO: `/v3/projects/5b70c86eac7b4ed4b3f21eec7bac45c6/users/23e3105e456c4265b7a6617ecfb5da34/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:31.611646 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6acbc7-f75f-44d5-a2a9-653436034bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b70c86eac7b4ed4b3f21eec7bac45c6, user_id=23e3105e456c4265b7a6617ecfb5da34, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:31.614348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6acbc7-f75f-44d5-a2a9-653436034bce admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:31.625625 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd195c13-24b4-48e6-8931-e888ef32fdbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:31.626277 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd195c13-24b4-48e6-8931-e888ef32fdbd service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:31.626561 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd195c13-24b4-48e6-8931-e888ef32fdbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:31.626835 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd195c13-24b4-48e6-8931-e888ef32fdbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:31.628583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1001/2016] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:31 2022] PUT /identity/v3/projects/5b70c86eac7b4ed4b3f21eec7bac45c6/users/23e3105e456c4265b7a6617ecfb5da34/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:31.638486 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6acbc7-f75f-44d5-a2a9-653436034bce admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:31.638632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd195c13-24b4-48e6-8931-e888ef32fdbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:31.638632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd195c13-24b4-48e6-8931-e888ef32fdbd service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:31.648191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1016/2017] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:31.649465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4010d6-7ec1-46c6-aa33-f513014d68c1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:31.649763 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4010d6-7ec1-46c6-aa33-f513014d68c1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:31.650035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4010d6-7ec1-46c6-aa33-f513014d68c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:31.680272 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1a4010d6-7ec1-46c6-aa33-f513014d68c1 None None] MFA Rules not processed for user `23e3105e456c4265b7a6617ecfb5da34`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:31.681584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1a4010d6-7ec1-46c6-aa33-f513014d68c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:31.708762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6acbc7-f75f-44d5-a2a9-653436034bce admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:31.714425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5504b-760f-420b-9046-9e4be23c548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:31.715174 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5504b-760f-420b-9046-9e4be23c548a admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:31.715540 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5504b-760f-420b-9046-9e4be23c548a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:31.715897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5504b-760f-420b-9046-9e4be23c548a admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:31.716731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5504b-760f-420b-9046-9e4be23c548a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:31.719042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5504b-760f-420b-9046-9e4be23c548a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:31.746262 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1002/2018] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:31 2022] POST /identity/v3/users => generated 301 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:31.750678 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5504b-760f-420b-9046-9e4be23c548a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:31.761228 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5504b-760f-420b-9046-9e4be23c548a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:31.768015 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bc416-5f84-476f-9c44-c25db5210906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:31.768835 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bc416-5f84-476f-9c44-c25db5210906 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:31.769097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bc416-5f84-476f-9c44-c25db5210906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:31.769437 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bc416-5f84-476f-9c44-c25db5210906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:31.770350 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bc416-5f84-476f-9c44-c25db5210906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:31.771955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bc416-5f84-476f-9c44-c25db5210906 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:31.783224 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1003/2019] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:28:31.787536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bc416-5f84-476f-9c44-c25db5210906 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:31.788690 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1017/2020] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:31.799946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4010d6-7ec1-46c6-aa33-f513014d68c1 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:31.802435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1a4010d6-7ec1-46c6-aa33-f513014d68c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:31.807991 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bc416-5f84-476f-9c44-c25db5210906 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:31.809857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:31.820532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d7ccc-5d51-4b03-a731-fb3621ce4986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:31.821834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d7ccc-5d51-4b03-a731-fb3621ce4986 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:31.822302 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d7ccc-5d51-4b03-a731-fb3621ce4986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:31.822708 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d7ccc-5d51-4b03-a731-fb3621ce4986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:31.823833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d7ccc-5d51-4b03-a731-fb3621ce4986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:31.825724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d7ccc-5d51-4b03-a731-fb3621ce4986 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:31.852749 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1004/2021] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:31.857710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d7ccc-5d51-4b03-a731-fb3621ce4986 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:31.871542 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d7ccc-5d51-4b03-a731-fb3621ce4986 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:31.878518 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b50f6-3f79-4afd-9a43-1153454d9d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:31.880505 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b50f6-3f79-4afd-9a43-1153454d9d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:31.880920 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b50f6-3f79-4afd-9a43-1153454d9d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:31.881209 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b50f6-3f79-4afd-9a43-1153454d9d24 admin admin] PATH_INFO: `/v3/projects/1d45a6d0b42e4382b349ce4308167968/users/e52c428b31594f7ba9ae7ae49b792cff/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:31.889567 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4010d6-7ec1-46c6-aa33-f513014d68c1 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:31.894263 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4177a4-5b71-4b92-af84-22d732198031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:31.895159 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4177a4-5b71-4b92-af84-22d732198031 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:31.895344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4177a4-5b71-4b92-af84-22d732198031 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:31.896607 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4177a4-5b71-4b92-af84-22d732198031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:31.899070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b50f6-3f79-4afd-9a43-1153454d9d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d45a6d0b42e4382b349ce4308167968, user_id=e52c428b31594f7ba9ae7ae49b792cff, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:31.902291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b50f6-3f79-4afd-9a43-1153454d9d24 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:31.908407 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4177a4-5b71-4b92-af84-22d732198031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:31.910314 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4177a4-5b71-4b92-af84-22d732198031 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:31.926078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1005/2022] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:31 2022] PUT /identity/v3/projects/1d45a6d0b42e4382b349ce4308167968/users/e52c428b31594f7ba9ae7ae49b792cff/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:31.933287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1018/2023] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:28:31.938891 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3f2f0-c834-46a2-bab2-c848c361d9b0 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:31.939179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3f2f0-c834-46a2-bab2-c848c361d9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:31.939456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3f2f0-c834-46a2-bab2-c848c361d9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:31.955586 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4177a4-5b71-4b92-af84-22d732198031 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:31.971005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4177a4-5b71-4b92-af84-22d732198031 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:31.979002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:31.992008 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-69b3f2f0-c834-46a2-bab2-c848c361d9b0 None None] MFA Rules not processed for user `e52c428b31594f7ba9ae7ae49b792cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:31.993475 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-69b3f2f0-c834-46a2-bab2-c848c361d9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:32.078546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e119f0-3b65-4ceb-8344-1b262f5d012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:32.079979 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e119f0-3b65-4ceb-8344-1b262f5d012c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:32.080279 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e119f0-3b65-4ceb-8344-1b262f5d012c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:32.080552 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e119f0-3b65-4ceb-8344-1b262f5d012c admin admin] PATH_INFO: `/v3/users/23e3105e456c4265b7a6617ecfb5da34` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:32.082435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e119f0-3b65-4ceb-8344-1b262f5d012c admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e3105e456c4265b7a6617ecfb5da34)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:32.084700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e119f0-3b65-4ceb-8344-1b262f5d012c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:32.102282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1006/2024] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:28:32.102282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3f2f0-c834-46a2-bab2-c848c361d9b0 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:32.102282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-69b3f2f0-c834-46a2-bab2-c848c361d9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:32.127147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3f2f0-c834-46a2-bab2-c848c361d9b0 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:32.134694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36673a32-f5d5-4ec6-8e26-5523be1085dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:32.135698 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36673a32-f5d5-4ec6-8e26-5523be1085dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:32.136078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36673a32-f5d5-4ec6-8e26-5523be1085dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:32.136465 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36673a32-f5d5-4ec6-8e26-5523be1085dc admin admin] PATH_INFO: `/v3/projects/d3f51bc03c2a4f0e8b1d835d1408ee11` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:32.138108 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36673a32-f5d5-4ec6-8e26-5523be1085dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f51bc03c2a4f0e8b1d835d1408ee11)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:32.141313 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36673a32-f5d5-4ec6-8e26-5523be1085dc admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:32.172351 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-62e119f0-3b65-4ceb-8344-1b262f5d012c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e3105e456c4265b7a6617ecfb5da34'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:32.173502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-62e119f0-3b65-4ceb-8344-1b262f5d012c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e3105e456c4265b7a6617ecfb5da34'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:32.215752 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-62e119f0-3b65-4ceb-8344-1b262f5d012c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e3105e456c4265b7a6617ecfb5da34'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:32.220585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-36673a32-f5d5-4ec6-8e26-5523be1085dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f51bc03c2a4f0e8b1d835d1408ee11', 'request_id': 'req-36673a32-f5d5-4ec6-8e26-5523be1085dc'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:32.235311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-62e119f0-3b65-4ceb-8344-1b262f5d012c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e3105e456c4265b7a6617ecfb5da34'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:32.236437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-62e119f0-3b65-4ceb-8344-1b262f5d012c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e3105e456c4265b7a6617ecfb5da34'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:32.238591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-36673a32-f5d5-4ec6-8e26-5523be1085dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f51bc03c2a4f0e8b1d835d1408ee11', 'request_id': 'req-36673a32-f5d5-4ec6-8e26-5523be1085dc'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:32.252289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-36673a32-f5d5-4ec6-8e26-5523be1085dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f51bc03c2a4f0e8b1d835d1408ee11', 'request_id': 'req-36673a32-f5d5-4ec6-8e26-5523be1085dc'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:32.268971 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1019/2025] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:31 2022] DELETE /identity/v3/users/23e3105e456c4265b7a6617ecfb5da34 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:32.271270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e119f0-3b65-4ceb-8344-1b262f5d012c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:32.274301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-62e119f0-3b65-4ceb-8344-1b262f5d012c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:32.276275 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-36673a32-f5d5-4ec6-8e26-5523be1085dc admin admin] The token cache is being invalidate because project d3f51bc03c2a4f0e8b1d835d1408ee11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:32.276942 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-36673a32-f5d5-4ec6-8e26-5523be1085dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:32.281107 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-36673a32-f5d5-4ec6-8e26-5523be1085dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:32.286479 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1007/2026] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:32 2022] DELETE /identity/v3/projects/d3f51bc03c2a4f0e8b1d835d1408ee11 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:32.286479 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c238326-4564-40e6-affe-695ac11ca2b8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:32.286479 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c238326-4564-40e6-affe-695ac11ca2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:32.288545 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c238326-4564-40e6-affe-695ac11ca2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:32.324956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8c238326-4564-40e6-affe-695ac11ca2b8 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:32.326742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8c238326-4564-40e6-affe-695ac11ca2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:32.386126 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:32.411494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1008/2027] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:32.412517 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c238326-4564-40e6-affe-695ac11ca2b8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:32.413926 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8c238326-4564-40e6-affe-695ac11ca2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:32.433838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c238326-4564-40e6-affe-695ac11ca2b8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:32.445735 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a233ec-4afe-4971-84c1-2c2861c67957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:32.446669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a233ec-4afe-4971-84c1-2c2861c67957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:32.447987 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a233ec-4afe-4971-84c1-2c2861c67957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:32.448280 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a233ec-4afe-4971-84c1-2c2861c67957 admin admin] PATH_INFO: `/v3/users/96682dabf4c645918e55b1cefeaf68fd` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:32.451994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a233ec-4afe-4971-84c1-2c2861c67957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96682dabf4c645918e55b1cefeaf68fd)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:32.455292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a233ec-4afe-4971-84c1-2c2861c67957 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:32.464854 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e119f0-3b65-4ceb-8344-1b262f5d012c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:32.470985 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fbb8d-b87e-41da-b319-ee995ab2acbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:32.471667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fbb8d-b87e-41da-b319-ee995ab2acbd admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:32.472003 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fbb8d-b87e-41da-b319-ee995ab2acbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:32.472252 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fbb8d-b87e-41da-b319-ee995ab2acbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:32.473629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fbb8d-b87e-41da-b319-ee995ab2acbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:32.476445 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fbb8d-b87e-41da-b319-ee995ab2acbd admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:32.486674 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:32.527349 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1020/2028] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:32 2022] POST /identity/v3/projects => generated 401 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:32.527349 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fbb8d-b87e-41da-b319-ee995ab2acbd admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:32.529983 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4e6fbb8d-b87e-41da-b319-ee995ab2acbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:32.534924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f3a233ec-4afe-4971-84c1-2c2861c67957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96682dabf4c645918e55b1cefeaf68fd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:32.536676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f3a233ec-4afe-4971-84c1-2c2861c67957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96682dabf4c645918e55b1cefeaf68fd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:32.555759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f3a233ec-4afe-4971-84c1-2c2861c67957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96682dabf4c645918e55b1cefeaf68fd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:32.557233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f3a233ec-4afe-4971-84c1-2c2861c67957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96682dabf4c645918e55b1cefeaf68fd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:32.606213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f3a233ec-4afe-4971-84c1-2c2861c67957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96682dabf4c645918e55b1cefeaf68fd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:32.648718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1009/2029] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:32 2022] DELETE /identity/v3/users/96682dabf4c645918e55b1cefeaf68fd => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:32.649890 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a233ec-4afe-4971-84c1-2c2861c67957 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:32.656076 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f3a233ec-4afe-4971-84c1-2c2861c67957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:32.675908 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fbb8d-b87e-41da-b319-ee995ab2acbd admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:32.757245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f029c-0e0f-4b44-8142-34d5725e54ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:32.757930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f029c-0e0f-4b44-8142-34d5725e54ef service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:32.758217 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f029c-0e0f-4b44-8142-34d5725e54ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:32.758499 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f029c-0e0f-4b44-8142-34d5725e54ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:32.760653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-891f029c-0e0f-4b44-8142-34d5725e54ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:32.767034 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a233ec-4afe-4971-84c1-2c2861c67957 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:32.772965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5475ff-c795-4c69-af43-8c23c3f60be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:32.773345 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f029c-0e0f-4b44-8142-34d5725e54ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:32.773681 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5475ff-c795-4c69-af43-8c23c3f60be1 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:32.773968 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5475ff-c795-4c69-af43-8c23c3f60be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:32.774246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5475ff-c795-4c69-af43-8c23c3f60be1 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:32.774805 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f029c-0e0f-4b44-8142-34d5725e54ef service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:32.774978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5475ff-c795-4c69-af43-8c23c3f60be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:32.776876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5475ff-c795-4c69-af43-8c23c3f60be1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:32.786834 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1021/2030] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:32.804078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1010/2031] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:32 2022] POST /identity/v3/users => generated 307 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:32.805340 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f029c-0e0f-4b44-8142-34d5725e54ef service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:32.817816 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f029c-0e0f-4b44-8142-34d5725e54ef service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:32.822962 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a09d8-b5db-4ea1-885a-5c1d75f8e040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:32.823638 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a09d8-b5db-4ea1-885a-5c1d75f8e040 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:32.823923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a09d8-b5db-4ea1-885a-5c1d75f8e040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:32.824199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a09d8-b5db-4ea1-885a-5c1d75f8e040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:32.825571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a09d8-b5db-4ea1-885a-5c1d75f8e040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:32.827261 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a09d8-b5db-4ea1-885a-5c1d75f8e040 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:32.843789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1022/2032] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:32.845132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5475ff-c795-4c69-af43-8c23c3f60be1 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:32.868726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5475ff-c795-4c69-af43-8c23c3f60be1 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:32.874128 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa484385-7dd2-45a7-9905-1f3f44764885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:32.875084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa484385-7dd2-45a7-9905-1f3f44764885 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:32.875371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa484385-7dd2-45a7-9905-1f3f44764885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:32.875651 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa484385-7dd2-45a7-9905-1f3f44764885 admin admin] PATH_INFO: `/v3/projects/54132fbbca834ec480e07695e818cc48/users/6b420bed518c408b89c6a533124132e9/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:32.894743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa484385-7dd2-45a7-9905-1f3f44764885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54132fbbca834ec480e07695e818cc48, user_id=6b420bed518c408b89c6a533124132e9, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:32.897438 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa484385-7dd2-45a7-9905-1f3f44764885 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:32.912348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1011/2033] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:32 2022] PUT /identity/v3/projects/54132fbbca834ec480e07695e818cc48/users/6b420bed518c408b89c6a533124132e9/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:32.916660 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a09d8-b5db-4ea1-885a-5c1d75f8e040 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:32.928720 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a09d8-b5db-4ea1-885a-5c1d75f8e040 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:32.998744 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0639f8e-8f19-4241-a938-ccb3851a29da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:32.999662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0639f8e-8f19-4241-a938-ccb3851a29da admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:32.999948 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0639f8e-8f19-4241-a938-ccb3851a29da admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:33.000223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0639f8e-8f19-4241-a938-ccb3851a29da admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:33.000951 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0639f8e-8f19-4241-a938-ccb3851a29da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:33.003142 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0639f8e-8f19-4241-a938-ccb3851a29da admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:33.004778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:33.016607 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1023/2034] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:33.020287 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa484385-7dd2-45a7-9905-1f3f44764885 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:33.033050 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa484385-7dd2-45a7-9905-1f3f44764885 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:33.044564 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124b704-7e5e-4415-bf44-ec5cb3773d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:33.045949 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124b704-7e5e-4415-bf44-ec5cb3773d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:33.047058 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124b704-7e5e-4415-bf44-ec5cb3773d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:33.047567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124b704-7e5e-4415-bf44-ec5cb3773d07 admin admin] PATH_INFO: `/v3/projects/54132fbbca834ec480e07695e818cc48/users/6b420bed518c408b89c6a533124132e9/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:33.052273 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124b704-7e5e-4415-bf44-ec5cb3773d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54132fbbca834ec480e07695e818cc48, user_id=6b420bed518c408b89c6a533124132e9, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:33.057534 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124b704-7e5e-4415-bf44-ec5cb3773d07 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:33.071908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1012/2035] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:33 2022] PUT /identity/v3/projects/54132fbbca834ec480e07695e818cc48/users/6b420bed518c408b89c6a533124132e9/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:33.084240 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600605-4398-4e36-9fee-2695bc687b20 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:33.084539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600605-4398-4e36-9fee-2695bc687b20 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:33.084827 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600605-4398-4e36-9fee-2695bc687b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:33.111735 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124b704-7e5e-4415-bf44-ec5cb3773d07 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:33.113828 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4124b704-7e5e-4415-bf44-ec5cb3773d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:33.153530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c2600605-4398-4e36-9fee-2695bc687b20 None None] MFA Rules not processed for user `6b420bed518c408b89c6a533124132e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:33.156838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c2600605-4398-4e36-9fee-2695bc687b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:33.217490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:DELETE=9,keystone:SELECT=85,keystone:INSERT=6 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:33.247366 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124b704-7e5e-4415-bf44-ec5cb3773d07 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:33.262036 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dae5c3-dd41-4041-890c-11f28c8b5f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:33.262218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dae5c3-dd41-4041-890c-11f28c8b5f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:33.262704 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dae5c3-dd41-4041-890c-11f28c8b5f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:33.263171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dae5c3-dd41-4041-890c-11f28c8b5f51 admin admin] PATH_INFO: `/v3/projects/e388b310cd024974b0f8e9fbd7765c20` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:33.265964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dae5c3-dd41-4041-890c-11f28c8b5f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e388b310cd024974b0f8e9fbd7765c20)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:33.268762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dae5c3-dd41-4041-890c-11f28c8b5f51 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:33.296990 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1024/2036] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:33 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:33.297561 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2600605-4398-4e36-9fee-2695bc687b20 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:33.299139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c2600605-4398-4e36-9fee-2695bc687b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:33.315961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2600605-4398-4e36-9fee-2695bc687b20 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:33.328331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-47dae5c3-dd41-4041-890c-11f28c8b5f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e388b310cd024974b0f8e9fbd7765c20', 'request_id': 'req-47dae5c3-dd41-4041-890c-11f28c8b5f51'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:33.335128 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-47dae5c3-dd41-4041-890c-11f28c8b5f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e388b310cd024974b0f8e9fbd7765c20', 'request_id': 'req-47dae5c3-dd41-4041-890c-11f28c8b5f51'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:33.342628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-47dae5c3-dd41-4041-890c-11f28c8b5f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e388b310cd024974b0f8e9fbd7765c20', 'request_id': 'req-47dae5c3-dd41-4041-890c-11f28c8b5f51'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:33.359900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-47dae5c3-dd41-4041-890c-11f28c8b5f51 admin admin] The token cache is being invalidate because project e388b310cd024974b0f8e9fbd7765c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:33.360334 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-47dae5c3-dd41-4041-890c-11f28c8b5f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:33.361621 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-47dae5c3-dd41-4041-890c-11f28c8b5f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:33.367975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1013/2037] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:33 2022] DELETE /identity/v3/projects/e388b310cd024974b0f8e9fbd7765c20 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:33.369646 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dae5c3-dd41-4041-890c-11f28c8b5f51 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:33.371412 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-47dae5c3-dd41-4041-890c-11f28c8b5f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:33.384308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12219dce-b487-465b-8f30-3ad268fdea5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:33.385381 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12219dce-b487-465b-8f30-3ad268fdea5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:33.385667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12219dce-b487-465b-8f30-3ad268fdea5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:33.386386 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12219dce-b487-465b-8f30-3ad268fdea5d admin admin] PATH_INFO: `/v3/projects/5b70c86eac7b4ed4b3f21eec7bac45c6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:33.388367 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12219dce-b487-465b-8f30-3ad268fdea5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b70c86eac7b4ed4b3f21eec7bac45c6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:33.391101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12219dce-b487-465b-8f30-3ad268fdea5d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:33.440922 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dae5c3-dd41-4041-890c-11f28c8b5f51 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:33.453823 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-12219dce-b487-465b-8f30-3ad268fdea5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b70c86eac7b4ed4b3f21eec7bac45c6', 'request_id': 'req-12219dce-b487-465b-8f30-3ad268fdea5d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:33.461617 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-12219dce-b487-465b-8f30-3ad268fdea5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b70c86eac7b4ed4b3f21eec7bac45c6', 'request_id': 'req-12219dce-b487-465b-8f30-3ad268fdea5d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:33.467489 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-12219dce-b487-465b-8f30-3ad268fdea5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b70c86eac7b4ed4b3f21eec7bac45c6', 'request_id': 'req-12219dce-b487-465b-8f30-3ad268fdea5d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:33.479030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-12219dce-b487-465b-8f30-3ad268fdea5d admin admin] The token cache is being invalidate because project 5b70c86eac7b4ed4b3f21eec7bac45c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:33.479390 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-12219dce-b487-465b-8f30-3ad268fdea5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:33.480056 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-12219dce-b487-465b-8f30-3ad268fdea5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:33.481666 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1025/2038] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:33 2022] DELETE /identity/v3/projects/5b70c86eac7b4ed4b3f21eec7bac45c6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:33.485664 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12219dce-b487-465b-8f30-3ad268fdea5d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:33.486970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-12219dce-b487-465b-8f30-3ad268fdea5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:33.490422 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9b457-92b6-444c-914f-ff4af80f4d71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:33.491064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9b457-92b6-444c-914f-ff4af80f4d71 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:33.491343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9b457-92b6-444c-914f-ff4af80f4d71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:33.491618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9b457-92b6-444c-914f-ff4af80f4d71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:33.493454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-91c9b457-92b6-444c-914f-ff4af80f4d71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:33.500147 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:33.542195 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:33.555285 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12219dce-b487-465b-8f30-3ad268fdea5d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:33.560095 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1248e9-3733-4152-a42d-06a778bdb9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:33.560972 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1248e9-3733-4152-a42d-06a778bdb9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:33.561250 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1248e9-3733-4152-a42d-06a778bdb9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:33.561555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1248e9-3733-4152-a42d-06a778bdb9a6 admin admin] PATH_INFO: `/v3/users/ad7558a804654441b28db81f9e9bb8e9` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:33.562788 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1248e9-3733-4152-a42d-06a778bdb9a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7558a804654441b28db81f9e9bb8e9)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:33.564743 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1248e9-3733-4152-a42d-06a778bdb9a6 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:33.566597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9b457-92b6-444c-914f-ff4af80f4d71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:33.568324 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9b457-92b6-444c-914f-ff4af80f4d71 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:33.579509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1014/2039] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:33 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:33.580874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734d33e-4993-4ce1-9887-7c2d949cd079 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:33.581310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734d33e-4993-4ce1-9887-7c2d949cd079 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:33.581594 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734d33e-4993-4ce1-9887-7c2d949cd079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:33.602141 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1734d33e-4993-4ce1-9887-7c2d949cd079 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:33.603526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1734d33e-4993-4ce1-9887-7c2d949cd079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:33.614765 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1015/2040] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:33.622155 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de917ef3-9a5c-48c7-a08d-f6ef30ffd832 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:33.622446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de917ef3-9a5c-48c7-a08d-f6ef30ffd832 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:33.622725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de917ef3-9a5c-48c7-a08d-f6ef30ffd832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:33.627824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-df1248e9-3733-4152-a42d-06a778bdb9a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7558a804654441b28db81f9e9bb8e9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:33.628546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-df1248e9-3733-4152-a42d-06a778bdb9a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7558a804654441b28db81f9e9bb8e9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:33.643690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-de917ef3-9a5c-48c7-a08d-f6ef30ffd832 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:33.646062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-de917ef3-9a5c-48c7-a08d-f6ef30ffd832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:33.656268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-df1248e9-3733-4152-a42d-06a778bdb9a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7558a804654441b28db81f9e9bb8e9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:33.660516 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1016/2041] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:33.661182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de917ef3-9a5c-48c7-a08d-f6ef30ffd832 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:33.667342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-df1248e9-3733-4152-a42d-06a778bdb9a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7558a804654441b28db81f9e9bb8e9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:33.668066 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-df1248e9-3733-4152-a42d-06a778bdb9a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7558a804654441b28db81f9e9bb8e9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:33.672164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de917ef3-9a5c-48c7-a08d-f6ef30ffd832 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:33.677474 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ffd87-bcad-4ae7-ab05-02e545af2b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:33.678143 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ffd87-bcad-4ae7-ab05-02e545af2b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:33.678427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ffd87-bcad-4ae7-ab05-02e545af2b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:33.678732 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ffd87-bcad-4ae7-ab05-02e545af2b72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:33.679469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ffd87-bcad-4ae7-ab05-02e545af2b72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:33.679774 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ffd87-bcad-4ae7-ab05-02e545af2b72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:33.681420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ffd87-bcad-4ae7-ab05-02e545af2b72 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:33.700291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1017/2042] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:28:33.701780 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ffd87-bcad-4ae7-ab05-02e545af2b72 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:33.705578 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-de3ffd87-bcad-4ae7-ab05-02e545af2b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:33.709931 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1026/2043] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:33 2022] DELETE /identity/v3/users/ad7558a804654441b28db81f9e9bb8e9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:33.713005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1248e9-3733-4152-a42d-06a778bdb9a6 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:33.723970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ffd87-bcad-4ae7-ab05-02e545af2b72 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:33.813597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24382e33-020c-47c2-864b-57b694d12502 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:33.814248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24382e33-020c-47c2-864b-57b694d12502 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:33.814553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24382e33-020c-47c2-864b-57b694d12502 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:33.816488 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24382e33-020c-47c2-864b-57b694d12502 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:33.821814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-24382e33-020c-47c2-864b-57b694d12502 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:33.831021 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1248e9-3733-4152-a42d-06a778bdb9a6 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:33.837730 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9c405-e04f-4d29-95ca-e76547a6e0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:33.838201 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9c405-e04f-4d29-95ca-e76547a6e0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:33.838494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9c405-e04f-4d29-95ca-e76547a6e0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:33.838775 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9c405-e04f-4d29-95ca-e76547a6e0c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:33.839473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9c405-e04f-4d29-95ca-e76547a6e0c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:33.842370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9c405-e04f-4d29-95ca-e76547a6e0c9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:33.888180 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1027/2044] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:33 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:33.891873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9c405-e04f-4d29-95ca-e76547a6e0c9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:33.921209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:33.949990 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24382e33-020c-47c2-864b-57b694d12502 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:33.962233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24382e33-020c-47c2-864b-57b694d12502 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:33.972629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1018/2045] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:33.997861 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9c405-e04f-4d29-95ca-e76547a6e0c9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:34.005066 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f875d0-f49e-4cbe-8020-1544ed4b9733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:34.006326 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f875d0-f49e-4cbe-8020-1544ed4b9733 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:34.006450 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f875d0-f49e-4cbe-8020-1544ed4b9733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:34.006785 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f875d0-f49e-4cbe-8020-1544ed4b9733 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:34.007614 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f875d0-f49e-4cbe-8020-1544ed4b9733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:34.009783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f875d0-f49e-4cbe-8020-1544ed4b9733 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:34.036875 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1028/2046] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:33 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:34.040979 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24382e33-020c-47c2-864b-57b694d12502 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:34.057814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24382e33-020c-47c2-864b-57b694d12502 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:34.064122 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27206223-03ac-434b-9d8f-baa4d89574d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:34.064926 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27206223-03ac-434b-9d8f-baa4d89574d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:34.065699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27206223-03ac-434b-9d8f-baa4d89574d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:34.066356 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27206223-03ac-434b-9d8f-baa4d89574d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:34.066839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27206223-03ac-434b-9d8f-baa4d89574d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:34.068636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27206223-03ac-434b-9d8f-baa4d89574d8 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:34.093047 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1019/2047] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:34.094626 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f875d0-f49e-4cbe-8020-1544ed4b9733 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:34.108487 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f875d0-f49e-4cbe-8020-1544ed4b9733 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:34.119103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7d8bc-72e5-43f3-8976-585d13bd3260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:34.120501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7d8bc-72e5-43f3-8976-585d13bd3260 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:34.120790 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7d8bc-72e5-43f3-8976-585d13bd3260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:34.121069 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7d8bc-72e5-43f3-8976-585d13bd3260 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:34.121841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7d8bc-72e5-43f3-8976-585d13bd3260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:34.126721 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7d8bc-72e5-43f3-8976-585d13bd3260 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:34.149097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1029/2048] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:34.150375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27206223-03ac-434b-9d8f-baa4d89574d8 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:34.165952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27206223-03ac-434b-9d8f-baa4d89574d8 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:34.178288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d94f1b-7ee5-47e1-b73f-d4e0c28d9e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:34.180913 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d94f1b-7ee5-47e1-b73f-d4e0c28d9e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:34.181541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d94f1b-7ee5-47e1-b73f-d4e0c28d9e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:34.182251 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d94f1b-7ee5-47e1-b73f-d4e0c28d9e6a admin admin] PATH_INFO: `/v3/projects/66db2d3f612342d6b7a05596abe46964/users/b107ee99d00b4c25a21fbede7f5955db/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:34.206505 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7d8bc-72e5-43f3-8976-585d13bd3260 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:34.209536 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-84e7d8bc-72e5-43f3-8976-585d13bd3260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:34.231198 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d94f1b-7ee5-47e1-b73f-d4e0c28d9e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66db2d3f612342d6b7a05596abe46964, user_id=b107ee99d00b4c25a21fbede7f5955db, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:34.234998 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d94f1b-7ee5-47e1-b73f-d4e0c28d9e6a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:34.256039 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7d8bc-72e5-43f3-8976-585d13bd3260 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:34.259589 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1020/2049] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:34 2022] PUT /identity/v3/projects/66db2d3f612342d6b7a05596abe46964/users/b107ee99d00b4c25a21fbede7f5955db/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:34.272394 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27205e35-c337-4aad-b96d-c082737b16c0 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:34.272678 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27205e35-c337-4aad-b96d-c082737b16c0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:34.272960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27205e35-c337-4aad-b96d-c082737b16c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:34.331693 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-27205e35-c337-4aad-b96d-c082737b16c0 None None] MFA Rules not processed for user `b107ee99d00b4c25a21fbede7f5955db`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:34.332970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-27205e35-c337-4aad-b96d-c082737b16c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:34.364381 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70523303-26b1-4049-85af-74807e699c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:34.365673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70523303-26b1-4049-85af-74807e699c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:34.365965 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70523303-26b1-4049-85af-74807e699c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:34.366308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70523303-26b1-4049-85af-74807e699c4c admin admin] PATH_INFO: `/v3/projects/0f94446de5a34b80a314f100acd55bec` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:34.368781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70523303-26b1-4049-85af-74807e699c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f94446de5a34b80a314f100acd55bec)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:34.371691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70523303-26b1-4049-85af-74807e699c4c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:34.386675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:34.476833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-70523303-26b1-4049-85af-74807e699c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f94446de5a34b80a314f100acd55bec', 'request_id': 'req-70523303-26b1-4049-85af-74807e699c4c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:34.502497 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-70523303-26b1-4049-85af-74807e699c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f94446de5a34b80a314f100acd55bec', 'request_id': 'req-70523303-26b1-4049-85af-74807e699c4c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:34.510123 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1021/2050] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:34.540080 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-70523303-26b1-4049-85af-74807e699c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f94446de5a34b80a314f100acd55bec', 'request_id': 'req-70523303-26b1-4049-85af-74807e699c4c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:34.585921 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-70523303-26b1-4049-85af-74807e699c4c admin admin] The token cache is being invalidate because project 0f94446de5a34b80a314f100acd55bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:34.587732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-70523303-26b1-4049-85af-74807e699c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:34.588602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-70523303-26b1-4049-85af-74807e699c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:34.590959 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1030/2051] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:34 2022] DELETE /identity/v3/projects/0f94446de5a34b80a314f100acd55bec => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:34.599332 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62f5af-d1c3-4ee5-9101-7a57ea1be911 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:34.599966 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62f5af-d1c3-4ee5-9101-7a57ea1be911 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:34.600798 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62f5af-d1c3-4ee5-9101-7a57ea1be911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:34.631967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4c62f5af-d1c3-4ee5-9101-7a57ea1be911 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:34.634200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4c62f5af-d1c3-4ee5-9101-7a57ea1be911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:34.690990 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70523303-26b1-4049-85af-74807e699c4c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:34.693594 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-70523303-26b1-4049-85af-74807e699c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:34.748711 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:34.774726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1022/2052] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:34.777518 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23612178-c22d-4b0e-8fc2-4cb00a544635 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:34.777814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23612178-c22d-4b0e-8fc2-4cb00a544635 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:34.778089 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23612178-c22d-4b0e-8fc2-4cb00a544635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:34.821163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-23612178-c22d-4b0e-8fc2-4cb00a544635 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:34.823350 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-23612178-c22d-4b0e-8fc2-4cb00a544635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:34.834373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70523303-26b1-4049-85af-74807e699c4c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:34.835228 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1023/2053] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:34.839522 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23612178-c22d-4b0e-8fc2-4cb00a544635 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:34.841196 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91889d99-5981-4139-b3ed-3a5f63f61ce3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:34.842073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91889d99-5981-4139-b3ed-3a5f63f61ce3 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:34.842412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91889d99-5981-4139-b3ed-3a5f63f61ce3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:34.842724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91889d99-5981-4139-b3ed-3a5f63f61ce3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:34.844974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-91889d99-5981-4139-b3ed-3a5f63f61ce3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:34.853117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23612178-c22d-4b0e-8fc2-4cb00a544635 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:34.857566 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023e1a7-7227-4511-b55d-a474a09243e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:34.858287 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023e1a7-7227-4511-b55d-a474a09243e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:34.858666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023e1a7-7227-4511-b55d-a474a09243e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:34.859004 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023e1a7-7227-4511-b55d-a474a09243e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:34.859821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023e1a7-7227-4511-b55d-a474a09243e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:34.860192 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023e1a7-7227-4511-b55d-a474a09243e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:34.861896 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023e1a7-7227-4511-b55d-a474a09243e0 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:34.878541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1024/2054] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:28:34.882837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023e1a7-7227-4511-b55d-a474a09243e0 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:34.901399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023e1a7-7227-4511-b55d-a474a09243e0 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:34.911615 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66287cf-b68f-490e-bd80-522f8f140edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:34.912500 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66287cf-b68f-490e-bd80-522f8f140edb admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:34.912856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66287cf-b68f-490e-bd80-522f8f140edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:34.913208 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66287cf-b68f-490e-bd80-522f8f140edb admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:34.914096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66287cf-b68f-490e-bd80-522f8f140edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:34.917720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66287cf-b68f-490e-bd80-522f8f140edb admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:34.926050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91889d99-5981-4139-b3ed-3a5f63f61ce3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:34.927900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91889d99-5981-4139-b3ed-3a5f63f61ce3 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:34.938198 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1031/2055] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:34.961091 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1025/2056] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:34 2022] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:28:34.962205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91889d99-5981-4139-b3ed-3a5f63f61ce3 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:34.973436 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91889d99-5981-4139-b3ed-3a5f63f61ce3 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:35.037181 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8e7c7-382e-401f-a81a-29aeb6953ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:35.037897 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8e7c7-382e-401f-a81a-29aeb6953ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:35.038183 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8e7c7-382e-401f-a81a-29aeb6953ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:35.038459 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8e7c7-382e-401f-a81a-29aeb6953ff4 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:35.039171 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8e7c7-382e-401f-a81a-29aeb6953ff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:35.041125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8e7c7-382e-401f-a81a-29aeb6953ff4 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:35.065103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1032/2057] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:34 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:35.068472 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66287cf-b68f-490e-bd80-522f8f140edb admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:35.080895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66287cf-b68f-490e-bd80-522f8f140edb admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:35.086002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edcd0d-b354-48d1-92fd-96e3bc578ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:35.086736 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edcd0d-b354-48d1-92fd-96e3bc578ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:35.087086 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edcd0d-b354-48d1-92fd-96e3bc578ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:35.087525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edcd0d-b354-48d1-92fd-96e3bc578ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:35.088166 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09edcd0d-b354-48d1-92fd-96e3bc578ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:35.089774 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09edcd0d-b354-48d1-92fd-96e3bc578ff2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:35.101620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1026/2058] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:35.105465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8e7c7-382e-401f-a81a-29aeb6953ff4 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:35.118627 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8e7c7-382e-401f-a81a-29aeb6953ff4 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:35.123464 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef702bb-0934-4e71-84d0-e2ad8006ba41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:35.124238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef702bb-0934-4e71-84d0-e2ad8006ba41 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:35.124667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef702bb-0934-4e71-84d0-e2ad8006ba41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:35.124857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef702bb-0934-4e71-84d0-e2ad8006ba41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:35.125622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef702bb-0934-4e71-84d0-e2ad8006ba41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:35.127274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef702bb-0934-4e71-84d0-e2ad8006ba41 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:35.138128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1033/2059] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:35.143033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edcd0d-b354-48d1-92fd-96e3bc578ff2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:35.153822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edcd0d-b354-48d1-92fd-96e3bc578ff2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:35.160289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450d8af-a37a-47ab-b2d6-a6e513ba8cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:35.161641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450d8af-a37a-47ab-b2d6-a6e513ba8cba admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:35.161949 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450d8af-a37a-47ab-b2d6-a6e513ba8cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:35.162226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450d8af-a37a-47ab-b2d6-a6e513ba8cba admin admin] PATH_INFO: `/v3/projects/91010bce90c54363a073b534a1c47fd1/users/5b98442814c84f85b9c0c8f5070fc7b4/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:35.183391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450d8af-a37a-47ab-b2d6-a6e513ba8cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=91010bce90c54363a073b534a1c47fd1, user_id=5b98442814c84f85b9c0c8f5070fc7b4, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:35.186261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450d8af-a37a-47ab-b2d6-a6e513ba8cba admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:35.206306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1027/2060] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:35 2022] PUT /identity/v3/projects/91010bce90c54363a073b534a1c47fd1/users/5b98442814c84f85b9c0c8f5070fc7b4/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:35.229500 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28ab10-d26f-4194-add0-35098bf24ce7 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:35.230281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28ab10-d26f-4194-add0-35098bf24ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:35.230872 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28ab10-d26f-4194-add0-35098bf24ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:35.269131 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-3e28ab10-d26f-4194-add0-35098bf24ce7 None None] MFA Rules not processed for user `5b98442814c84f85b9c0c8f5070fc7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:35.270627 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3e28ab10-d26f-4194-add0-35098bf24ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:35.329670 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:35.355388 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1034/2061] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:35.359885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450d8af-a37a-47ab-b2d6-a6e513ba8cba admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:35.411391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:35.426478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450d8af-a37a-47ab-b2d6-a6e513ba8cba admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:35.431270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a532f61-3e3f-42de-b603-9dbd4e8deab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:35.431952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a532f61-3e3f-42de-b603-9dbd4e8deab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:35.432243 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a532f61-3e3f-42de-b603-9dbd4e8deab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:35.432519 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a532f61-3e3f-42de-b603-9dbd4e8deab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:35.433290 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a532f61-3e3f-42de-b603-9dbd4e8deab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:35.435244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a532f61-3e3f-42de-b603-9dbd4e8deab6 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:35.463625 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1028/2062] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:35 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:35.467949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28ab10-d26f-4194-add0-35098bf24ce7 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:35.479508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28ab10-d26f-4194-add0-35098bf24ce7 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:35.545402 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c145f71-c5a0-4e00-bcec-98ee302dd762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:35.546404 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c145f71-c5a0-4e00-bcec-98ee302dd762 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:35.546825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c145f71-c5a0-4e00-bcec-98ee302dd762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:35.547252 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c145f71-c5a0-4e00-bcec-98ee302dd762 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:35.548288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c145f71-c5a0-4e00-bcec-98ee302dd762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:35.551385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c145f71-c5a0-4e00-bcec-98ee302dd762 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:35.587467 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1035/2063] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:35 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:35.589348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a532f61-3e3f-42de-b603-9dbd4e8deab6 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:35.603170 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a532f61-3e3f-42de-b603-9dbd4e8deab6 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:35.609356 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7781928-b182-4358-94ad-7d94b9e37c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:35.609500 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7781928-b182-4358-94ad-7d94b9e37c3f admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:35.609784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7781928-b182-4358-94ad-7d94b9e37c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:35.610261 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7781928-b182-4358-94ad-7d94b9e37c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:35.611068 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7781928-b182-4358-94ad-7d94b9e37c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:35.612746 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7781928-b182-4358-94ad-7d94b9e37c3f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:35.627492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1029/2064] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:28:35.630550 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c145f71-c5a0-4e00-bcec-98ee302dd762 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:35.643914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c145f71-c5a0-4e00-bcec-98ee302dd762 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:35.648953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce0ba0-6cfa-4a8c-a740-6a7b2e8e618c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:35.650101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce0ba0-6cfa-4a8c-a740-6a7b2e8e618c admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:35.650224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce0ba0-6cfa-4a8c-a740-6a7b2e8e618c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:35.650432 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce0ba0-6cfa-4a8c-a740-6a7b2e8e618c admin admin] PATH_INFO: `/v3/projects/95fb0c00c7ac41c19cfe50ab056fe73c/users/6f334606cde84720a9bf0780b985ec4a/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:35.666196 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce0ba0-6cfa-4a8c-a740-6a7b2e8e618c admin admin] RBAC: Authorizing `identity:create_grant(project_id=95fb0c00c7ac41c19cfe50ab056fe73c, user_id=6f334606cde84720a9bf0780b985ec4a, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:35.677498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce0ba0-6cfa-4a8c-a740-6a7b2e8e618c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:35.685002 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1036/2065] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:35 2022] PUT /identity/v3/projects/95fb0c00c7ac41c19cfe50ab056fe73c/users/6f334606cde84720a9bf0780b985ec4a/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:35.689221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7781928-b182-4358-94ad-7d94b9e37c3f admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:35.705734 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7781928-b182-4358-94ad-7d94b9e37c3f admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:35.786334 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f34a4e-e51e-42fb-8c6e-647481f9f30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:35.787225 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f34a4e-e51e-42fb-8c6e-647481f9f30c admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:35.787580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f34a4e-e51e-42fb-8c6e-647481f9f30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:35.787930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f34a4e-e51e-42fb-8c6e-647481f9f30c admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:35.788983 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f34a4e-e51e-42fb-8c6e-647481f9f30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:35.792284 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f34a4e-e51e-42fb-8c6e-647481f9f30c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:35.807309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1030/2066] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:35.811015 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce0ba0-6cfa-4a8c-a740-6a7b2e8e618c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:35.826169 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce0ba0-6cfa-4a8c-a740-6a7b2e8e618c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:35.847060 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324ab83-9234-48ed-a80a-5803d39be276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:35.849846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324ab83-9234-48ed-a80a-5803d39be276 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:35.850335 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324ab83-9234-48ed-a80a-5803d39be276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:35.851503 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324ab83-9234-48ed-a80a-5803d39be276 admin admin] PATH_INFO: `/v3/projects/95fb0c00c7ac41c19cfe50ab056fe73c/users/6f334606cde84720a9bf0780b985ec4a/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:35.857077 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324ab83-9234-48ed-a80a-5803d39be276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95fb0c00c7ac41c19cfe50ab056fe73c, user_id=6f334606cde84720a9bf0780b985ec4a, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:35.860587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324ab83-9234-48ed-a80a-5803d39be276 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:35.903760 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1037/2067] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:35 2022] PUT /identity/v3/projects/95fb0c00c7ac41c19cfe50ab056fe73c/users/6f334606cde84720a9bf0780b985ec4a/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:35.905713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6afe5-b066-42f2-a312-44fb156ef774 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:35.906116 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6afe5-b066-42f2-a312-44fb156ef774 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:35.906390 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6afe5-b066-42f2-a312-44fb156ef774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:35.935332 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2aa6afe5-b066-42f2-a312-44fb156ef774 None None] MFA Rules not processed for user `6f334606cde84720a9bf0780b985ec4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:35.937022 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2aa6afe5-b066-42f2-a312-44fb156ef774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:36.081529 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1031/2068] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:36.092322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324ab83-9234-48ed-a80a-5803d39be276 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:36.159964 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324ab83-9234-48ed-a80a-5803d39be276 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:36.165067 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2f1b0-72b9-4592-8a6a-d394faeffcf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:36.165753 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2f1b0-72b9-4592-8a6a-d394faeffcf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:36.166035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2f1b0-72b9-4592-8a6a-d394faeffcf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:36.166342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2f1b0-72b9-4592-8a6a-d394faeffcf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:36.176079 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2f1b0-72b9-4592-8a6a-d394faeffcf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:36.177618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2f1b0-72b9-4592-8a6a-d394faeffcf9 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:36.188502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1038/2069] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:36 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:36.285587 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6afe5-b066-42f2-a312-44fb156ef774 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:36.297787 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6afe5-b066-42f2-a312-44fb156ef774 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:36.305793 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6bdd3-7488-4e66-a6b0-7d58e6fe093d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:36.306701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6bdd3-7488-4e66-a6b0-7d58e6fe093d service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:36.307091 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6bdd3-7488-4e66-a6b0-7d58e6fe093d service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:36.307523 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6bdd3-7488-4e66-a6b0-7d58e6fe093d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:36.370636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:36.389543 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6bdd3-7488-4e66-a6b0-7d58e6fe093d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:36.391064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6bdd3-7488-4e66-a6b0-7d58e6fe093d service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:36.405021 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1032/2070] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:38.357434 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2f1b0-72b9-4592-8a6a-d394faeffcf9 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:38.358989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-12b2f1b0-72b9-4592-8a6a-d394faeffcf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:38.408276 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:38.430478 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2f1b0-72b9-4592-8a6a-d394faeffcf9 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:38.435147 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940d6b0-7801-4ffe-9070-47be29cf16f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:38.436018 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940d6b0-7801-4ffe-9070-47be29cf16f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:38.436316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940d6b0-7801-4ffe-9070-47be29cf16f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:38.437123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940d6b0-7801-4ffe-9070-47be29cf16f3 admin admin] PATH_INFO: `/v3/users/5b58335a12ed420791872316d9b2782e` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:38.438389 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940d6b0-7801-4ffe-9070-47be29cf16f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b58335a12ed420791872316d9b2782e)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:38.440323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940d6b0-7801-4ffe-9070-47be29cf16f3 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:38.490953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d940d6b0-7801-4ffe-9070-47be29cf16f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b58335a12ed420791872316d9b2782e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:38.491893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d940d6b0-7801-4ffe-9070-47be29cf16f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b58335a12ed420791872316d9b2782e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:38.504324 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d940d6b0-7801-4ffe-9070-47be29cf16f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b58335a12ed420791872316d9b2782e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:38.511833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d940d6b0-7801-4ffe-9070-47be29cf16f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b58335a12ed420791872316d9b2782e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:38.512545 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d940d6b0-7801-4ffe-9070-47be29cf16f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b58335a12ed420791872316d9b2782e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:38.525283 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1039/2071] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:38 2022] DELETE /identity/v3/users/5b58335a12ed420791872316d9b2782e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:38.529809 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da5050-b601-4847-b1e6-2ab6779f50e8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:38.530850 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da5050-b601-4847-b1e6-2ab6779f50e8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:38.530978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da5050-b601-4847-b1e6-2ab6779f50e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:38.549573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d0da5050-b601-4847-b1e6-2ab6779f50e8 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:38.551216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d0da5050-b601-4847-b1e6-2ab6779f50e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:38.614963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1033/2072] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:38.626497 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940d6b0-7801-4ffe-9070-47be29cf16f3 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:38.628136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d940d6b0-7801-4ffe-9070-47be29cf16f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:38.697501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940d6b0-7801-4ffe-9070-47be29cf16f3 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:38.703383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34030640-e400-40db-845f-f6cfd7c44874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:38.703826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34030640-e400-40db-845f-f6cfd7c44874 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:38.704235 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34030640-e400-40db-845f-f6cfd7c44874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:38.704513 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34030640-e400-40db-845f-f6cfd7c44874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:38.716007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34030640-e400-40db-845f-f6cfd7c44874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:38.717616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34030640-e400-40db-845f-f6cfd7c44874 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:38.728226 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1040/2073] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:38.863655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da5050-b601-4847-b1e6-2ab6779f50e8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:38.865190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d0da5050-b601-4847-b1e6-2ab6779f50e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:38.894273 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da5050-b601-4847-b1e6-2ab6779f50e8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:38.915685 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed726c-0c62-4934-982c-8a77eb6df4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:38.916667 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed726c-0c62-4934-982c-8a77eb6df4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:38.916947 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed726c-0c62-4934-982c-8a77eb6df4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:38.917223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed726c-0c62-4934-982c-8a77eb6df4a3 admin admin] PATH_INFO: `/v3/users/e52c428b31594f7ba9ae7ae49b792cff` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:38.918545 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed726c-0c62-4934-982c-8a77eb6df4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e52c428b31594f7ba9ae7ae49b792cff)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:38.920619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed726c-0c62-4934-982c-8a77eb6df4a3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:38.977625 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7fed726c-0c62-4934-982c-8a77eb6df4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e52c428b31594f7ba9ae7ae49b792cff'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:38.978193 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7fed726c-0c62-4934-982c-8a77eb6df4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e52c428b31594f7ba9ae7ae49b792cff'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:38.987986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7fed726c-0c62-4934-982c-8a77eb6df4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e52c428b31594f7ba9ae7ae49b792cff'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:38.988742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7fed726c-0c62-4934-982c-8a77eb6df4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e52c428b31594f7ba9ae7ae49b792cff'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:38.998036 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7fed726c-0c62-4934-982c-8a77eb6df4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e52c428b31594f7ba9ae7ae49b792cff'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:39.019875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1034/2074] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:38 2022] DELETE /identity/v3/users/e52c428b31594f7ba9ae7ae49b792cff => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:39.024159 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990130c5-0b89-479d-80fe-55c3035b6929 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:39.024356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990130c5-0b89-479d-80fe-55c3035b6929 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:39.024666 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990130c5-0b89-479d-80fe-55c3035b6929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:39.044027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed726c-0c62-4934-982c-8a77eb6df4a3 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:39.050590 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7fed726c-0c62-4934-982c-8a77eb6df4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:39.070593 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-990130c5-0b89-479d-80fe-55c3035b6929 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:39.080987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-990130c5-0b89-479d-80fe-55c3035b6929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:39.156164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:39.164613 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed726c-0c62-4934-982c-8a77eb6df4a3 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:39.171282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6f8d1-7fdf-4c22-8243-86eff304346f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:39.172189 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6f8d1-7fdf-4c22-8243-86eff304346f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:39.173001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6f8d1-7fdf-4c22-8243-86eff304346f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:39.173937 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6f8d1-7fdf-4c22-8243-86eff304346f admin admin] PATH_INFO: `/v3/projects/db91b7a988b645b592eb6e6401c44dd6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:39.174609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1041/2075] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:39.176658 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6f8d1-7fdf-4c22-8243-86eff304346f admin admin] RBAC: Authorizing `identity:delete_project(project_id=db91b7a988b645b592eb6e6401c44dd6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:39.178838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6f8d1-7fdf-4c22-8243-86eff304346f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:39.183606 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990130c5-0b89-479d-80fe-55c3035b6929 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:39.186162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-990130c5-0b89-479d-80fe-55c3035b6929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:39.198308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:39.257817 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2db6f8d1-7fdf-4c22-8243-86eff304346f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db91b7a988b645b592eb6e6401c44dd6', 'request_id': 'req-2db6f8d1-7fdf-4c22-8243-86eff304346f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:39.270391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2db6f8d1-7fdf-4c22-8243-86eff304346f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db91b7a988b645b592eb6e6401c44dd6', 'request_id': 'req-2db6f8d1-7fdf-4c22-8243-86eff304346f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:39.279605 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2db6f8d1-7fdf-4c22-8243-86eff304346f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db91b7a988b645b592eb6e6401c44dd6', 'request_id': 'req-2db6f8d1-7fdf-4c22-8243-86eff304346f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:39.309111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2db6f8d1-7fdf-4c22-8243-86eff304346f admin admin] The token cache is being invalidate because project db91b7a988b645b592eb6e6401c44dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:39.310465 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2db6f8d1-7fdf-4c22-8243-86eff304346f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:39.312862 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2db6f8d1-7fdf-4c22-8243-86eff304346f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:39.325696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1035/2076] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:39 2022] DELETE /identity/v3/projects/db91b7a988b645b592eb6e6401c44dd6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:39.329755 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6f8d1-7fdf-4c22-8243-86eff304346f admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:39.331132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2db6f8d1-7fdf-4c22-8243-86eff304346f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:39.343495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990130c5-0b89-479d-80fe-55c3035b6929 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:39.474065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23989dc-f227-47e4-9d47-fb6e8e6b082e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:39.474753 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23989dc-f227-47e4-9d47-fb6e8e6b082e service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:39.475119 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23989dc-f227-47e4-9d47-fb6e8e6b082e service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:39.475317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23989dc-f227-47e4-9d47-fb6e8e6b082e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:39.482344 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b23989dc-f227-47e4-9d47-fb6e8e6b082e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:39.506218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6f8d1-7fdf-4c22-8243-86eff304346f admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:39.511762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23989dc-f227-47e4-9d47-fb6e8e6b082e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:39.513505 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23989dc-f227-47e4-9d47-fb6e8e6b082e service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:39.516931 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd41821-bc98-4be4-88df-22e0fb00f138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:39.518041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd41821-bc98-4be4-88df-22e0fb00f138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:39.518552 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd41821-bc98-4be4-88df-22e0fb00f138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:39.519066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd41821-bc98-4be4-88df-22e0fb00f138 admin admin] PATH_INFO: `/v3/users/7dfd2fdeec4a459fb296dffbb20b083a` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:39.520913 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd41821-bc98-4be4-88df-22e0fb00f138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dfd2fdeec4a459fb296dffbb20b083a)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:39.523018 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd41821-bc98-4be4-88df-22e0fb00f138 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:39.525399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1042/2077] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:28:39.607403 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2cd41821-bc98-4be4-88df-22e0fb00f138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dfd2fdeec4a459fb296dffbb20b083a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:39.609201 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2cd41821-bc98-4be4-88df-22e0fb00f138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dfd2fdeec4a459fb296dffbb20b083a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:39.624963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2cd41821-bc98-4be4-88df-22e0fb00f138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dfd2fdeec4a459fb296dffbb20b083a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:39.625747 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2cd41821-bc98-4be4-88df-22e0fb00f138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dfd2fdeec4a459fb296dffbb20b083a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:39.643138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2cd41821-bc98-4be4-88df-22e0fb00f138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dfd2fdeec4a459fb296dffbb20b083a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:39.671879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1036/2078] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:39 2022] DELETE /identity/v3/users/7dfd2fdeec4a459fb296dffbb20b083a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:39.994703 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23989dc-f227-47e4-9d47-fb6e8e6b082e service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:39.996322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b23989dc-f227-47e4-9d47-fb6e8e6b082e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:40.034261 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23989dc-f227-47e4-9d47-fb6e8e6b082e service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:40.126830 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd41821-bc98-4be4-88df-22e0fb00f138 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:40.127889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cadabd-641c-4570-a707-dd995651173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:40.128787 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2cd41821-bc98-4be4-88df-22e0fb00f138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:40.129225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cadabd-641c-4570-a707-dd995651173d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:40.129849 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cadabd-641c-4570-a707-dd995651173d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:40.130281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cadabd-641c-4570-a707-dd995651173d admin admin] PATH_INFO: `/v3/projects/1d45a6d0b42e4382b349ce4308167968` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:40.131954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cadabd-641c-4570-a707-dd995651173d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d45a6d0b42e4382b349ce4308167968)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:40.142476 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cadabd-641c-4570-a707-dd995651173d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:40.143611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:40.152669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd41821-bc98-4be4-88df-22e0fb00f138 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:40.164631 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c111fd2-989b-4884-9277-a247e125f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:40.165496 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c111fd2-989b-4884-9277-a247e125f882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:40.166053 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c111fd2-989b-4884-9277-a247e125f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:40.166337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c111fd2-989b-4884-9277-a247e125f882 admin admin] PATH_INFO: `/v3/projects/d7bb683b74c7406d807147d19024b4c6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:40.168031 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c111fd2-989b-4884-9277-a247e125f882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7bb683b74c7406d807147d19024b4c6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:40.173478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c111fd2-989b-4884-9277-a247e125f882 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:40.210507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b7cadabd-641c-4570-a707-dd995651173d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d45a6d0b42e4382b349ce4308167968', 'request_id': 'req-b7cadabd-641c-4570-a707-dd995651173d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:40.219971 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b7cadabd-641c-4570-a707-dd995651173d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d45a6d0b42e4382b349ce4308167968', 'request_id': 'req-b7cadabd-641c-4570-a707-dd995651173d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:40.227125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b7cadabd-641c-4570-a707-dd995651173d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d45a6d0b42e4382b349ce4308167968', 'request_id': 'req-b7cadabd-641c-4570-a707-dd995651173d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:40.228449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:40.229892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5c111fd2-989b-4884-9277-a247e125f882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7bb683b74c7406d807147d19024b4c6', 'request_id': 'req-5c111fd2-989b-4884-9277-a247e125f882'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:40.236980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5c111fd2-989b-4884-9277-a247e125f882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7bb683b74c7406d807147d19024b4c6', 'request_id': 'req-5c111fd2-989b-4884-9277-a247e125f882'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:40.244493 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b7cadabd-641c-4570-a707-dd995651173d admin admin] The token cache is being invalidate because project 1d45a6d0b42e4382b349ce4308167968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:40.245024 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b7cadabd-641c-4570-a707-dd995651173d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:40.245978 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b7cadabd-641c-4570-a707-dd995651173d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:40.248181 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5c111fd2-989b-4884-9277-a247e125f882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7bb683b74c7406d807147d19024b4c6', 'request_id': 'req-5c111fd2-989b-4884-9277-a247e125f882'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:40.248547 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1043/2079] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:39 2022] DELETE /identity/v3/projects/1d45a6d0b42e4382b349ce4308167968 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:40.253372 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cadabd-641c-4570-a707-dd995651173d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:40.255092 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b7cadabd-641c-4570-a707-dd995651173d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:40.267286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5c111fd2-989b-4884-9277-a247e125f882 admin admin] The token cache is being invalidate because project d7bb683b74c7406d807147d19024b4c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:40.267590 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5c111fd2-989b-4884-9277-a247e125f882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:40.268238 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5c111fd2-989b-4884-9277-a247e125f882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:40.270260 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1037/2080] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:40 2022] DELETE /identity/v3/projects/d7bb683b74c7406d807147d19024b4c6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:40.274881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c5952-6131-4d97-9e5e-f6f243c635bf None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:40.275452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c5952-6131-4d97-9e5e-f6f243c635bf None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:40.275837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c5952-6131-4d97-9e5e-f6f243c635bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:40.299604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-080c5952-6131-4d97-9e5e-f6f243c635bf None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:40.301408 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-080c5952-6131-4d97-9e5e-f6f243c635bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:40.348612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cadabd-641c-4570-a707-dd995651173d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:40.385379 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1038/2081] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:28:40.393507 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17acfe2-07b7-4b91-923f-99ec21314d59 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:40.393767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17acfe2-07b7-4b91-923f-99ec21314d59 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:40.394149 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17acfe2-07b7-4b91-923f-99ec21314d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:40.415125 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d17acfe2-07b7-4b91-923f-99ec21314d59 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:40.416757 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d17acfe2-07b7-4b91-923f-99ec21314d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:40.428029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1039/2082] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:28:40.431600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17acfe2-07b7-4b91-923f-99ec21314d59 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:40.432778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89ea04-6995-409d-b129-3f5859e8d4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:40.433873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89ea04-6995-409d-b129-3f5859e8d4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:40.434322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89ea04-6995-409d-b129-3f5859e8d4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:40.434738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89ea04-6995-409d-b129-3f5859e8d4c7 admin admin] PATH_INFO: `/v3/users/6b420bed518c408b89c6a533124132e9` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:40.436867 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89ea04-6995-409d-b129-3f5859e8d4c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b420bed518c408b89c6a533124132e9)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:40.439033 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89ea04-6995-409d-b129-3f5859e8d4c7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:40.443996 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17acfe2-07b7-4b91-923f-99ec21314d59 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:40.449845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354b252-6d4b-4223-a59f-e878bae36745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:40.450866 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354b252-6d4b-4223-a59f-e878bae36745 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:40.451327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354b252-6d4b-4223-a59f-e878bae36745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:40.451533 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354b252-6d4b-4223-a59f-e878bae36745 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:40.452672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354b252-6d4b-4223-a59f-e878bae36745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:40.452986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354b252-6d4b-4223-a59f-e878bae36745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:40.454729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354b252-6d4b-4223-a59f-e878bae36745 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:40.470743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1040/2083] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:28:40.476154 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354b252-6d4b-4223-a59f-e878bae36745 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:40.488352 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354b252-6d4b-4223-a59f-e878bae36745 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:40.493544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4795816-630e-48d1-b7db-0c264dccffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:40.494269 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4795816-630e-48d1-b7db-0c264dccffa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:40.494781 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4795816-630e-48d1-b7db-0c264dccffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:40.495184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4795816-630e-48d1-b7db-0c264dccffa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:40.496118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4795816-630e-48d1-b7db-0c264dccffa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:40.498516 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4795816-630e-48d1-b7db-0c264dccffa3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:40.511149 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-fe89ea04-6995-409d-b129-3f5859e8d4c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b420bed518c408b89c6a533124132e9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:40.512018 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-fe89ea04-6995-409d-b129-3f5859e8d4c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b420bed518c408b89c6a533124132e9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:40.530884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-fe89ea04-6995-409d-b129-3f5859e8d4c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b420bed518c408b89c6a533124132e9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:40.533844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1041/2084] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:40 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:40.537783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4795816-630e-48d1-b7db-0c264dccffa3 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:40.539446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-fe89ea04-6995-409d-b129-3f5859e8d4c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b420bed518c408b89c6a533124132e9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:40.539580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d4795816-630e-48d1-b7db-0c264dccffa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:40.540178 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-fe89ea04-6995-409d-b129-3f5859e8d4c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b420bed518c408b89c6a533124132e9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:40.556943 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1044/2085] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:40 2022] DELETE /identity/v3/users/6b420bed518c408b89c6a533124132e9 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:40.600864 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:40.627859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4795816-630e-48d1-b7db-0c264dccffa3 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:40.693449 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086e19e-408a-4537-8b24-398f65e8e4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:40.694185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086e19e-408a-4537-8b24-398f65e8e4ac admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:40.694526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086e19e-408a-4537-8b24-398f65e8e4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:40.694879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086e19e-408a-4537-8b24-398f65e8e4ac admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:40.695665 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086e19e-408a-4537-8b24-398f65e8e4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:40.699319 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086e19e-408a-4537-8b24-398f65e8e4ac admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:40.727893 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1042/2086] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:40 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:28:40.729055 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89ea04-6995-409d-b129-3f5859e8d4c7 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:40.742224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89ea04-6995-409d-b129-3f5859e8d4c7 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:40.747124 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e9f87-0f1f-4d3e-be44-48db04863720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:40.748310 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e9f87-0f1f-4d3e-be44-48db04863720 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:40.748599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e9f87-0f1f-4d3e-be44-48db04863720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:40.748874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e9f87-0f1f-4d3e-be44-48db04863720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:40.750223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e9f87-0f1f-4d3e-be44-48db04863720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:40.751893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e9f87-0f1f-4d3e-be44-48db04863720 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:40.767284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1045/2087] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:28:40.768540 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086e19e-408a-4537-8b24-398f65e8e4ac admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:40.778664 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086e19e-408a-4537-8b24-398f65e8e4ac admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:40.783601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509cc8c1-c704-4c3e-92e1-281abb877cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:40.784340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cc8c1-c704-4c3e-92e1-281abb877cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:40.784686 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cc8c1-c704-4c3e-92e1-281abb877cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:40.785045 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cc8c1-c704-4c3e-92e1-281abb877cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:40.785897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509cc8c1-c704-4c3e-92e1-281abb877cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:40.787591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509cc8c1-c704-4c3e-92e1-281abb877cc9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:40.800106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1043/2088] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:28:40.804538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e9f87-0f1f-4d3e-be44-48db04863720 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:40.816901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e9f87-0f1f-4d3e-be44-48db04863720 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:40.822373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda291fe-d6cd-428b-aa8b-5128ebeb3776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:40.822950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda291fe-d6cd-428b-aa8b-5128ebeb3776 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:40.823133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda291fe-d6cd-428b-aa8b-5128ebeb3776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:40.823404 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda291fe-d6cd-428b-aa8b-5128ebeb3776 admin admin] PATH_INFO: `/v3/projects/fbf385f9a98e4338b9a7f200cda03f6d/users/8d31caf469e04329855cc553a140a8ba/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:40.827530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:40.840646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda291fe-d6cd-428b-aa8b-5128ebeb3776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf385f9a98e4338b9a7f200cda03f6d, user_id=8d31caf469e04329855cc553a140a8ba, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:40.843923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda291fe-d6cd-428b-aa8b-5128ebeb3776 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:40.858102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1046/2089] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:40 2022] PUT /identity/v3/projects/fbf385f9a98e4338b9a7f200cda03f6d/users/8d31caf469e04329855cc553a140a8ba/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:40.864368 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1cdf0-59e9-44b0-80fa-957ba4722180 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:40.864771 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1cdf0-59e9-44b0-80fa-957ba4722180 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:40.865115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1cdf0-59e9-44b0-80fa-957ba4722180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:40.884078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-bcc1cdf0-59e9-44b0-80fa-957ba4722180 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:40.885326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bcc1cdf0-59e9-44b0-80fa-957ba4722180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:40.933293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda291fe-d6cd-428b-aa8b-5128ebeb3776 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:40.935848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-eda291fe-d6cd-428b-aa8b-5128ebeb3776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:40.979990 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1044/2090] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:28:40.991377 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1cdf0-59e9-44b0-80fa-957ba4722180 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:40.993211 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bcc1cdf0-59e9-44b0-80fa-957ba4722180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:41.034026 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda291fe-d6cd-428b-aa8b-5128ebeb3776 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:41.055424 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9568858-c9e4-48b4-a8dc-3e6c2cf69356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:41.057241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9568858-c9e4-48b4-a8dc-3e6c2cf69356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:41.058021 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9568858-c9e4-48b4-a8dc-3e6c2cf69356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:41.058372 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9568858-c9e4-48b4-a8dc-3e6c2cf69356 admin admin] PATH_INFO: `/v3/projects/54132fbbca834ec480e07695e818cc48` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:41.059927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9568858-c9e4-48b4-a8dc-3e6c2cf69356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54132fbbca834ec480e07695e818cc48)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:41.063146 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9568858-c9e4-48b4-a8dc-3e6c2cf69356 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:41.103994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1cdf0-59e9-44b0-80fa-957ba4722180 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:41.111734 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd06e74-56e1-4796-8088-b992d4f2c8b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:41.112547 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd06e74-56e1-4796-8088-b992d4f2c8b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:41.112821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd06e74-56e1-4796-8088-b992d4f2c8b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:41.113143 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd06e74-56e1-4796-8088-b992d4f2c8b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:41.120413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c9568858-c9e4-48b4-a8dc-3e6c2cf69356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54132fbbca834ec480e07695e818cc48', 'request_id': 'req-c9568858-c9e4-48b4-a8dc-3e6c2cf69356'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:41.122888 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd06e74-56e1-4796-8088-b992d4f2c8b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:41.125325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd06e74-56e1-4796-8088-b992d4f2c8b7 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:41.131176 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c9568858-c9e4-48b4-a8dc-3e6c2cf69356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54132fbbca834ec480e07695e818cc48', 'request_id': 'req-c9568858-c9e4-48b4-a8dc-3e6c2cf69356'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:41.137119 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c9568858-c9e4-48b4-a8dc-3e6c2cf69356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54132fbbca834ec480e07695e818cc48', 'request_id': 'req-c9568858-c9e4-48b4-a8dc-3e6c2cf69356'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:41.137555 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1045/2091] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:28:41.149661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c9568858-c9e4-48b4-a8dc-3e6c2cf69356 admin admin] The token cache is being invalidate because project 54132fbbca834ec480e07695e818cc48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:41.149955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c9568858-c9e4-48b4-a8dc-3e6c2cf69356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:41.150619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c9568858-c9e4-48b4-a8dc-3e6c2cf69356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:41.152892 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1047/2092] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:40 2022] DELETE /identity/v3/projects/54132fbbca834ec480e07695e818cc48 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:41.158318 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0439d-1eb7-4354-9ee0-bc3ff7b3e460 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:41.158600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0439d-1eb7-4354-9ee0-bc3ff7b3e460 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:41.158879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0439d-1eb7-4354-9ee0-bc3ff7b3e460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:41.179740 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a9c0439d-1eb7-4354-9ee0-bc3ff7b3e460 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:41.180958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a9c0439d-1eb7-4354-9ee0-bc3ff7b3e460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:41.190643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:41.246757 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1046/2093] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:28:41.254623 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b417402-0f93-4a06-9e3a-179c55c4f627 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:41.254915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b417402-0f93-4a06-9e3a-179c55c4f627 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:41.255223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b417402-0f93-4a06-9e3a-179c55c4f627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:41.274732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8b417402-0f93-4a06-9e3a-179c55c4f627 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:41.275949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8b417402-0f93-4a06-9e3a-179c55c4f627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:41.285278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1048/2094] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:41.289583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0439d-1eb7-4354-9ee0-bc3ff7b3e460 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:41.299904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0439d-1eb7-4354-9ee0-bc3ff7b3e460 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:41.304582 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd711445-6525-488a-8445-b39e6c050ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:41.305241 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd711445-6525-488a-8445-b39e6c050ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:41.305556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd711445-6525-488a-8445-b39e6c050ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:41.305852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd711445-6525-488a-8445-b39e6c050ba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:41.306571 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd711445-6525-488a-8445-b39e6c050ba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:41.306879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd711445-6525-488a-8445-b39e6c050ba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:41.308683 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd711445-6525-488a-8445-b39e6c050ba0 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:41.322912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1047/2095] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:28:41.328019 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b417402-0f93-4a06-9e3a-179c55c4f627 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:41.337614 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b417402-0f93-4a06-9e3a-179c55c4f627 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:41.342571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9adb7d-7136-4fb1-b443-759cda938b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:41.343917 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9adb7d-7136-4fb1-b443-759cda938b3b admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:41.344196 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9adb7d-7136-4fb1-b443-759cda938b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:41.344467 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9adb7d-7136-4fb1-b443-759cda938b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:41.345331 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9adb7d-7136-4fb1-b443-759cda938b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:41.347377 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9adb7d-7136-4fb1-b443-759cda938b3b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:41.375612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1049/2096] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:41 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:41.379877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd711445-6525-488a-8445-b39e6c050ba0 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:41.390801 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd711445-6525-488a-8445-b39e6c050ba0 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:41.461121 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6aa44-11cd-4b71-9e64-46dc86bcab98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:41.461941 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6aa44-11cd-4b71-9e64-46dc86bcab98 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:41.462294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6aa44-11cd-4b71-9e64-46dc86bcab98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:41.462652 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6aa44-11cd-4b71-9e64-46dc86bcab98 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:41.463415 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6aa44-11cd-4b71-9e64-46dc86bcab98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:41.465856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6aa44-11cd-4b71-9e64-46dc86bcab98 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:41.509049 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1048/2097] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:41 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:28:41.510905 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9adb7d-7136-4fb1-b443-759cda938b3b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:41.526190 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9adb7d-7136-4fb1-b443-759cda938b3b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:41.532157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53300345-9f79-4053-bd4f-2b1e0d1edead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:41.533014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53300345-9f79-4053-bd4f-2b1e0d1edead admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:41.533471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53300345-9f79-4053-bd4f-2b1e0d1edead admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:41.533907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53300345-9f79-4053-bd4f-2b1e0d1edead admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:41.534796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53300345-9f79-4053-bd4f-2b1e0d1edead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:41.536681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53300345-9f79-4053-bd4f-2b1e0d1edead admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:41.551396 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1050/2098] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:41.552655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6aa44-11cd-4b71-9e64-46dc86bcab98 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:41.579689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6aa44-11cd-4b71-9e64-46dc86bcab98 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:41.585186 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb72f5e-c8d1-4178-b164-ea1a1bbb88cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:41.585931 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb72f5e-c8d1-4178-b164-ea1a1bbb88cd admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:41.586218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb72f5e-c8d1-4178-b164-ea1a1bbb88cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:41.586722 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb72f5e-c8d1-4178-b164-ea1a1bbb88cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:41.587453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb72f5e-c8d1-4178-b164-ea1a1bbb88cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:41.589304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb72f5e-c8d1-4178-b164-ea1a1bbb88cd admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:41.614211 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1049/2099] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:41.615800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53300345-9f79-4053-bd4f-2b1e0d1edead admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:41.639931 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53300345-9f79-4053-bd4f-2b1e0d1edead admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:41.646687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac29d1-5f00-45de-bde3-e5cafa8f7b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:41.648764 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac29d1-5f00-45de-bde3-e5cafa8f7b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:41.649300 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac29d1-5f00-45de-bde3-e5cafa8f7b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:41.649775 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac29d1-5f00-45de-bde3-e5cafa8f7b4e admin admin] PATH_INFO: `/v3/projects/856aab00318c422d9b1381f148d24850/users/2f7e6ba54fc84b5c9154762cdfeef21c/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:41.682412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac29d1-5f00-45de-bde3-e5cafa8f7b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=856aab00318c422d9b1381f148d24850, user_id=2f7e6ba54fc84b5c9154762cdfeef21c, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:41.685787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac29d1-5f00-45de-bde3-e5cafa8f7b4e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:41.705620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1051/2100] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:41 2022] PUT /identity/v3/projects/856aab00318c422d9b1381f148d24850/users/2f7e6ba54fc84b5c9154762cdfeef21c/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:41.715792 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ccf05-2e4a-4bd7-9f66-eeb5bce17ac6 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:41.716414 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ccf05-2e4a-4bd7-9f66-eeb5bce17ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:41.716414 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ccf05-2e4a-4bd7-9f66-eeb5bce17ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:41.750806 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-261ccf05-2e4a-4bd7-9f66-eeb5bce17ac6 None None] MFA Rules not processed for user `2f7e6ba54fc84b5c9154762cdfeef21c`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:41.752181 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-261ccf05-2e4a-4bd7-9f66-eeb5bce17ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:41.831372 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1050/2101] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:41.848016 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac29d1-5f00-45de-bde3-e5cafa8f7b4e admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:41.848016 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-cdac29d1-5f00-45de-bde3-e5cafa8f7b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:41.865232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:41.877503 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ccf05-2e4a-4bd7-9f66-eeb5bce17ac6 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:41.879332 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-261ccf05-2e4a-4bd7-9f66-eeb5bce17ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:41.910438 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:42.036579 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac29d1-5f00-45de-bde3-e5cafa8f7b4e admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:42.045357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdf6af-9bc0-45d9-bbaa-b2d05790a675 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5602d0a51329412ab6e908e7787531a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:42.048807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdf6af-9bc0-45d9-bbaa-b2d05790a675 service glance] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:42.049118 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdf6af-9bc0-45d9-bbaa-b2d05790a675 service glance] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:42.050515 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdf6af-9bc0-45d9-bbaa-b2d05790a675 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:42.062190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ccf05-2e4a-4bd7-9f66-eeb5bce17ac6 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:42.072572 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdf6af-9bc0-45d9-bbaa-b2d05790a675 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:42.075813 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdf6af-9bc0-45d9-bbaa-b2d05790a675 service glance] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:42.078466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e24be-055e-432c-8900-4ca36b8b51ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:42.079596 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e24be-055e-432c-8900-4ca36b8b51ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:42.080971 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e24be-055e-432c-8900-4ca36b8b51ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:42.081453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e24be-055e-432c-8900-4ca36b8b51ef admin admin] PATH_INFO: `/v3/users/5b98442814c84f85b9c0c8f5070fc7b4` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:42.085723 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e24be-055e-432c-8900-4ca36b8b51ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b98442814c84f85b9c0c8f5070fc7b4)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:42.088030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e24be-055e-432c-8900-4ca36b8b51ef admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:42.088937 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1052/2102] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:42.090951 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c848f91-d274-4687-8fd3-eb5e4765bf22 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:42.090951 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c848f91-d274-4687-8fd3-eb5e4765bf22 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:42.091172 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c848f91-d274-4687-8fd3-eb5e4765bf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:42.135598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-3c848f91-d274-4687-8fd3-eb5e4765bf22 None None] MFA Rules not processed for user `8d31caf469e04329855cc553a140a8ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:42.141982 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3c848f91-d274-4687-8fd3-eb5e4765bf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:42.252298 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5d9e24be-055e-432c-8900-4ca36b8b51ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b98442814c84f85b9c0c8f5070fc7b4'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:42.254753 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5d9e24be-055e-432c-8900-4ca36b8b51ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b98442814c84f85b9c0c8f5070fc7b4'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:42.274117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1053/2103] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:42.278321 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5d9e24be-055e-432c-8900-4ca36b8b51ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b98442814c84f85b9c0c8f5070fc7b4'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:42.279144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5d9e24be-055e-432c-8900-4ca36b8b51ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b98442814c84f85b9c0c8f5070fc7b4'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:42.279975 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c848f91-d274-4687-8fd3-eb5e4765bf22 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:42.281331 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3c848f91-d274-4687-8fd3-eb5e4765bf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:42.293752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5d9e24be-055e-432c-8900-4ca36b8b51ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b98442814c84f85b9c0c8f5070fc7b4'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:42.308793 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c848f91-d274-4687-8fd3-eb5e4765bf22 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:42.327045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50c47e-e017-4e56-a2f5-545f2a9f9c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:42.329155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50c47e-e017-4e56-a2f5-545f2a9f9c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:42.329293 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1051/2104] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:41 2022] DELETE /identity/v3/users/5b98442814c84f85b9c0c8f5070fc7b4 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:42.329460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50c47e-e017-4e56-a2f5-545f2a9f9c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:42.329737 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50c47e-e017-4e56-a2f5-545f2a9f9c0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:42.330435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50c47e-e017-4e56-a2f5-545f2a9f9c0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:42.333364 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de0eb5-b6fb-4578-8633-7d97c955fe28 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:42.334581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de0eb5-b6fb-4578-8633-7d97c955fe28 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:42.334939 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de0eb5-b6fb-4578-8633-7d97c955fe28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:42.339486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50c47e-e017-4e56-a2f5-545f2a9f9c0a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:42.356442 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-01de0eb5-b6fb-4578-8633-7d97c955fe28 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:42.357945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-01de0eb5-b6fb-4578-8633-7d97c955fe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:42.416716 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1054/2105] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:42 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:42.420735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50c47e-e017-4e56-a2f5-545f2a9f9c0a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:42.427487 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1f50c47e-e017-4e56-a2f5-545f2a9f9c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:42.469781 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1052/2106] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:42.478084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de0eb5-b6fb-4578-8633-7d97c955fe28 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:42.487400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-01de0eb5-b6fb-4578-8633-7d97c955fe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:42.516110 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50c47e-e017-4e56-a2f5-545f2a9f9c0a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:42.520912 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ab93a-5a4d-4d2c-b394-84212488b1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:42.521901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ab93a-5a4d-4d2c-b394-84212488b1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:42.522022 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ab93a-5a4d-4d2c-b394-84212488b1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:42.522442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ab93a-5a4d-4d2c-b394-84212488b1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:42.522981 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ab93a-5a4d-4d2c-b394-84212488b1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:42.524926 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ab93a-5a4d-4d2c-b394-84212488b1b3 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:42.534577 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:42.539267 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:42.551693 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1055/2107] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:42 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:42.551693 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ab93a-5a4d-4d2c-b394-84212488b1b3 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:42.568591 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ab93a-5a4d-4d2c-b394-84212488b1b3 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:42.581320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee8440-b099-42c1-8e09-26dcc9ddc466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:42.582009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee8440-b099-42c1-8e09-26dcc9ddc466 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:42.582307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee8440-b099-42c1-8e09-26dcc9ddc466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:42.582852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee8440-b099-42c1-8e09-26dcc9ddc466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:42.584105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee8440-b099-42c1-8e09-26dcc9ddc466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:42.586202 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee8440-b099-42c1-8e09-26dcc9ddc466 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:42.598058 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de0eb5-b6fb-4578-8633-7d97c955fe28 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:42.600557 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1056/2108] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:42.604940 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee8440-b099-42c1-8e09-26dcc9ddc466 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:42.620510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee8440-b099-42c1-8e09-26dcc9ddc466 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:42.629736 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b1a60-961f-4969-91fd-7d94d17946d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:42.631406 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b1a60-961f-4969-91fd-7d94d17946d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:42.632143 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b1a60-961f-4969-91fd-7d94d17946d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:42.632763 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b1a60-961f-4969-91fd-7d94d17946d1 admin admin] PATH_INFO: `/v3/projects/cf306f171b1e47c286c6b6cbd60110ef/users/a2d232bb0d4244958ea95a51089b0504/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:42.677612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b1a60-961f-4969-91fd-7d94d17946d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf306f171b1e47c286c6b6cbd60110ef, user_id=a2d232bb0d4244958ea95a51089b0504, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:42.681672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b1a60-961f-4969-91fd-7d94d17946d1 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:42.683890 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad2699-0f39-4f0d-98cf-f48ad1cd669f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:42.684603 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad2699-0f39-4f0d-98cf-f48ad1cd669f service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:42.684893 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad2699-0f39-4f0d-98cf-f48ad1cd669f service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:42.685169 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad2699-0f39-4f0d-98cf-f48ad1cd669f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:42.695314 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad2699-0f39-4f0d-98cf-f48ad1cd669f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:42.696762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad2699-0f39-4f0d-98cf-f48ad1cd669f service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:42.699881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1057/2109] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:42 2022] PUT /identity/v3/projects/cf306f171b1e47c286c6b6cbd60110ef/users/a2d232bb0d4244958ea95a51089b0504/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:42.704620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b1a60-961f-4969-91fd-7d94d17946d1 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:42.708087 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1053/2110] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:42.799430 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b1a60-961f-4969-91fd-7d94d17946d1 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:42.805708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2b54c-80a9-495d-8309-484d7538d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:42.806561 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2b54c-80a9-495d-8309-484d7538d215 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:42.806944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2b54c-80a9-495d-8309-484d7538d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:42.807288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2b54c-80a9-495d-8309-484d7538d215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:42.808094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2b54c-80a9-495d-8309-484d7538d215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:42.809893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2b54c-80a9-495d-8309-484d7538d215 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:42.825545 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1058/2111] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:42.829191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad2699-0f39-4f0d-98cf-f48ad1cd669f service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:42.846343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad2699-0f39-4f0d-98cf-f48ad1cd669f service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:42.854098 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eda16d-cb03-433a-b742-0e4f1727388f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:42.856843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eda16d-cb03-433a-b742-0e4f1727388f admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:42.857147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eda16d-cb03-433a-b742-0e4f1727388f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:42.857449 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eda16d-cb03-433a-b742-0e4f1727388f admin admin] PATH_INFO: `/v3/projects/cf306f171b1e47c286c6b6cbd60110ef/users/a2d232bb0d4244958ea95a51089b0504/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:42.866903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eda16d-cb03-433a-b742-0e4f1727388f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf306f171b1e47c286c6b6cbd60110ef, user_id=a2d232bb0d4244958ea95a51089b0504, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:42.869908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eda16d-cb03-433a-b742-0e4f1727388f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:42.911852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1054/2112] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:42 2022] PUT /identity/v3/projects/cf306f171b1e47c286c6b6cbd60110ef/users/a2d232bb0d4244958ea95a51089b0504/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:43.041954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2b54c-80a9-495d-8309-484d7538d215 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:43.043697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2ed2b54c-80a9-495d-8309-484d7538d215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:43.059212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2b54c-80a9-495d-8309-484d7538d215 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:43.127230 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84af742-358f-4137-94a4-56f9e1d9c8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:43.128141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84af742-358f-4137-94a4-56f9e1d9c8aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:43.128416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84af742-358f-4137-94a4-56f9e1d9c8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:43.128849 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84af742-358f-4137-94a4-56f9e1d9c8aa admin admin] PATH_INFO: `/v3/projects/91010bce90c54363a073b534a1c47fd1` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:43.130250 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84af742-358f-4137-94a4-56f9e1d9c8aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=91010bce90c54363a073b534a1c47fd1)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:43.132209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84af742-358f-4137-94a4-56f9e1d9c8aa admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:43.183851 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f84af742-358f-4137-94a4-56f9e1d9c8aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91010bce90c54363a073b534a1c47fd1', 'request_id': 'req-f84af742-358f-4137-94a4-56f9e1d9c8aa'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:43.187530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:43.192621 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f84af742-358f-4137-94a4-56f9e1d9c8aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91010bce90c54363a073b534a1c47fd1', 'request_id': 'req-f84af742-358f-4137-94a4-56f9e1d9c8aa'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:43.201530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f84af742-358f-4137-94a4-56f9e1d9c8aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91010bce90c54363a073b534a1c47fd1', 'request_id': 'req-f84af742-358f-4137-94a4-56f9e1d9c8aa'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:43.217556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f84af742-358f-4137-94a4-56f9e1d9c8aa admin admin] The token cache is being invalidate because project 91010bce90c54363a073b534a1c47fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:43.218461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f84af742-358f-4137-94a4-56f9e1d9c8aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:43.219118 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f84af742-358f-4137-94a4-56f9e1d9c8aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:43.223627 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1059/2113] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:43 2022] DELETE /identity/v3/projects/91010bce90c54363a073b534a1c47fd1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:43.225167 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eda16d-cb03-433a-b742-0e4f1727388f admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:43.228858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e5eda16d-cb03-433a-b742-0e4f1727388f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:43.242168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eda16d-cb03-433a-b742-0e4f1727388f admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:43.322996 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5581831-bf23-427c-9266-e761c27e7aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:43.324714 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5581831-bf23-427c-9266-e761c27e7aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:43.325007 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5581831-bf23-427c-9266-e761c27e7aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:43.325705 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5581831-bf23-427c-9266-e761c27e7aa2 admin admin] PATH_INFO: `/v3/users/6f334606cde84720a9bf0780b985ec4a` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:43.326938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5581831-bf23-427c-9266-e761c27e7aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f334606cde84720a9bf0780b985ec4a)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:43.330097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5581831-bf23-427c-9266-e761c27e7aa2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:43.454092 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c5581831-bf23-427c-9266-e761c27e7aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f334606cde84720a9bf0780b985ec4a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:43.456502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c5581831-bf23-427c-9266-e761c27e7aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f334606cde84720a9bf0780b985ec4a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:43.520479 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c5581831-bf23-427c-9266-e761c27e7aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f334606cde84720a9bf0780b985ec4a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:43.522229 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c5581831-bf23-427c-9266-e761c27e7aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f334606cde84720a9bf0780b985ec4a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:43.535547 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c5581831-bf23-427c-9266-e761c27e7aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f334606cde84720a9bf0780b985ec4a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:43.562844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:43.581330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1055/2114] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:43 2022] DELETE /identity/v3/users/6f334606cde84720a9bf0780b985ec4a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:43.760504 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48717401-a4e9-4328-adfc-2dd92b233a52 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:43.761105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48717401-a4e9-4328-adfc-2dd92b233a52 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:43.761694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48717401-a4e9-4328-adfc-2dd92b233a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:43.800884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-48717401-a4e9-4328-adfc-2dd92b233a52 None None] MFA Rules not processed for user `a2d232bb0d4244958ea95a51089b0504`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:43.802689 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-48717401-a4e9-4328-adfc-2dd92b233a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:43.954966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1060/2115] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:43 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:43.971114 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fe282-29ac-4d9d-a3eb-eae088da57fc None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:43.971631 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fe282-29ac-4d9d-a3eb-eae088da57fc None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:43.972310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fe282-29ac-4d9d-a3eb-eae088da57fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:44.009113 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-669fe282-29ac-4d9d-a3eb-eae088da57fc None None] MFA Rules not processed for user `8d31caf469e04329855cc553a140a8ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:44.012572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-669fe282-29ac-4d9d-a3eb-eae088da57fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:44.109536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1056/2116] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:44.114921 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48717401-a4e9-4328-adfc-2dd92b233a52 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:44.116459 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-48717401-a4e9-4328-adfc-2dd92b233a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:44.169389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fe282-29ac-4d9d-a3eb-eae088da57fc None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:44.171329 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-669fe282-29ac-4d9d-a3eb-eae088da57fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:44.265226 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48717401-a4e9-4328-adfc-2dd92b233a52 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:44.271661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2336f83-2684-43fd-85c6-ee505a1fa55f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:44.273305 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2336f83-2684-43fd-85c6-ee505a1fa55f service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:44.273305 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2336f83-2684-43fd-85c6-ee505a1fa55f service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:44.273305 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2336f83-2684-43fd-85c6-ee505a1fa55f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:44.278591 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a2336f83-2684-43fd-85c6-ee505a1fa55f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:44.287195 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fe282-29ac-4d9d-a3eb-eae088da57fc None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:44.290862 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2336f83-2684-43fd-85c6-ee505a1fa55f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:44.293003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecd85b-9459-49f0-b299-435e6397a726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:44.293166 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2336f83-2684-43fd-85c6-ee505a1fa55f service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:44.293652 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecd85b-9459-49f0-b299-435e6397a726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:44.293991 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecd85b-9459-49f0-b299-435e6397a726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:44.294328 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecd85b-9459-49f0-b299-435e6397a726 admin admin] PATH_INFO: `/v3/projects/95fb0c00c7ac41c19cfe50ab056fe73c` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:44.295627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecd85b-9459-49f0-b299-435e6397a726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95fb0c00c7ac41c19cfe50ab056fe73c)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:44.297692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecd85b-9459-49f0-b299-435e6397a726 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:44.302600 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1061/2117] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:44.387706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bfecd85b-9459-49f0-b299-435e6397a726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95fb0c00c7ac41c19cfe50ab056fe73c', 'request_id': 'req-bfecd85b-9459-49f0-b299-435e6397a726'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:44.399744 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bfecd85b-9459-49f0-b299-435e6397a726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95fb0c00c7ac41c19cfe50ab056fe73c', 'request_id': 'req-bfecd85b-9459-49f0-b299-435e6397a726'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:44.408946 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bfecd85b-9459-49f0-b299-435e6397a726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95fb0c00c7ac41c19cfe50ab056fe73c', 'request_id': 'req-bfecd85b-9459-49f0-b299-435e6397a726'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:44.427550 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bfecd85b-9459-49f0-b299-435e6397a726 admin admin] The token cache is being invalidate because project 95fb0c00c7ac41c19cfe50ab056fe73c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:44.427846 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bfecd85b-9459-49f0-b299-435e6397a726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:44.428586 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bfecd85b-9459-49f0-b299-435e6397a726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:44.430262 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1057/2118] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:44 2022] DELETE /identity/v3/projects/95fb0c00c7ac41c19cfe50ab056fe73c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:44.436939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604806c2-e10d-4d35-83ec-4100f7baebb7 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:44.437240 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604806c2-e10d-4d35-83ec-4100f7baebb7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:44.437548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604806c2-e10d-4d35-83ec-4100f7baebb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:44.469912 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-604806c2-e10d-4d35-83ec-4100f7baebb7 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:44.471520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-604806c2-e10d-4d35-83ec-4100f7baebb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:44.558861 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:44.597238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1062/2119] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:28:44.599971 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55bdeb-a157-44b2-9d2b-9856418a6b59 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:44.600274 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55bdeb-a157-44b2-9d2b-9856418a6b59 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:44.600557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55bdeb-a157-44b2-9d2b-9856418a6b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:44.624468 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2a55bdeb-a157-44b2-9d2b-9856418a6b59 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:44.625416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2a55bdeb-a157-44b2-9d2b-9856418a6b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:44.640336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1058/2120] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:28:44.644533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604806c2-e10d-4d35-83ec-4100f7baebb7 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:44.654631 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604806c2-e10d-4d35-83ec-4100f7baebb7 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:44.660948 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042886c1-83a7-48a1-94c3-430e587438ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:44.662288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042886c1-83a7-48a1-94c3-430e587438ec admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:44.662288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042886c1-83a7-48a1-94c3-430e587438ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:44.662462 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042886c1-83a7-48a1-94c3-430e587438ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:44.663185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042886c1-83a7-48a1-94c3-430e587438ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:44.663501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042886c1-83a7-48a1-94c3-430e587438ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:44.667490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042886c1-83a7-48a1-94c3-430e587438ec admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:44.682010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1063/2121] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:28:44.686570 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55bdeb-a157-44b2-9d2b-9856418a6b59 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:44.697249 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55bdeb-a157-44b2-9d2b-9856418a6b59 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:44.706904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee2185-bedc-4826-9f15-f9b487355eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:44.707601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee2185-bedc-4826-9f15-f9b487355eaa admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:44.707869 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee2185-bedc-4826-9f15-f9b487355eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:44.708142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee2185-bedc-4826-9f15-f9b487355eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:44.708856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee2185-bedc-4826-9f15-f9b487355eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:44.710989 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee2185-bedc-4826-9f15-f9b487355eaa admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:44.750928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1059/2122] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:44 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:28:44.755129 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042886c1-83a7-48a1-94c3-430e587438ec admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:44.766413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042886c1-83a7-48a1-94c3-430e587438ec admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:44.846027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cf271-61dd-46cd-8224-757f3c825be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:44.846723 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cf271-61dd-46cd-8224-757f3c825be4 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:44.847009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cf271-61dd-46cd-8224-757f3c825be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:44.847288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cf271-61dd-46cd-8224-757f3c825be4 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:44.848009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cf271-61dd-46cd-8224-757f3c825be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:44.850371 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cf271-61dd-46cd-8224-757f3c825be4 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:44.885435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1064/2123] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:44 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:28:44.888236 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee2185-bedc-4826-9f15-f9b487355eaa admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:44.894493 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:44.900123 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee2185-bedc-4826-9f15-f9b487355eaa admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:44.907187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c73f8-b6a5-4e8b-8530-ed9f5f8b9295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:44.908090 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c73f8-b6a5-4e8b-8530-ed9f5f8b9295 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:44.908622 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c73f8-b6a5-4e8b-8530-ed9f5f8b9295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:44.909166 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c73f8-b6a5-4e8b-8530-ed9f5f8b9295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:44.910205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c73f8-b6a5-4e8b-8530-ed9f5f8b9295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:44.912010 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c73f8-b6a5-4e8b-8530-ed9f5f8b9295 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:44.927196 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1060/2124] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:28:44.928692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cf271-61dd-46cd-8224-757f3c825be4 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:44.940006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cf271-61dd-46cd-8224-757f3c825be4 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:44.946597 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bf260-6a27-4d6f-b184-fefb5f5caf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:44.948036 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bf260-6a27-4d6f-b184-fefb5f5caf33 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:44.948425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bf260-6a27-4d6f-b184-fefb5f5caf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:44.948627 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bf260-6a27-4d6f-b184-fefb5f5caf33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:44.949390 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bf260-6a27-4d6f-b184-fefb5f5caf33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:44.951802 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bf260-6a27-4d6f-b184-fefb5f5caf33 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:44.980046 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1065/2125] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:44.984937 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c73f8-b6a5-4e8b-8530-ed9f5f8b9295 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:45.007019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c73f8-b6a5-4e8b-8530-ed9f5f8b9295 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:45.022972 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeb881-0e45-47f6-b6df-bdf07194347b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:45.023983 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeb881-0e45-47f6-b6df-bdf07194347b admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:45.024282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeb881-0e45-47f6-b6df-bdf07194347b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:45.024544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeb881-0e45-47f6-b6df-bdf07194347b admin admin] PATH_INFO: `/v3/projects/8bf88cf154664456a7bc8761cc6d9a37/users/8f8a8c338582484cb6fb9b455131fbce/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:45.060448 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feeb881-0e45-47f6-b6df-bdf07194347b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf88cf154664456a7bc8761cc6d9a37, user_id=8f8a8c338582484cb6fb9b455131fbce, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:45.063499 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feeb881-0e45-47f6-b6df-bdf07194347b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:45.099853 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1061/2126] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:44 2022] PUT /identity/v3/projects/8bf88cf154664456a7bc8761cc6d9a37/users/8f8a8c338582484cb6fb9b455131fbce/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:45.111654 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13349da-6d07-49a7-9b0f-e5e365d7712e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:45.111998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13349da-6d07-49a7-9b0f-e5e365d7712e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:45.112332 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13349da-6d07-49a7-9b0f-e5e365d7712e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:45.147754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b13349da-6d07-49a7-9b0f-e5e365d7712e None None] MFA Rules not processed for user `8f8a8c338582484cb6fb9b455131fbce`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:45.149622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b13349da-6d07-49a7-9b0f-e5e365d7712e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:45.263109 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeb881-0e45-47f6-b6df-bdf07194347b admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:45.279729 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1066/2127] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:45.378817 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeb881-0e45-47f6-b6df-bdf07194347b admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:45.393885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93849d9-0744-43ab-ada2-a1091c369ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:45.394890 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93849d9-0744-43ab-ada2-a1091c369ceb admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:45.395369 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93849d9-0744-43ab-ada2-a1091c369ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:45.395740 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93849d9-0744-43ab-ada2-a1091c369ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:45.397010 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93849d9-0744-43ab-ada2-a1091c369ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:45.398844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93849d9-0744-43ab-ada2-a1091c369ceb admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:45.434792 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1062/2128] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:45 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:45.438902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13349da-6d07-49a7-9b0f-e5e365d7712e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:45.451146 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13349da-6d07-49a7-9b0f-e5e365d7712e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:45.508125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:45.525777 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8588bbb-ba25-482b-ab68-7b1ef9bb84e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:45.526469 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8588bbb-ba25-482b-ab68-7b1ef9bb84e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:45.526826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8588bbb-ba25-482b-ab68-7b1ef9bb84e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:45.527108 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8588bbb-ba25-482b-ab68-7b1ef9bb84e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:45.527825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8588bbb-ba25-482b-ab68-7b1ef9bb84e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:45.529895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8588bbb-ba25-482b-ab68-7b1ef9bb84e5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:45.553845 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1067/2129] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:45 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:45.557966 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93849d9-0744-43ab-ada2-a1091c369ceb admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:45.570360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93849d9-0744-43ab-ada2-a1091c369ceb admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:45.575852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c41e62-7277-4f2a-844e-da14e0900e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:45.576563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c41e62-7277-4f2a-844e-da14e0900e62 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:45.576802 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c41e62-7277-4f2a-844e-da14e0900e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:45.577636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c41e62-7277-4f2a-844e-da14e0900e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:45.579045 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c41e62-7277-4f2a-844e-da14e0900e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:45.580686 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c41e62-7277-4f2a-844e-da14e0900e62 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:45.593892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1063/2130] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:45.598911 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8588bbb-ba25-482b-ab68-7b1ef9bb84e5 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:45.611089 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8588bbb-ba25-482b-ab68-7b1ef9bb84e5 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:45.616405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1915d-1684-49b2-bfd6-a250a2723c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:45.617680 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1915d-1684-49b2-bfd6-a250a2723c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:45.624763 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1915d-1684-49b2-bfd6-a250a2723c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:45.625075 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1915d-1684-49b2-bfd6-a250a2723c83 admin admin] PATH_INFO: `/v3/projects/db15b986693346659c1226f9172e5d74/users/167c35f7dd0149d49aa2e8719babc442/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:45.642426 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1915d-1684-49b2-bfd6-a250a2723c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db15b986693346659c1226f9172e5d74, user_id=167c35f7dd0149d49aa2e8719babc442, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:45.645301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1915d-1684-49b2-bfd6-a250a2723c83 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:45.674183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c41e62-7277-4f2a-844e-da14e0900e62 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:45.674754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1068/2131] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:45 2022] PUT /identity/v3/projects/db15b986693346659c1226f9172e5d74/users/167c35f7dd0149d49aa2e8719babc442/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:45.693227 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c41e62-7277-4f2a-844e-da14e0900e62 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:45.790694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc10ffa-8e02-42da-8bda-2823b44ce29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:45.792616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc10ffa-8e02-42da-8bda-2823b44ce29e admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:45.792616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc10ffa-8e02-42da-8bda-2823b44ce29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:45.792616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc10ffa-8e02-42da-8bda-2823b44ce29e admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:45.792616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc10ffa-8e02-42da-8bda-2823b44ce29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:45.794493 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc10ffa-8e02-42da-8bda-2823b44ce29e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:45.808548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1064/2132] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:45.812775 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1915d-1684-49b2-bfd6-a250a2723c83 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:45.838979 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1915d-1684-49b2-bfd6-a250a2723c83 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:45.852110 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fabc17-79f1-4820-bef4-82284bf17704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:45.856998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fabc17-79f1-4820-bef4-82284bf17704 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:45.857435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fabc17-79f1-4820-bef4-82284bf17704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:45.857800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fabc17-79f1-4820-bef4-82284bf17704 admin admin] PATH_INFO: `/v3/projects/db15b986693346659c1226f9172e5d74/users/167c35f7dd0149d49aa2e8719babc442/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:45.860330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fabc17-79f1-4820-bef4-82284bf17704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db15b986693346659c1226f9172e5d74, user_id=167c35f7dd0149d49aa2e8719babc442, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:45.868137 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fabc17-79f1-4820-bef4-82284bf17704 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:45.898053 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1069/2133] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:45 2022] PUT /identity/v3/projects/db15b986693346659c1226f9172e5d74/users/167c35f7dd0149d49aa2e8719babc442/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:45.911556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a56e84-b0b1-4199-aa8f-09e973c919da None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:45.912007 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a56e84-b0b1-4199-aa8f-09e973c919da None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:45.912465 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a56e84-b0b1-4199-aa8f-09e973c919da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:45.987444 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-62a56e84-b0b1-4199-aa8f-09e973c919da None None] MFA Rules not processed for user `167c35f7dd0149d49aa2e8719babc442`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:45.989402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-62a56e84-b0b1-4199-aa8f-09e973c919da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:46.023576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:46.101640 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1065/2134] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:46.122804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fabc17-79f1-4820-bef4-82284bf17704 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:46.125298 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c7fabc17-79f1-4820-bef4-82284bf17704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:46.223243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fabc17-79f1-4820-bef4-82284bf17704 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:46.227200 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4557e-5921-4f9a-9b4f-921989923f5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:46.227983 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4557e-5921-4f9a-9b4f-921989923f5a service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:46.228354 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4557e-5921-4f9a-9b4f-921989923f5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:46.228685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4557e-5921-4f9a-9b4f-921989923f5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:46.239145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4557e-5921-4f9a-9b4f-921989923f5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:46.240654 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4557e-5921-4f9a-9b4f-921989923f5a service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:46.250541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1070/2135] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:46.322046 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a56e84-b0b1-4199-aa8f-09e973c919da None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:46.346180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a56e84-b0b1-4199-aa8f-09e973c919da None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:46.353464 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08277f42-fe99-4793-920d-56cd2ea8c067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:46.354925 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08277f42-fe99-4793-920d-56cd2ea8c067 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:46.356110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08277f42-fe99-4793-920d-56cd2ea8c067 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:46.356508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08277f42-fe99-4793-920d-56cd2ea8c067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:46.452898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08277f42-fe99-4793-920d-56cd2ea8c067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:46.454427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08277f42-fe99-4793-920d-56cd2ea8c067 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:46.464163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1066/2136] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:46.843590 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4557e-5921-4f9a-9b4f-921989923f5a service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:46.906449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4557e-5921-4f9a-9b4f-921989923f5a service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:46.910949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58b63b-30ea-4d58-9880-a441be49fcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:46.911839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58b63b-30ea-4d58-9880-a441be49fcbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:46.912120 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58b63b-30ea-4d58-9880-a441be49fcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:46.912394 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58b63b-30ea-4d58-9880-a441be49fcbf admin admin] PATH_INFO: `/v3/users/8f8a8c338582484cb6fb9b455131fbce` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:46.913761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58b63b-30ea-4d58-9880-a441be49fcbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f8a8c338582484cb6fb9b455131fbce)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:46.915700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58b63b-30ea-4d58-9880-a441be49fcbf admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:46.964466 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:46.967061 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2d58b63b-30ea-4d58-9880-a441be49fcbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f8a8c338582484cb6fb9b455131fbce'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:46.968210 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2d58b63b-30ea-4d58-9880-a441be49fcbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f8a8c338582484cb6fb9b455131fbce'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:46.983125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2d58b63b-30ea-4d58-9880-a441be49fcbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f8a8c338582484cb6fb9b455131fbce'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:46.991651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2d58b63b-30ea-4d58-9880-a441be49fcbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f8a8c338582484cb6fb9b455131fbce'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:46.992994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2d58b63b-30ea-4d58-9880-a441be49fcbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f8a8c338582484cb6fb9b455131fbce'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.008964 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1071/2137] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:46 2022] DELETE /identity/v3/users/8f8a8c338582484cb6fb9b455131fbce => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:47.014132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89508ec5-a735-4bf2-b8fb-7a4ae8afa699 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:47.015270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89508ec5-a735-4bf2-b8fb-7a4ae8afa699 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:47.015270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89508ec5-a735-4bf2-b8fb-7a4ae8afa699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:47.038135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-89508ec5-a735-4bf2-b8fb-7a4ae8afa699 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:47.039624 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-89508ec5-a735-4bf2-b8fb-7a4ae8afa699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:47.108596 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1067/2138] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:47.118314 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58b63b-30ea-4d58-9880-a441be49fcbf admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:47.119772 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2d58b63b-30ea-4d58-9880-a441be49fcbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:47.183043 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58b63b-30ea-4d58-9880-a441be49fcbf admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:47.186732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1486f1-53f4-445a-a249-53359334c1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:47.187405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1486f1-53f4-445a-a249-53359334c1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:47.187689 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1486f1-53f4-445a-a249-53359334c1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:47.187966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1486f1-53f4-445a-a249-53359334c1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:47.197292 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1486f1-53f4-445a-a249-53359334c1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:47.198653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1486f1-53f4-445a-a249-53359334c1c9 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:47.208782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1072/2139] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:47.589349 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89508ec5-a735-4bf2-b8fb-7a4ae8afa699 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:47.591300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-89508ec5-a735-4bf2-b8fb-7a4ae8afa699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:47.608012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89508ec5-a735-4bf2-b8fb-7a4ae8afa699 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:47.613583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c9d09-b46c-4e00-aaa7-015af4a321a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:47.615378 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c9d09-b46c-4e00-aaa7-015af4a321a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:47.615658 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c9d09-b46c-4e00-aaa7-015af4a321a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:47.615962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c9d09-b46c-4e00-aaa7-015af4a321a9 admin admin] PATH_INFO: `/v3/projects/8bf88cf154664456a7bc8761cc6d9a37` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:47.617157 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c9d09-b46c-4e00-aaa7-015af4a321a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf88cf154664456a7bc8761cc6d9a37)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:47.619137 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c9d09-b46c-4e00-aaa7-015af4a321a9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:47.673885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-208c9d09-b46c-4e00-aaa7-015af4a321a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf88cf154664456a7bc8761cc6d9a37', 'request_id': 'req-208c9d09-b46c-4e00-aaa7-015af4a321a9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.678470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:47.679850 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-208c9d09-b46c-4e00-aaa7-015af4a321a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf88cf154664456a7bc8761cc6d9a37', 'request_id': 'req-208c9d09-b46c-4e00-aaa7-015af4a321a9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.687064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-208c9d09-b46c-4e00-aaa7-015af4a321a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf88cf154664456a7bc8761cc6d9a37', 'request_id': 'req-208c9d09-b46c-4e00-aaa7-015af4a321a9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.699679 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-208c9d09-b46c-4e00-aaa7-015af4a321a9 admin admin] The token cache is being invalidate because project 8bf88cf154664456a7bc8761cc6d9a37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:47.699967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-208c9d09-b46c-4e00-aaa7-015af4a321a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.700889 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-208c9d09-b46c-4e00-aaa7-015af4a321a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.702519 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1068/2140] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:47 2022] DELETE /identity/v3/projects/8bf88cf154664456a7bc8761cc6d9a37 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:47.706570 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1486f1-53f4-445a-a249-53359334c1c9 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:47.718129 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1486f1-53f4-445a-a249-53359334c1c9 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:47.798015 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc590959-a28d-470c-b842-5e13ddcd019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:47.799503 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc590959-a28d-470c-b842-5e13ddcd019b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:47.799720 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc590959-a28d-470c-b842-5e13ddcd019b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:47.800010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc590959-a28d-470c-b842-5e13ddcd019b admin admin] PATH_INFO: `/v3/users/167c35f7dd0149d49aa2e8719babc442` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:47.801421 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc590959-a28d-470c-b842-5e13ddcd019b admin admin] RBAC: Authorizing `identity:delete_user(user_id=167c35f7dd0149d49aa2e8719babc442)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:47.803701 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc590959-a28d-470c-b842-5e13ddcd019b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:47.869697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-dc590959-a28d-470c-b842-5e13ddcd019b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '167c35f7dd0149d49aa2e8719babc442'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.870369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-dc590959-a28d-470c-b842-5e13ddcd019b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '167c35f7dd0149d49aa2e8719babc442'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.882550 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-dc590959-a28d-470c-b842-5e13ddcd019b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '167c35f7dd0149d49aa2e8719babc442'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.884540 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:47.896265 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-dc590959-a28d-470c-b842-5e13ddcd019b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '167c35f7dd0149d49aa2e8719babc442'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.898424 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-dc590959-a28d-470c-b842-5e13ddcd019b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '167c35f7dd0149d49aa2e8719babc442'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.914091 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1073/2141] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:47 2022] DELETE /identity/v3/users/167c35f7dd0149d49aa2e8719babc442 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:48.295969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c9d09-b46c-4e00-aaa7-015af4a321a9 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:48.297485 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-208c9d09-b46c-4e00-aaa7-015af4a321a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:48.313511 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c9d09-b46c-4e00-aaa7-015af4a321a9 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:48.391321 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa564e-e191-47b3-86b6-c211509d4ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:48.392227 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa564e-e191-47b3-86b6-c211509d4ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:48.392511 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa564e-e191-47b3-86b6-c211509d4ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:48.392784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa564e-e191-47b3-86b6-c211509d4ccb admin admin] PATH_INFO: `/v3/projects/db15b986693346659c1226f9172e5d74` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:48.394038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa564e-e191-47b3-86b6-c211509d4ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=db15b986693346659c1226f9172e5d74)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:48.396032 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa564e-e191-47b3-86b6-c211509d4ccb admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:48.463544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-abaa564e-e191-47b3-86b6-c211509d4ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db15b986693346659c1226f9172e5d74', 'request_id': 'req-abaa564e-e191-47b3-86b6-c211509d4ccb'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:48.470644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-abaa564e-e191-47b3-86b6-c211509d4ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db15b986693346659c1226f9172e5d74', 'request_id': 'req-abaa564e-e191-47b3-86b6-c211509d4ccb'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:48.483096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-abaa564e-e191-47b3-86b6-c211509d4ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db15b986693346659c1226f9172e5d74', 'request_id': 'req-abaa564e-e191-47b3-86b6-c211509d4ccb'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:48.505322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-abaa564e-e191-47b3-86b6-c211509d4ccb admin admin] The token cache is being invalidate because project db15b986693346659c1226f9172e5d74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:48.505732 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-abaa564e-e191-47b3-86b6-c211509d4ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:48.506521 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-abaa564e-e191-47b3-86b6-c211509d4ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:48.508176 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1069/2142] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:48 2022] DELETE /identity/v3/projects/db15b986693346659c1226f9172e5d74 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:48.513758 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e12608-edfc-4d99-aac2-4b651819dbbd None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:48.514082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e12608-edfc-4d99-aac2-4b651819dbbd None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:48.514456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e12608-edfc-4d99-aac2-4b651819dbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:48.539902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d9e12608-edfc-4d99-aac2-4b651819dbbd None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:48.541538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d9e12608-edfc-4d99-aac2-4b651819dbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:48.657247 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1074/2143] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:48.667604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab97e16-2a42-4200-bdda-0870fdc975da None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:48.667964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab97e16-2a42-4200-bdda-0870fdc975da None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:48.668249 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab97e16-2a42-4200-bdda-0870fdc975da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:48.692027 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-0ab97e16-2a42-4200-bdda-0870fdc975da None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:48.693349 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0ab97e16-2a42-4200-bdda-0870fdc975da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:48.706124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1070/2144] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:48.708811 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e12608-edfc-4d99-aac2-4b651819dbbd None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:48.720944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e12608-edfc-4d99-aac2-4b651819dbbd None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:48.726402 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e7bfd-2802-48f4-b1be-f7580d23ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:48.727065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e7bfd-2802-48f4-b1be-f7580d23ce17 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:48.727379 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e7bfd-2802-48f4-b1be-f7580d23ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:48.727704 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e7bfd-2802-48f4-b1be-f7580d23ce17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:48.728623 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e7bfd-2802-48f4-b1be-f7580d23ce17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:48.728943 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e7bfd-2802-48f4-b1be-f7580d23ce17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:48.730620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e7bfd-2802-48f4-b1be-f7580d23ce17 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:48.755896 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1075/2145] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:28:48.757145 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab97e16-2a42-4200-bdda-0870fdc975da None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:48.768280 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab97e16-2a42-4200-bdda-0870fdc975da None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:48.774614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8f799-635c-4e0b-ba64-8d62339b1c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:48.775588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8f799-635c-4e0b-ba64-8d62339b1c55 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:48.777303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8f799-635c-4e0b-ba64-8d62339b1c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:48.777303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8f799-635c-4e0b-ba64-8d62339b1c55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:48.777303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8f799-635c-4e0b-ba64-8d62339b1c55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:48.779100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8f799-635c-4e0b-ba64-8d62339b1c55 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:48.811876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1071/2146] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:48 2022] POST /identity/v3/projects => generated 357 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:48.813828 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e7bfd-2802-48f4-b1be-f7580d23ce17 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:48.825023 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e7bfd-2802-48f4-b1be-f7580d23ce17 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:48.918210 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a13d7-2d12-43cc-82ae-5445342cf8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:48.921807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a13d7-2d12-43cc-82ae-5445342cf8e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:48.922063 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a13d7-2d12-43cc-82ae-5445342cf8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:48.922520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a13d7-2d12-43cc-82ae-5445342cf8e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:48.923558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a13d7-2d12-43cc-82ae-5445342cf8e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:48.926111 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a13d7-2d12-43cc-82ae-5445342cf8e8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:48.960722 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1076/2147] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:48 2022] POST /identity/v3/users => generated 279 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:48.974982 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8f799-635c-4e0b-ba64-8d62339b1c55 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:48.991116 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8f799-635c-4e0b-ba64-8d62339b1c55 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:48.997994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69042e-1735-4285-a4b0-4c2940dbc1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:48.999871 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69042e-1735-4285-a4b0-4c2940dbc1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.000363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69042e-1735-4285-a4b0-4c2940dbc1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.000859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69042e-1735-4285-a4b0-4c2940dbc1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.001825 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69042e-1735-4285-a4b0-4c2940dbc1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:49.004305 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69042e-1735-4285-a4b0-4c2940dbc1e8 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:49.018858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1072/2148] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:49.022428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a13d7-2d12-43cc-82ae-5445342cf8e8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:49.044444 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a13d7-2d12-43cc-82ae-5445342cf8e8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:49.053307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d0bfc-06ff-4822-899f-a06c7032e845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:49.053985 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d0bfc-06ff-4822-899f-a06c7032e845 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.054270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d0bfc-06ff-4822-899f-a06c7032e845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.054796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d0bfc-06ff-4822-899f-a06c7032e845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.055537 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d0bfc-06ff-4822-899f-a06c7032e845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:49.055854 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69042e-1735-4285-a4b0-4c2940dbc1e8 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:49.057338 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d0bfc-06ff-4822-899f-a06c7032e845 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:49.057694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6d69042e-1735-4285-a4b0-4c2940dbc1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:49.072616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69042e-1735-4285-a4b0-4c2940dbc1e8 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:49.078567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cfad6-f491-40a8-84e8-5d7502801459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:49.079805 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cfad6-f491-40a8-84e8-5d7502801459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.080431 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cfad6-f491-40a8-84e8-5d7502801459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.080431 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cfad6-f491-40a8-84e8-5d7502801459 admin admin] PATH_INFO: `/v3/users/b107ee99d00b4c25a21fbede7f5955db` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.081684 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7cfad6-f491-40a8-84e8-5d7502801459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b107ee99d00b4c25a21fbede7f5955db)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:49.082533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1077/2149] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:49.087470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d0bfc-06ff-4822-899f-a06c7032e845 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:49.088848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7cfad6-f491-40a8-84e8-5d7502801459 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:49.102616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d0bfc-06ff-4822-899f-a06c7032e845 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:49.109607 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d18de0-2fc8-4349-bb2e-559ebd2bf9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:49.115320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d18de0-2fc8-4349-bb2e-559ebd2bf9a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.115664 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d18de0-2fc8-4349-bb2e-559ebd2bf9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.115950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d18de0-2fc8-4349-bb2e-559ebd2bf9a7 admin admin] PATH_INFO: `/v3/projects/adce656e7685400a8a479283cc9429c4/users/b43376d0e05a43bcad3988f70ad984d7/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.142334 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:49.147714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d18de0-2fc8-4349-bb2e-559ebd2bf9a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adce656e7685400a8a479283cc9429c4, user_id=b43376d0e05a43bcad3988f70ad984d7, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:49.150505 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d18de0-2fc8-4349-bb2e-559ebd2bf9a7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:49.162982 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8d7cfad6-f491-40a8-84e8-5d7502801459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b107ee99d00b4c25a21fbede7f5955db'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:49.163706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8d7cfad6-f491-40a8-84e8-5d7502801459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b107ee99d00b4c25a21fbede7f5955db'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:49.171203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1078/2150] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:49 2022] PUT /identity/v3/projects/adce656e7685400a8a479283cc9429c4/users/b43376d0e05a43bcad3988f70ad984d7/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:49.181221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8d7cfad6-f491-40a8-84e8-5d7502801459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b107ee99d00b4c25a21fbede7f5955db'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:49.184557 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfccb9a-ea42-4743-aaa4-878495cdb394 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.184925 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfccb9a-ea42-4743-aaa4-878495cdb394 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.185375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8d7cfad6-f491-40a8-84e8-5d7502801459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b107ee99d00b4c25a21fbede7f5955db'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:49.185580 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfccb9a-ea42-4743-aaa4-878495cdb394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.204009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8d7cfad6-f491-40a8-84e8-5d7502801459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b107ee99d00b4c25a21fbede7f5955db'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:49.226116 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1073/2151] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:49 2022] DELETE /identity/v3/users/b107ee99d00b4c25a21fbede7f5955db => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:49.229642 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1cfccb9a-ea42-4743-aaa4-878495cdb394 None None] MFA Rules not processed for user `b43376d0e05a43bcad3988f70ad984d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:49.231269 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e12101-e504-4a84-8d53-cbb051b3e091 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.231415 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1cfccb9a-ea42-4743-aaa4-878495cdb394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:49.231573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e12101-e504-4a84-8d53-cbb051b3e091 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.231803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e12101-e504-4a84-8d53-cbb051b3e091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.254621 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:49.262598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a2e12101-e504-4a84-8d53-cbb051b3e091 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:49.263905 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a2e12101-e504-4a84-8d53-cbb051b3e091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:49.346911 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1079/2152] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:49 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:49.380002 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfccb9a-ea42-4743-aaa4-878495cdb394 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:49.381623 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1cfccb9a-ea42-4743-aaa4-878495cdb394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:49.388790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1074/2153] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:49.399576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e12101-e504-4a84-8d53-cbb051b3e091 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:49.401440 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a2e12101-e504-4a84-8d53-cbb051b3e091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:49.460192 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfccb9a-ea42-4743-aaa4-878495cdb394 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:49.465134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062511a0-ca57-4665-a633-f79417b1a9b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:49.465828 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062511a0-ca57-4665-a633-f79417b1a9b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.466106 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062511a0-ca57-4665-a633-f79417b1a9b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.466376 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062511a0-ca57-4665-a633-f79417b1a9b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.478488 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062511a0-ca57-4665-a633-f79417b1a9b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:49.480512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062511a0-ca57-4665-a633-f79417b1a9b4 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:49.491132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e12101-e504-4a84-8d53-cbb051b3e091 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:49.493498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1080/2154] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:49 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:49.495745 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59145c-e4c9-4658-a62c-7559e714e4ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:49.496956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59145c-e4c9-4658-a62c-7559e714e4ae service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.497645 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59145c-e4c9-4658-a62c-7559e714e4ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.498037 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59145c-e4c9-4658-a62c-7559e714e4ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.508256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062511a0-ca57-4665-a633-f79417b1a9b4 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:49.509611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59145c-e4c9-4658-a62c-7559e714e4ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:49.510553 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-062511a0-ca57-4665-a633-f79417b1a9b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:49.511063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59145c-e4c9-4658-a62c-7559e714e4ae service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:49.524425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1075/2155] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:49.529514 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062511a0-ca57-4665-a633-f79417b1a9b4 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:49.537111 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d25f0-a722-44db-96be-ae01330c5ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:49.537971 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d25f0-a722-44db-96be-ae01330c5ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.538272 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d25f0-a722-44db-96be-ae01330c5ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.538637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d25f0-a722-44db-96be-ae01330c5ff9 admin admin] PATH_INFO: `/v3/users/b43376d0e05a43bcad3988f70ad984d7` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.539879 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d25f0-a722-44db-96be-ae01330c5ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b43376d0e05a43bcad3988f70ad984d7)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:49.542096 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d25f0-a722-44db-96be-ae01330c5ff9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:49.618762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6c2d25f0-a722-44db-96be-ae01330c5ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b43376d0e05a43bcad3988f70ad984d7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:49.619499 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6c2d25f0-a722-44db-96be-ae01330c5ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b43376d0e05a43bcad3988f70ad984d7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:49.637416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6c2d25f0-a722-44db-96be-ae01330c5ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b43376d0e05a43bcad3988f70ad984d7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:49.646427 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6c2d25f0-a722-44db-96be-ae01330c5ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b43376d0e05a43bcad3988f70ad984d7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:49.647313 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6c2d25f0-a722-44db-96be-ae01330c5ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b43376d0e05a43bcad3988f70ad984d7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:49.666216 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1081/2156] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:49 2022] DELETE /identity/v3/users/b43376d0e05a43bcad3988f70ad984d7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:49.671274 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155426f-0e6d-4e7c-9e30-304c85bae380 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.671589 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155426f-0e6d-4e7c-9e30-304c85bae380 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.671870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155426f-0e6d-4e7c-9e30-304c85bae380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.704928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8155426f-0e6d-4e7c-9e30-304c85bae380 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:49.707135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8155426f-0e6d-4e7c-9e30-304c85bae380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:49.774897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:49.796577 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1076/2157] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:49.809398 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d25f0-a722-44db-96be-ae01330c5ff9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:49.811032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6c2d25f0-a722-44db-96be-ae01330c5ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:49.875556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:49.922490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d25f0-a722-44db-96be-ae01330c5ff9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:49.927013 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318836a9-718e-4f98-b630-dfce58e1a7d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:49.927706 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318836a9-718e-4f98-b630-dfce58e1a7d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.927975 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318836a9-718e-4f98-b630-dfce58e1a7d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.928245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318836a9-718e-4f98-b630-dfce58e1a7d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.943179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318836a9-718e-4f98-b630-dfce58e1a7d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:49.944765 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318836a9-718e-4f98-b630-dfce58e1a7d6 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:49.970557 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1082/2158] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:50.084569 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155426f-0e6d-4e7c-9e30-304c85bae380 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:50.086707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8155426f-0e6d-4e7c-9e30-304c85bae380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:50.115659 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155426f-0e6d-4e7c-9e30-304c85bae380 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:50.121820 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b25119-9c24-46c0-a5f9-0666adc0b676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:50.123029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b25119-9c24-46c0-a5f9-0666adc0b676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:50.123431 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b25119-9c24-46c0-a5f9-0666adc0b676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:50.123799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b25119-9c24-46c0-a5f9-0666adc0b676 admin admin] PATH_INFO: `/v3/projects/66db2d3f612342d6b7a05596abe46964` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:50.125183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b25119-9c24-46c0-a5f9-0666adc0b676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66db2d3f612342d6b7a05596abe46964)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:50.127706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b25119-9c24-46c0-a5f9-0666adc0b676 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:50.203392 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-87b25119-9c24-46c0-a5f9-0666adc0b676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66db2d3f612342d6b7a05596abe46964', 'request_id': 'req-87b25119-9c24-46c0-a5f9-0666adc0b676'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:50.226297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-87b25119-9c24-46c0-a5f9-0666adc0b676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66db2d3f612342d6b7a05596abe46964', 'request_id': 'req-87b25119-9c24-46c0-a5f9-0666adc0b676'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:50.237753 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-87b25119-9c24-46c0-a5f9-0666adc0b676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66db2d3f612342d6b7a05596abe46964', 'request_id': 'req-87b25119-9c24-46c0-a5f9-0666adc0b676'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:50.265643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-87b25119-9c24-46c0-a5f9-0666adc0b676 admin admin] The token cache is being invalidate because project 66db2d3f612342d6b7a05596abe46964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:50.266277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-87b25119-9c24-46c0-a5f9-0666adc0b676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:50.267121 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-87b25119-9c24-46c0-a5f9-0666adc0b676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:50.276829 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1077/2159] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:50 2022] DELETE /identity/v3/projects/66db2d3f612342d6b7a05596abe46964 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:50.280775 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0034e-c842-44ca-a3f4-1b1bace87770 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:50.281416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0034e-c842-44ca-a3f4-1b1bace87770 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:50.281700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0034e-c842-44ca-a3f4-1b1bace87770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:50.306377 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-3eb0034e-c842-44ca-a3f4-1b1bace87770 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:50.307596 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3eb0034e-c842-44ca-a3f4-1b1bace87770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:50.408247 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1083/2160] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:50.416407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62210b0f-5def-48f7-a72f-34c6c01b8f3e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:50.417147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62210b0f-5def-48f7-a72f-34c6c01b8f3e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:50.417529 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62210b0f-5def-48f7-a72f-34c6c01b8f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:50.439322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-62210b0f-5def-48f7-a72f-34c6c01b8f3e None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:50.440807 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-62210b0f-5def-48f7-a72f-34c6c01b8f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:50.450525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1078/2161] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:50.455078 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0034e-c842-44ca-a3f4-1b1bace87770 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:50.465372 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0034e-c842-44ca-a3f4-1b1bace87770 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:50.472725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fc527-d9b8-4b2f-bf24-fd3d4033cb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:50.473420 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fc527-d9b8-4b2f-bf24-fd3d4033cb91 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:50.473714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fc527-d9b8-4b2f-bf24-fd3d4033cb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:50.473981 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fc527-d9b8-4b2f-bf24-fd3d4033cb91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:50.474786 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fc527-d9b8-4b2f-bf24-fd3d4033cb91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:50.475094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fc527-d9b8-4b2f-bf24-fd3d4033cb91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:50.476758 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fc527-d9b8-4b2f-bf24-fd3d4033cb91 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:50.489343 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1084/2162] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:28:50.493865 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62210b0f-5def-48f7-a72f-34c6c01b8f3e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:50.504348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62210b0f-5def-48f7-a72f-34c6c01b8f3e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:50.509548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf6b1a-b459-42e1-86b8-91748abb1440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:50.510320 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf6b1a-b459-42e1-86b8-91748abb1440 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:50.510552 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf6b1a-b459-42e1-86b8-91748abb1440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:50.510824 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf6b1a-b459-42e1-86b8-91748abb1440 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:50.511517 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf6b1a-b459-42e1-86b8-91748abb1440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:50.514996 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf6b1a-b459-42e1-86b8-91748abb1440 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:50.547237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1079/2163] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:50 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:28:50.552864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fc527-d9b8-4b2f-bf24-fd3d4033cb91 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:50.571452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf6b1a-b459-42e1-86b8-91748abb1440 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:50.574481 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0ecf6b1a-b459-42e1-86b8-91748abb1440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:50.602614 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fc527-d9b8-4b2f-bf24-fd3d4033cb91 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:50.688047 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf6b1a-b459-42e1-86b8-91748abb1440 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:50.691228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585104e-9405-4226-9d86-2db2558a5ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:50.692233 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585104e-9405-4226-9d86-2db2558a5ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:50.692692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585104e-9405-4226-9d86-2db2558a5ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:50.693113 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585104e-9405-4226-9d86-2db2558a5ac0 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:50.693295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355be40f-991e-4dde-9806-df96a5c40360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:50.694129 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585104e-9405-4226-9d86-2db2558a5ac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:50.694439 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355be40f-991e-4dde-9806-df96a5c40360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:50.694786 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355be40f-991e-4dde-9806-df96a5c40360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:50.695249 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355be40f-991e-4dde-9806-df96a5c40360 admin admin] PATH_INFO: `/v3/projects/adce656e7685400a8a479283cc9429c4` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:50.697622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585104e-9405-4226-9d86-2db2558a5ac0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:50.698626 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355be40f-991e-4dde-9806-df96a5c40360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adce656e7685400a8a479283cc9429c4)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:50.700936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355be40f-991e-4dde-9806-df96a5c40360 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:50.730645 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1085/2164] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:50 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:50.731892 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585104e-9405-4226-9d86-2db2558a5ac0 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:50.749855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585104e-9405-4226-9d86-2db2558a5ac0 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:50.756841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c35cbe-4441-49dd-aa01-0c2f7b9915e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:50.757899 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c35cbe-4441-49dd-aa01-0c2f7b9915e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:50.758243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c35cbe-4441-49dd-aa01-0c2f7b9915e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:50.761015 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c35cbe-4441-49dd-aa01-0c2f7b9915e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:50.762101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c35cbe-4441-49dd-aa01-0c2f7b9915e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:50.763703 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c35cbe-4441-49dd-aa01-0c2f7b9915e9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:50.777932 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1086/2165] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:50.784132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c35cbe-4441-49dd-aa01-0c2f7b9915e9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:50.784998 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:50.790097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-355be40f-991e-4dde-9806-df96a5c40360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adce656e7685400a8a479283cc9429c4', 'request_id': 'req-355be40f-991e-4dde-9806-df96a5c40360'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:50.801957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-355be40f-991e-4dde-9806-df96a5c40360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adce656e7685400a8a479283cc9429c4', 'request_id': 'req-355be40f-991e-4dde-9806-df96a5c40360'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:50.802152 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c35cbe-4441-49dd-aa01-0c2f7b9915e9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:50.810149 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-355be40f-991e-4dde-9806-df96a5c40360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adce656e7685400a8a479283cc9429c4', 'request_id': 'req-355be40f-991e-4dde-9806-df96a5c40360'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:50.831463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-355be40f-991e-4dde-9806-df96a5c40360 admin admin] The token cache is being invalidate because project adce656e7685400a8a479283cc9429c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:50.831821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-355be40f-991e-4dde-9806-df96a5c40360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:50.832833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-355be40f-991e-4dde-9806-df96a5c40360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:50.834979 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1080/2166] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:50 2022] DELETE /identity/v3/projects/adce656e7685400a8a479283cc9429c4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:50.866030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:50.891293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2108d-e8c6-4358-b3d0-709f646c2138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:50.892115 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2108d-e8c6-4358-b3d0-709f646c2138 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:50.892461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2108d-e8c6-4358-b3d0-709f646c2138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:50.893418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2108d-e8c6-4358-b3d0-709f646c2138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:50.894170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2108d-e8c6-4358-b3d0-709f646c2138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:50.896362 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2108d-e8c6-4358-b3d0-709f646c2138 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:50.907488 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1087/2167] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:28:50.912096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355be40f-991e-4dde-9806-df96a5c40360 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:50.913599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-355be40f-991e-4dde-9806-df96a5c40360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:50.953103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355be40f-991e-4dde-9806-df96a5c40360 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:50.969605 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38488481-89a4-4bac-b4bf-205161a1279a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:50.970831 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38488481-89a4-4bac-b4bf-205161a1279a admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:50.971270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38488481-89a4-4bac-b4bf-205161a1279a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:50.971647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38488481-89a4-4bac-b4bf-205161a1279a admin admin] PATH_INFO: `/v3/projects/dd9aae147d6d4d3885d5780d08d2c6ad/users/a9c7ca3570c2417fb54328d939382a1c/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:51.005928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38488481-89a4-4bac-b4bf-205161a1279a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd9aae147d6d4d3885d5780d08d2c6ad, user_id=a9c7ca3570c2417fb54328d939382a1c, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:51.009377 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38488481-89a4-4bac-b4bf-205161a1279a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:51.026113 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1081/2168] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:50 2022] PUT /identity/v3/projects/dd9aae147d6d4d3885d5780d08d2c6ad/users/a9c7ca3570c2417fb54328d939382a1c/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:51.040972 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca7b4f-409b-4f77-8499-3ccfd6e4d0d3 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:51.041521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca7b4f-409b-4f77-8499-3ccfd6e4d0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:51.044596 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca7b4f-409b-4f77-8499-3ccfd6e4d0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:51.101368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-deca7b4f-409b-4f77-8499-3ccfd6e4d0d3 None None] MFA Rules not processed for user `a9c7ca3570c2417fb54328d939382a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:51.102389 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-deca7b4f-409b-4f77-8499-3ccfd6e4d0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:51.189037 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1088/2169] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:51.200765 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38488481-89a4-4bac-b4bf-205161a1279a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:51.202534 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-38488481-89a4-4bac-b4bf-205161a1279a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:51.283858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38488481-89a4-4bac-b4bf-205161a1279a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:51.287706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c810c9-b622-416f-ba69-20ac9f809318 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5602d0a51329412ab6e908e7787531a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:51.288390 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c810c9-b622-416f-ba69-20ac9f809318 service glance] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:51.288733 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c810c9-b622-416f-ba69-20ac9f809318 service glance] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:51.289003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c810c9-b622-416f-ba69-20ac9f809318 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:51.299184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c810c9-b622-416f-ba69-20ac9f809318 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:51.300553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c810c9-b622-416f-ba69-20ac9f809318 service glance] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:51.310314 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1082/2170] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:51.849621 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca7b4f-409b-4f77-8499-3ccfd6e4d0d3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:51.851440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-deca7b4f-409b-4f77-8499-3ccfd6e4d0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:51.990896 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca7b4f-409b-4f77-8499-3ccfd6e4d0d3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:51.995796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5fc58-5004-4b45-a64c-9811d1ab6e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:51.996878 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5fc58-5004-4b45-a64c-9811d1ab6e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:51.997166 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5fc58-5004-4b45-a64c-9811d1ab6e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:51.997477 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5fc58-5004-4b45-a64c-9811d1ab6e02 admin admin] PATH_INFO: `/v3/users/e250af22fd024a8d9d2ae3a18c2d5f67` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:51.998735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5fc58-5004-4b45-a64c-9811d1ab6e02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e250af22fd024a8d9d2ae3a18c2d5f67)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:52.000975 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5fc58-5004-4b45-a64c-9811d1ab6e02 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:52.057936 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-40f5fc58-5004-4b45-a64c-9811d1ab6e02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e250af22fd024a8d9d2ae3a18c2d5f67'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:52.058599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-40f5fc58-5004-4b45-a64c-9811d1ab6e02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e250af22fd024a8d9d2ae3a18c2d5f67'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:52.076949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-40f5fc58-5004-4b45-a64c-9811d1ab6e02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e250af22fd024a8d9d2ae3a18c2d5f67'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:52.079094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:52.086517 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-40f5fc58-5004-4b45-a64c-9811d1ab6e02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e250af22fd024a8d9d2ae3a18c2d5f67'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:52.087274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-40f5fc58-5004-4b45-a64c-9811d1ab6e02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e250af22fd024a8d9d2ae3a18c2d5f67'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:52.109930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1089/2171] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:51 2022] DELETE /identity/v3/users/e250af22fd024a8d9d2ae3a18c2d5f67 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:52.111658 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845304db-2ebb-42f3-9f7a-12c18b6744c0 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:52.112029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845304db-2ebb-42f3-9f7a-12c18b6744c0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:52.112240 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845304db-2ebb-42f3-9f7a-12c18b6744c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:52.135356 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-845304db-2ebb-42f3-9f7a-12c18b6744c0 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:52.136935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-845304db-2ebb-42f3-9f7a-12c18b6744c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:52.250014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1083/2172] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:52.264529 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5fc58-5004-4b45-a64c-9811d1ab6e02 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:52.265997 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-40f5fc58-5004-4b45-a64c-9811d1ab6e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:52.340352 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5fc58-5004-4b45-a64c-9811d1ab6e02 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:52.344147 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ee904-07d6-460c-9f21-7f40d4e9f119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:52.344801 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ee904-07d6-460c-9f21-7f40d4e9f119 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:52.345081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ee904-07d6-460c-9f21-7f40d4e9f119 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:52.345461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ee904-07d6-460c-9f21-7f40d4e9f119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:52.356278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ee904-07d6-460c-9f21-7f40d4e9f119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:52.357776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ee904-07d6-460c-9f21-7f40d4e9f119 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:52.370673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1090/2173] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:52.726435 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845304db-2ebb-42f3-9f7a-12c18b6744c0 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:52.728048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-845304db-2ebb-42f3-9f7a-12c18b6744c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:52.745008 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845304db-2ebb-42f3-9f7a-12c18b6744c0 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:52.757233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26f384-b5a9-4d54-b6b1-7d9cf259e321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:52.758136 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26f384-b5a9-4d54-b6b1-7d9cf259e321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:52.758432 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26f384-b5a9-4d54-b6b1-7d9cf259e321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:52.758679 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26f384-b5a9-4d54-b6b1-7d9cf259e321 admin admin] PATH_INFO: `/v3/projects/cf158029cacb409caf388cebb771b067` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:52.759876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26f384-b5a9-4d54-b6b1-7d9cf259e321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf158029cacb409caf388cebb771b067)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:52.762908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26f384-b5a9-4d54-b6b1-7d9cf259e321 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:52.824953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-eb26f384-b5a9-4d54-b6b1-7d9cf259e321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf158029cacb409caf388cebb771b067', 'request_id': 'req-eb26f384-b5a9-4d54-b6b1-7d9cf259e321'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:52.826580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:52.833201 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-eb26f384-b5a9-4d54-b6b1-7d9cf259e321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf158029cacb409caf388cebb771b067', 'request_id': 'req-eb26f384-b5a9-4d54-b6b1-7d9cf259e321'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:52.844240 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-eb26f384-b5a9-4d54-b6b1-7d9cf259e321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf158029cacb409caf388cebb771b067', 'request_id': 'req-eb26f384-b5a9-4d54-b6b1-7d9cf259e321'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:52.861725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-eb26f384-b5a9-4d54-b6b1-7d9cf259e321 admin admin] The token cache is being invalidate because project cf158029cacb409caf388cebb771b067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:52.862118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-eb26f384-b5a9-4d54-b6b1-7d9cf259e321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:52.862680 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-eb26f384-b5a9-4d54-b6b1-7d9cf259e321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:52.865242 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1084/2174] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:52 2022] DELETE /identity/v3/projects/cf158029cacb409caf388cebb771b067 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:52.869397 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ee904-07d6-460c-9f21-7f40d4e9f119 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:52.881191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ee904-07d6-460c-9f21-7f40d4e9f119 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:52.954693 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699ec3b-15cd-4edd-ade8-c1a4adce5c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:52.955638 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699ec3b-15cd-4edd-ade8-c1a4adce5c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:52.955925 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699ec3b-15cd-4edd-ade8-c1a4adce5c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:52.956204 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699ec3b-15cd-4edd-ade8-c1a4adce5c2d admin admin] PATH_INFO: `/v3/users/74642fddc4c84d9ab82762e412729bf3` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:52.957883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699ec3b-15cd-4edd-ade8-c1a4adce5c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=74642fddc4c84d9ab82762e412729bf3)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:52.959786 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699ec3b-15cd-4edd-ade8-c1a4adce5c2d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:53.057322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1699ec3b-15cd-4edd-ade8-c1a4adce5c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74642fddc4c84d9ab82762e412729bf3'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:53.058640 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1699ec3b-15cd-4edd-ade8-c1a4adce5c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74642fddc4c84d9ab82762e412729bf3'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:53.085122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1699ec3b-15cd-4edd-ade8-c1a4adce5c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74642fddc4c84d9ab82762e412729bf3'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:53.096739 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1699ec3b-15cd-4edd-ade8-c1a4adce5c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74642fddc4c84d9ab82762e412729bf3'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:53.097607 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1699ec3b-15cd-4edd-ade8-c1a4adce5c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74642fddc4c84d9ab82762e412729bf3'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:53.113728 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1091/2175] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:52 2022] DELETE /identity/v3/users/74642fddc4c84d9ab82762e412729bf3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:53.438081 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26f384-b5a9-4d54-b6b1-7d9cf259e321 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:53.440102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-eb26f384-b5a9-4d54-b6b1-7d9cf259e321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:53.457099 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26f384-b5a9-4d54-b6b1-7d9cf259e321 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:53.599144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964aef0-c539-4e70-87f3-887fe780290b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:53.600312 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964aef0-c539-4e70-87f3-887fe780290b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:53.600312 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964aef0-c539-4e70-87f3-887fe780290b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:53.600741 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964aef0-c539-4e70-87f3-887fe780290b admin admin] PATH_INFO: `/v3/projects/0e52476f36d94e7fa2453febae1b4328` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:53.602518 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964aef0-c539-4e70-87f3-887fe780290b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e52476f36d94e7fa2453febae1b4328)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:53.604385 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964aef0-c539-4e70-87f3-887fe780290b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:53.671674 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f964aef0-c539-4e70-87f3-887fe780290b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e52476f36d94e7fa2453febae1b4328', 'request_id': 'req-f964aef0-c539-4e70-87f3-887fe780290b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:53.678709 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f964aef0-c539-4e70-87f3-887fe780290b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e52476f36d94e7fa2453febae1b4328', 'request_id': 'req-f964aef0-c539-4e70-87f3-887fe780290b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:53.686674 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f964aef0-c539-4e70-87f3-887fe780290b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e52476f36d94e7fa2453febae1b4328', 'request_id': 'req-f964aef0-c539-4e70-87f3-887fe780290b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:53.705096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f964aef0-c539-4e70-87f3-887fe780290b admin admin] The token cache is being invalidate because project 0e52476f36d94e7fa2453febae1b4328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:53.705096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f964aef0-c539-4e70-87f3-887fe780290b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:53.706061 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f964aef0-c539-4e70-87f3-887fe780290b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:53.708294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1085/2176] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:53 2022] DELETE /identity/v3/projects/0e52476f36d94e7fa2453febae1b4328 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:53.713187 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a6eed-41a9-48f7-a133-13aeb0ca7146 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:53.714221 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a6eed-41a9-48f7-a133-13aeb0ca7146 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:53.714503 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a6eed-41a9-48f7-a133-13aeb0ca7146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:53.733403 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:53.740038 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9e2a6eed-41a9-48f7-a133-13aeb0ca7146 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:53.743808 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9e2a6eed-41a9-48f7-a133-13aeb0ca7146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:53.827458 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1092/2177] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:28:53.836784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60e094-a688-4fa9-b5c8-2149de3923e2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:53.837076 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60e094-a688-4fa9-b5c8-2149de3923e2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:53.837394 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60e094-a688-4fa9-b5c8-2149de3923e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:53.860683 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-7f60e094-a688-4fa9-b5c8-2149de3923e2 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:53.862001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7f60e094-a688-4fa9-b5c8-2149de3923e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:53.876087 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1086/2178] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:53.877277 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a6eed-41a9-48f7-a133-13aeb0ca7146 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:53.888281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a6eed-41a9-48f7-a133-13aeb0ca7146 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:53.895466 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220041bf-f6b7-4fea-b694-57ea375dc70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:53.896345 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220041bf-f6b7-4fea-b694-57ea375dc70d admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:53.896732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220041bf-f6b7-4fea-b694-57ea375dc70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:53.897116 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220041bf-f6b7-4fea-b694-57ea375dc70d admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:53.898031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220041bf-f6b7-4fea-b694-57ea375dc70d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:53.898450 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220041bf-f6b7-4fea-b694-57ea375dc70d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:53.900246 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220041bf-f6b7-4fea-b694-57ea375dc70d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:53.921295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60e094-a688-4fa9-b5c8-2149de3923e2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:53.927426 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1093/2179] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:28:53.932144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60e094-a688-4fa9-b5c8-2149de3923e2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:53.940465 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc8325-6c8b-458b-a22c-50a1ef57ce73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:53.941249 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc8325-6c8b-458b-a22c-50a1ef57ce73 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:53.941558 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc8325-6c8b-458b-a22c-50a1ef57ce73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:53.941833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc8325-6c8b-458b-a22c-50a1ef57ce73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:53.942552 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc8325-6c8b-458b-a22c-50a1ef57ce73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:53.944492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc8325-6c8b-458b-a22c-50a1ef57ce73 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:53.989628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1087/2180] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:53 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:28:53.991138 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220041bf-f6b7-4fea-b694-57ea375dc70d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:54.002563 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220041bf-f6b7-4fea-b694-57ea375dc70d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:54.070361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4d893-a102-4ec4-ad19-75a0dff242e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:54.071209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4d893-a102-4ec4-ad19-75a0dff242e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:54.078301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4d893-a102-4ec4-ad19-75a0dff242e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:54.078846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4d893-a102-4ec4-ad19-75a0dff242e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:54.079746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4d893-a102-4ec4-ad19-75a0dff242e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:54.083789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4d893-a102-4ec4-ad19-75a0dff242e4 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:54.128019 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1094/2181] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:53 2022] POST /identity/v3/users => generated 283 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:54.132038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc8325-6c8b-458b-a22c-50a1ef57ce73 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:54.151026 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc8325-6c8b-458b-a22c-50a1ef57ce73 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:54.156554 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3b58e-4c37-4ee7-8a18-c1aa2eccd9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:54.157558 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3b58e-4c37-4ee7-8a18-c1aa2eccd9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:54.157681 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3b58e-4c37-4ee7-8a18-c1aa2eccd9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:54.157915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3b58e-4c37-4ee7-8a18-c1aa2eccd9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:54.158654 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3b58e-4c37-4ee7-8a18-c1aa2eccd9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:54.160353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3b58e-4c37-4ee7-8a18-c1aa2eccd9b3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:54.175794 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1088/2182] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:54.177319 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4d893-a102-4ec4-ad19-75a0dff242e4 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:54.190435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4d893-a102-4ec4-ad19-75a0dff242e4 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:54.203706 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e37a18-51bc-4079-812c-525d019125d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:54.204402 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e37a18-51bc-4079-812c-525d019125d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:54.204687 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e37a18-51bc-4079-812c-525d019125d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:54.204966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e37a18-51bc-4079-812c-525d019125d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:54.205806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e37a18-51bc-4079-812c-525d019125d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:54.208849 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e37a18-51bc-4079-812c-525d019125d5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:54.225413 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3b58e-4c37-4ee7-8a18-c1aa2eccd9b3 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:54.231624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1095/2183] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:54.252436 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3b58e-4c37-4ee7-8a18-c1aa2eccd9b3 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:54.260043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5734e-f369-478c-820c-81039c818262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:54.260964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5734e-f369-478c-820c-81039c818262 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:54.261284 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5734e-f369-478c-820c-81039c818262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:54.261589 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5734e-f369-478c-820c-81039c818262 admin admin] PATH_INFO: `/v3/projects/368f024c633146e4bd9668fc560d4c5e/users/63d35a2ad5e149dcb1e809d2a7fc4a3e/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:54.280650 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5734e-f369-478c-820c-81039c818262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=368f024c633146e4bd9668fc560d4c5e, user_id=63d35a2ad5e149dcb1e809d2a7fc4a3e, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:54.284113 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5734e-f369-478c-820c-81039c818262 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:54.314742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1089/2184] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:54 2022] PUT /identity/v3/projects/368f024c633146e4bd9668fc560d4c5e/users/63d35a2ad5e149dcb1e809d2a7fc4a3e/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:54.326073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6d7fe-c7f2-429b-9c7b-6e0328c6c9e2 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:54.326378 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6d7fe-c7f2-429b-9c7b-6e0328c6c9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:54.326665 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6d7fe-c7f2-429b-9c7b-6e0328c6c9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:54.374686 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9cc6d7fe-c7f2-429b-9c7b-6e0328c6c9e2 None None] MFA Rules not processed for user `63d35a2ad5e149dcb1e809d2a7fc4a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:54.376035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9cc6d7fe-c7f2-429b-9c7b-6e0328c6c9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:54.501586 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5734e-f369-478c-820c-81039c818262 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:54.509550 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:54.510214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1096/2185] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:54.636337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5734e-f369-478c-820c-81039c818262 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:54.656553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64eb2d-c10e-41c3-90e3-6793560e29c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:54.656553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64eb2d-c10e-41c3-90e3-6793560e29c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:54.656553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64eb2d-c10e-41c3-90e3-6793560e29c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:54.656553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64eb2d-c10e-41c3-90e3-6793560e29c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:54.657047 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64eb2d-c10e-41c3-90e3-6793560e29c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:54.657047 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64eb2d-c10e-41c3-90e3-6793560e29c2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:54.706169 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1090/2186] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:54 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:54.710624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6d7fe-c7f2-429b-9c7b-6e0328c6c9e2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:54.716388 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:54.728130 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6d7fe-c7f2-429b-9c7b-6e0328c6c9e2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:54.824929 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06854d0-b12e-4b14-a335-53dd71e2326d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:54.827332 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06854d0-b12e-4b14-a335-53dd71e2326d admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:54.827744 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06854d0-b12e-4b14-a335-53dd71e2326d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:54.830377 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06854d0-b12e-4b14-a335-53dd71e2326d admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:54.831412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06854d0-b12e-4b14-a335-53dd71e2326d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:54.834182 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06854d0-b12e-4b14-a335-53dd71e2326d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:54.872961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1097/2187] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:54 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:54.876960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64eb2d-c10e-41c3-90e3-6793560e29c2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:54.892995 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64eb2d-c10e-41c3-90e3-6793560e29c2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:54.899871 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a8355-c172-4479-8397-51a054c2b360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:54.900525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a8355-c172-4479-8397-51a054c2b360 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:54.900806 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a8355-c172-4479-8397-51a054c2b360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:54.901700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a8355-c172-4479-8397-51a054c2b360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:54.901834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a8355-c172-4479-8397-51a054c2b360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:54.903447 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a8355-c172-4479-8397-51a054c2b360 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:54.920593 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1091/2188] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:54.921299 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06854d0-b12e-4b14-a335-53dd71e2326d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:54.931920 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06854d0-b12e-4b14-a335-53dd71e2326d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:54.937582 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639a752-2ecf-417e-b847-7e0558a18679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:54.938478 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639a752-2ecf-417e-b847-7e0558a18679 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:54.938937 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639a752-2ecf-417e-b847-7e0558a18679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:54.939037 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639a752-2ecf-417e-b847-7e0558a18679 admin admin] PATH_INFO: `/v3/projects/ee15aeabd66440e7a73606a610097145/users/70f22e469ab84822a387d9f1a599ad03/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:54.960882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639a752-2ecf-417e-b847-7e0558a18679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee15aeabd66440e7a73606a610097145, user_id=70f22e469ab84822a387d9f1a599ad03, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:54.961685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639a752-2ecf-417e-b847-7e0558a18679 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:55.018700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1098/2189] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:54 2022] PUT /identity/v3/projects/ee15aeabd66440e7a73606a610097145/users/70f22e469ab84822a387d9f1a599ad03/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:55.025229 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a8355-c172-4479-8397-51a054c2b360 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:55.053771 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a8355-c172-4479-8397-51a054c2b360 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:55.171533 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824e07e-60c8-445d-b57c-3dad16c2b330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:55.172253 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824e07e-60c8-445d-b57c-3dad16c2b330 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:55.172507 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824e07e-60c8-445d-b57c-3dad16c2b330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:55.172786 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824e07e-60c8-445d-b57c-3dad16c2b330 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:55.173569 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824e07e-60c8-445d-b57c-3dad16c2b330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:55.175193 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824e07e-60c8-445d-b57c-3dad16c2b330 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:55.197874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1092/2190] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:55.202939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639a752-2ecf-417e-b847-7e0558a18679 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:55.220806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639a752-2ecf-417e-b847-7e0558a18679 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:55.225962 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084df7ce-89e0-4f8e-9e7d-cfe44c4fd0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:55.227765 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df7ce-89e0-4f8e-9e7d-cfe44c4fd0f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:55.227907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df7ce-89e0-4f8e-9e7d-cfe44c4fd0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:55.228117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df7ce-89e0-4f8e-9e7d-cfe44c4fd0f5 admin admin] PATH_INFO: `/v3/projects/ee15aeabd66440e7a73606a610097145/users/70f22e469ab84822a387d9f1a599ad03/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:55.230227 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084df7ce-89e0-4f8e-9e7d-cfe44c4fd0f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee15aeabd66440e7a73606a610097145, user_id=70f22e469ab84822a387d9f1a599ad03, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:55.233701 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084df7ce-89e0-4f8e-9e7d-cfe44c4fd0f5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:55.257311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1099/2191] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:55 2022] PUT /identity/v3/projects/ee15aeabd66440e7a73606a610097145/users/70f22e469ab84822a387d9f1a599ad03/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:55.263324 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ad6be-ba7e-4353-a076-b1698f26001e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:55.263746 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ad6be-ba7e-4353-a076-b1698f26001e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:55.264151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ad6be-ba7e-4353-a076-b1698f26001e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:55.308276 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-df8ad6be-ba7e-4353-a076-b1698f26001e None None] MFA Rules not processed for user `70f22e469ab84822a387d9f1a599ad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:55.309521 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-df8ad6be-ba7e-4353-a076-b1698f26001e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:55.388447 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:55.396992 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1093/2192] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:28:55.405634 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084df7ce-89e0-4f8e-9e7d-cfe44c4fd0f5 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:55.407540 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-084df7ce-89e0-4f8e-9e7d-cfe44c4fd0f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:55.475745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084df7ce-89e0-4f8e-9e7d-cfe44c4fd0f5 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:55.478976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89e3df-d1f0-4680-acf0-766bd7a30e7c None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:55.479267 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89e3df-d1f0-4680-acf0-766bd7a30e7c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:55.479546 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89e3df-d1f0-4680-acf0-766bd7a30e7c None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:55.480603 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3374a7-57ba-4aa7-b90b-cfda26274ecf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:55.480916 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1094/2193] 10.222.0.57 () {54 vars in 921 bytes} [Tue Jul 12 18:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:28:55.481276 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3374a7-57ba-4aa7-b90b-cfda26274ecf service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:55.481574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3374a7-57ba-4aa7-b90b-cfda26274ecf service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:55.481856 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3374a7-57ba-4aa7-b90b-cfda26274ecf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:55.488117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18af6f-90f8-4e58-a08e-8031b7449d31 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:55.488405 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18af6f-90f8-4e58-a08e-8031b7449d31 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:55.488682 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18af6f-90f8-4e58-a08e-8031b7449d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:55.495394 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3374a7-57ba-4aa7-b90b-cfda26274ecf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:55.496855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3374a7-57ba-4aa7-b90b-cfda26274ecf service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:55.508250 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1100/2194] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:55 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:55.508645 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8a18af6f-90f8-4e58-a08e-8031b7449d31 None None] MFA Rules not processed for user `206242c775be40c7b96af6de635e2065`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:55.509902 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8a18af6f-90f8-4e58-a08e-8031b7449d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:55.562969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3374a7-57ba-4aa7-b90b-cfda26274ecf service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:55.566609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9e3374a7-57ba-4aa7-b90b-cfda26274ecf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:55.587300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1095/2195] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Jul 12 18:28:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:55.602528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18af6f-90f8-4e58-a08e-8031b7449d31 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:55.617130 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18af6f-90f8-4e58-a08e-8031b7449d31 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:55.621776 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc55536-056f-4bd3-891e-56460a428be1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:55.622639 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc55536-056f-4bd3-891e-56460a428be1 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:55.623122 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc55536-056f-4bd3-891e-56460a428be1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:55.624239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc55536-056f-4bd3-891e-56460a428be1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:55.682849 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:55.688712 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3374a7-57ba-4aa7-b90b-cfda26274ecf service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:55.695040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b4e9e-aecb-428d-bb1c-416c391cec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:55.696204 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b4e9e-aecb-428d-bb1c-416c391cec8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:55.696632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b4e9e-aecb-428d-bb1c-416c391cec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:55.698830 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b4e9e-aecb-428d-bb1c-416c391cec8a admin admin] PATH_INFO: `/v3/users/f16b40fe2b734406a6d1494f30e0c1e2` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:55.700862 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b4e9e-aecb-428d-bb1c-416c391cec8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16b40fe2b734406a6d1494f30e0c1e2)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:55.703341 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b4e9e-aecb-428d-bb1c-416c391cec8a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:55.725774 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc55536-056f-4bd3-891e-56460a428be1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:55.727441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc55536-056f-4bd3-891e-56460a428be1 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:55.739521 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1096/2196] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:55.740869 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc55536-056f-4bd3-891e-56460a428be1 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:55.742668 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6fc55536-056f-4bd3-891e-56460a428be1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:55.761670 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-4a9b4e9e-aecb-428d-bb1c-416c391cec8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16b40fe2b734406a6d1494f30e0c1e2'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:55.763558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-4a9b4e9e-aecb-428d-bb1c-416c391cec8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16b40fe2b734406a6d1494f30e0c1e2'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:55.768940 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc55536-056f-4bd3-891e-56460a428be1 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:55.784633 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-4a9b4e9e-aecb-428d-bb1c-416c391cec8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16b40fe2b734406a6d1494f30e0c1e2'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:55.792498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263652d-305f-49cd-a1d4-6082e59b4f93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206242c775be40c7b96af6de635e2065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:55.792932 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-4a9b4e9e-aecb-428d-bb1c-416c391cec8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16b40fe2b734406a6d1494f30e0c1e2'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:55.793194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263652d-305f-49cd-a1d4-6082e59b4f93 service placement] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:55.793527 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263652d-305f-49cd-a1d4-6082e59b4f93 service placement] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:55.793701 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-4a9b4e9e-aecb-428d-bb1c-416c391cec8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16b40fe2b734406a6d1494f30e0c1e2'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:55.793816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263652d-305f-49cd-a1d4-6082e59b4f93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:55.796187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e263652d-305f-49cd-a1d4-6082e59b4f93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:55.809231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1101/2197] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:55 2022] DELETE /identity/v3/users/f16b40fe2b734406a6d1494f30e0c1e2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:55.818600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263652d-305f-49cd-a1d4-6082e59b4f93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:55.821069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263652d-305f-49cd-a1d4-6082e59b4f93 service placement] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:55.835910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1097/2198] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:56.021799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b4e9e-aecb-428d-bb1c-416c391cec8a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:56.023237 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4a9b4e9e-aecb-428d-bb1c-416c391cec8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:56.108071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b4e9e-aecb-428d-bb1c-416c391cec8a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:56.112799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70395bda-babc-4659-9176-981ffb3540da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:56.113751 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70395bda-babc-4659-9176-981ffb3540da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:56.114160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70395bda-babc-4659-9176-981ffb3540da admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:56.114440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70395bda-babc-4659-9176-981ffb3540da admin admin] PATH_INFO: `/v3/projects/3ffb1cbeb9664655aa64e8754de4fe25` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:56.115691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70395bda-babc-4659-9176-981ffb3540da admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ffb1cbeb9664655aa64e8754de4fe25)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:56.117803 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70395bda-babc-4659-9176-981ffb3540da admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:56.169923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-70395bda-babc-4659-9176-981ffb3540da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ffb1cbeb9664655aa64e8754de4fe25', 'request_id': 'req-70395bda-babc-4659-9176-981ffb3540da'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:56.178048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-70395bda-babc-4659-9176-981ffb3540da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ffb1cbeb9664655aa64e8754de4fe25', 'request_id': 'req-70395bda-babc-4659-9176-981ffb3540da'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:56.184035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-70395bda-babc-4659-9176-981ffb3540da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ffb1cbeb9664655aa64e8754de4fe25', 'request_id': 'req-70395bda-babc-4659-9176-981ffb3540da'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:56.195218 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-70395bda-babc-4659-9176-981ffb3540da admin admin] The token cache is being invalidate because project 3ffb1cbeb9664655aa64e8754de4fe25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:56.195504 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-70395bda-babc-4659-9176-981ffb3540da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:56.196147 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-70395bda-babc-4659-9176-981ffb3540da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:56.198007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1102/2199] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:56 2022] DELETE /identity/v3/projects/3ffb1cbeb9664655aa64e8754de4fe25 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:56.203766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f860a-4065-4ddb-95f0-375b1078279a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:56.204062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f860a-4065-4ddb-95f0-375b1078279a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:56.204344 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f860a-4065-4ddb-95f0-375b1078279a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:56.222881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e24f860a-4065-4ddb-95f0-375b1078279a None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:56.224091 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e24f860a-4065-4ddb-95f0-375b1078279a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:56.306033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1098/2200] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:56.314489 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d70797-d9d7-4f44-8b03-e1036e38c8ab None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:56.315228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d70797-d9d7-4f44-8b03-e1036e38c8ab None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:56.315514 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d70797-d9d7-4f44-8b03-e1036e38c8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:56.331051 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:56.340813 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-80d70797-d9d7-4f44-8b03-e1036e38c8ab None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:56.341852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-80d70797-d9d7-4f44-8b03-e1036e38c8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:56.353305 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1103/2201] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:56.355921 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f860a-4065-4ddb-95f0-375b1078279a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:56.367344 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f860a-4065-4ddb-95f0-375b1078279a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:56.375928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e387d6-d68a-49b2-9591-8aea2bd6ed21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:56.376603 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e387d6-d68a-49b2-9591-8aea2bd6ed21 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:56.376888 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e387d6-d68a-49b2-9591-8aea2bd6ed21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:56.377156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e387d6-d68a-49b2-9591-8aea2bd6ed21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:56.377943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e387d6-d68a-49b2-9591-8aea2bd6ed21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:56.378267 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e387d6-d68a-49b2-9591-8aea2bd6ed21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:56.379924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e387d6-d68a-49b2-9591-8aea2bd6ed21 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:56.396770 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1099/2202] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:28:56.397893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d70797-d9d7-4f44-8b03-e1036e38c8ab None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:56.411120 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d70797-d9d7-4f44-8b03-e1036e38c8ab None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:56.416118 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217ba76-6317-4449-ac4b-f4cb59b5adca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:56.416800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217ba76-6317-4449-ac4b-f4cb59b5adca admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:56.417229 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217ba76-6317-4449-ac4b-f4cb59b5adca admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:56.417548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217ba76-6317-4449-ac4b-f4cb59b5adca admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:56.418247 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217ba76-6317-4449-ac4b-f4cb59b5adca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:56.423975 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217ba76-6317-4449-ac4b-f4cb59b5adca admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:56.476224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1104/2203] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:56 2022] POST /identity/v3/projects => generated 405 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:56.480959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e387d6-d68a-49b2-9591-8aea2bd6ed21 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:56.497326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e387d6-d68a-49b2-9591-8aea2bd6ed21 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:56.505780 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:56.582975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdc4c0-3ad3-47d0-9293-0a6ef44932e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:56.582975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdc4c0-3ad3-47d0-9293-0a6ef44932e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:56.582975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdc4c0-3ad3-47d0-9293-0a6ef44932e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:56.583986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdc4c0-3ad3-47d0-9293-0a6ef44932e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:56.583986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bdc4c0-3ad3-47d0-9293-0a6ef44932e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:56.585967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bdc4c0-3ad3-47d0-9293-0a6ef44932e2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:56.613307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1100/2204] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:56 2022] POST /identity/v3/users => generated 303 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:56.615775 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217ba76-6317-4449-ac4b-f4cb59b5adca admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:56.627479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217ba76-6317-4449-ac4b-f4cb59b5adca admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:56.632589 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246bb49c-0f29-43f4-a17b-88964bac64da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:56.633316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bb49c-0f29-43f4-a17b-88964bac64da admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:56.633598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bb49c-0f29-43f4-a17b-88964bac64da admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:56.633869 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bb49c-0f29-43f4-a17b-88964bac64da admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:56.634595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246bb49c-0f29-43f4-a17b-88964bac64da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:56.636258 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246bb49c-0f29-43f4-a17b-88964bac64da admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:56.648030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1105/2205] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:56.652224 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdc4c0-3ad3-47d0-9293-0a6ef44932e2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:56.662635 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdc4c0-3ad3-47d0-9293-0a6ef44932e2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:56.667186 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd57b4-600c-44b7-9200-76129fad6dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:56.667838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd57b4-600c-44b7-9200-76129fad6dea admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:56.668118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd57b4-600c-44b7-9200-76129fad6dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:56.668388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd57b4-600c-44b7-9200-76129fad6dea admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:56.669129 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd57b4-600c-44b7-9200-76129fad6dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:56.670778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd57b4-600c-44b7-9200-76129fad6dea admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:56.680458 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1101/2206] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:56.684409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246bb49c-0f29-43f4-a17b-88964bac64da admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:56.694767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246bb49c-0f29-43f4-a17b-88964bac64da admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:56.699318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483fbc8-ba39-4571-a9ba-3e289367448a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:56.700186 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483fbc8-ba39-4571-a9ba-3e289367448a admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:56.700712 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483fbc8-ba39-4571-a9ba-3e289367448a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:56.700981 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483fbc8-ba39-4571-a9ba-3e289367448a admin admin] PATH_INFO: `/v3/projects/a8dbd90f2e5b461fbcb3c60f40f0a3dc/users/aa02dab0099b4104a4c09ba02d8d7b17/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:56.716126 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483fbc8-ba39-4571-a9ba-3e289367448a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8dbd90f2e5b461fbcb3c60f40f0a3dc, user_id=aa02dab0099b4104a4c09ba02d8d7b17, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:56.718912 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483fbc8-ba39-4571-a9ba-3e289367448a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:56.735907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1106/2207] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:56 2022] PUT /identity/v3/projects/a8dbd90f2e5b461fbcb3c60f40f0a3dc/users/aa02dab0099b4104a4c09ba02d8d7b17/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:56.741017 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe94afb-64b3-4b15-a6ac-d0a78349404a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:56.741559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe94afb-64b3-4b15-a6ac-d0a78349404a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:56.741952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe94afb-64b3-4b15-a6ac-d0a78349404a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:56.760269 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-dfe94afb-64b3-4b15-a6ac-d0a78349404a None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:56.763322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-dfe94afb-64b3-4b15-a6ac-d0a78349404a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:56.823418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1102/2208] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:56.833446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483fbc8-ba39-4571-a9ba-3e289367448a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:56.835281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b483fbc8-ba39-4571-a9ba-3e289367448a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:56.893432 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483fbc8-ba39-4571-a9ba-3e289367448a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:56.897105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d503b56-69c0-41bb-a325-3a4e50267926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:56.897786 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d503b56-69c0-41bb-a325-3a4e50267926 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:56.898072 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d503b56-69c0-41bb-a325-3a4e50267926 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:56.898352 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d503b56-69c0-41bb-a325-3a4e50267926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:56.907784 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d503b56-69c0-41bb-a325-3a4e50267926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:56.909213 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d503b56-69c0-41bb-a325-3a4e50267926 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:56.919020 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1107/2209] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:57.626278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde40903-7925-4041-af0b-20e6c1bcc97e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:57.626278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde40903-7925-4041-af0b-20e6c1bcc97e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:57.626897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde40903-7925-4041-af0b-20e6c1bcc97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:57.664268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-fde40903-7925-4041-af0b-20e6c1bcc97e None None] MFA Rules not processed for user `aa02dab0099b4104a4c09ba02d8d7b17`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:57.666188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-fde40903-7925-4041-af0b-20e6c1bcc97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:57.788947 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1103/2210] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:57.789984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d503b56-69c0-41bb-a325-3a4e50267926 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:57.801334 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d503b56-69c0-41bb-a325-3a4e50267926 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:57.808996 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448445a1-c6da-42e1-a5ae-cba3964728a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:57.809732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448445a1-c6da-42e1-a5ae-cba3964728a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:57.810020 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448445a1-c6da-42e1-a5ae-cba3964728a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:57.810302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448445a1-c6da-42e1-a5ae-cba3964728a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:57.811062 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448445a1-c6da-42e1-a5ae-cba3964728a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:57.813039 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448445a1-c6da-42e1-a5ae-cba3964728a7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:57.852613 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1108/2211] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:57 2022] POST /identity/v3/projects => generated 405 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:28:57.856727 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde40903-7925-4041-af0b-20e6c1bcc97e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:57.871043 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde40903-7925-4041-af0b-20e6c1bcc97e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:57.884522 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:57.934072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce64b0-c956-4479-a52e-aff0f02e4a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:57.934754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce64b0-c956-4479-a52e-aff0f02e4a15 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:57.935039 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce64b0-c956-4479-a52e-aff0f02e4a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:57.935312 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce64b0-c956-4479-a52e-aff0f02e4a15 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:57.936595 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce64b0-c956-4479-a52e-aff0f02e4a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:57.938533 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce64b0-c956-4479-a52e-aff0f02e4a15 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:57.963159 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1104/2212] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:57 2022] POST /identity/v3/users => generated 309 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:57.964308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448445a1-c6da-42e1-a5ae-cba3964728a7 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:57.975594 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448445a1-c6da-42e1-a5ae-cba3964728a7 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:57.980316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce5e57-c205-4e42-9dbc-153a8a84ab43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:57.980982 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce5e57-c205-4e42-9dbc-153a8a84ab43 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:57.981320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce5e57-c205-4e42-9dbc-153a8a84ab43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:57.981602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce5e57-c205-4e42-9dbc-153a8a84ab43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:57.982363 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce5e57-c205-4e42-9dbc-153a8a84ab43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:57.984033 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce5e57-c205-4e42-9dbc-153a8a84ab43 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:57.995001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1109/2213] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:28:57.999885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce64b0-c956-4479-a52e-aff0f02e4a15 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:58.010050 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce64b0-c956-4479-a52e-aff0f02e4a15 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:58.015217 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210de69-1337-42fe-8ae2-81a8f1c80066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:58.016093 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210de69-1337-42fe-8ae2-81a8f1c80066 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:58.016375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210de69-1337-42fe-8ae2-81a8f1c80066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:58.016649 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210de69-1337-42fe-8ae2-81a8f1c80066 admin admin] PATH_INFO: `/v3/projects/4a4c9d9808a44a18b7d85c035b50a2a5/users/807cf671dde8483fbae66b6883341ec7/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:58.031181 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210de69-1337-42fe-8ae2-81a8f1c80066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a4c9d9808a44a18b7d85c035b50a2a5, user_id=807cf671dde8483fbae66b6883341ec7, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:58.036226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210de69-1337-42fe-8ae2-81a8f1c80066 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:58.048638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1105/2214] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:57 2022] PUT /identity/v3/projects/4a4c9d9808a44a18b7d85c035b50a2a5/users/807cf671dde8483fbae66b6883341ec7/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:58.052768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce5e57-c205-4e42-9dbc-153a8a84ab43 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:58.063625 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce5e57-c205-4e42-9dbc-153a8a84ab43 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:58.119524 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c901ff3-1579-4852-bae2-ac0454ee0785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:58.120177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901ff3-1579-4852-bae2-ac0454ee0785 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:58.120464 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901ff3-1579-4852-bae2-ac0454ee0785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:58.120739 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901ff3-1579-4852-bae2-ac0454ee0785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:58.121480 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c901ff3-1579-4852-bae2-ac0454ee0785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:58.123074 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c901ff3-1579-4852-bae2-ac0454ee0785 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:58.132890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1110/2215] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:58.137132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210de69-1337-42fe-8ae2-81a8f1c80066 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:58.148648 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210de69-1337-42fe-8ae2-81a8f1c80066 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:58.153526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6496fe-b987-41ca-88a0-8e8678be8193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:58.154415 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6496fe-b987-41ca-88a0-8e8678be8193 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:58.154695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6496fe-b987-41ca-88a0-8e8678be8193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:58.155023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6496fe-b987-41ca-88a0-8e8678be8193 admin admin] PATH_INFO: `/v3/projects/4a4c9d9808a44a18b7d85c035b50a2a5/users/807cf671dde8483fbae66b6883341ec7/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:58.156988 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6496fe-b987-41ca-88a0-8e8678be8193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a4c9d9808a44a18b7d85c035b50a2a5, user_id=807cf671dde8483fbae66b6883341ec7, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:58.159666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6496fe-b987-41ca-88a0-8e8678be8193 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:58.170238 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1106/2216] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:58 2022] PUT /identity/v3/projects/4a4c9d9808a44a18b7d85c035b50a2a5/users/807cf671dde8483fbae66b6883341ec7/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:58.628409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c901ff3-1579-4852-bae2-ac0454ee0785 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:58.630227 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8c901ff3-1579-4852-bae2-ac0454ee0785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:58.643802 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c901ff3-1579-4852-bae2-ac0454ee0785 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:58.651668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:58.707725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde1015-77c4-4754-9c5d-18829641c724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:58.708611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde1015-77c4-4754-9c5d-18829641c724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:58.708895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde1015-77c4-4754-9c5d-18829641c724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:58.709170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde1015-77c4-4754-9c5d-18829641c724 admin admin] PATH_INFO: `/v3/users/63d35a2ad5e149dcb1e809d2a7fc4a3e` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:58.710410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde1015-77c4-4754-9c5d-18829641c724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d35a2ad5e149dcb1e809d2a7fc4a3e)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:58.716711 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde1015-77c4-4754-9c5d-18829641c724 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:58.781458 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ccde1015-77c4-4754-9c5d-18829641c724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d35a2ad5e149dcb1e809d2a7fc4a3e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:58.782118 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ccde1015-77c4-4754-9c5d-18829641c724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d35a2ad5e149dcb1e809d2a7fc4a3e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:58.795125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ccde1015-77c4-4754-9c5d-18829641c724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d35a2ad5e149dcb1e809d2a7fc4a3e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:58.803080 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ccde1015-77c4-4754-9c5d-18829641c724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d35a2ad5e149dcb1e809d2a7fc4a3e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:58.803824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ccde1015-77c4-4754-9c5d-18829641c724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d35a2ad5e149dcb1e809d2a7fc4a3e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:58.816889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1111/2217] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:58 2022] DELETE /identity/v3/users/63d35a2ad5e149dcb1e809d2a7fc4a3e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:58.822624 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013dcbd-5de7-40ad-bbae-061a4bf0443f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:58.823168 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013dcbd-5de7-40ad-bbae-061a4bf0443f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:58.823543 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013dcbd-5de7-40ad-bbae-061a4bf0443f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:58.842866 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-7013dcbd-5de7-40ad-bbae-061a4bf0443f None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:58.845296 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7013dcbd-5de7-40ad-bbae-061a4bf0443f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:58.955401 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ed71c-fad8-4c9c-934c-abef43530803 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:58.955796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ed71c-fad8-4c9c-934c-abef43530803 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:58.956185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ed71c-fad8-4c9c-934c-abef43530803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:58.978219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1107/2218] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:58.986910 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-493ed71c-fad8-4c9c-934c-abef43530803 None None] MFA Rules not processed for user `807cf671dde8483fbae66b6883341ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:58.988225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-493ed71c-fad8-4c9c-934c-abef43530803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:58.988347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013dcbd-5de7-40ad-bbae-061a4bf0443f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:58.989692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7013dcbd-5de7-40ad-bbae-061a4bf0443f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:59.074694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013dcbd-5de7-40ad-bbae-061a4bf0443f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:59.079162 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5b8d8-9e97-488c-8d15-84ec811db851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:59.079816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5b8d8-9e97-488c-8d15-84ec811db851 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:59.080097 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5b8d8-9e97-488c-8d15-84ec811db851 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:59.080370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5b8d8-9e97-488c-8d15-84ec811db851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:59.096240 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5b8d8-9e97-488c-8d15-84ec811db851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:59.101587 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5b8d8-9e97-488c-8d15-84ec811db851 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:59.113798 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1108/2219] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:28:59.121753 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1112/2220] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:28:58 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:28:59.541294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5b8d8-9e97-488c-8d15-84ec811db851 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:59.543676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-18e5b8d8-9e97-488c-8d15-84ec811db851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:59.592793 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5b8d8-9e97-488c-8d15-84ec811db851 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:59.598030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae351dc-8ffc-4e15-bc7f-f2b01fa81a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:59.598903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae351dc-8ffc-4e15-bc7f-f2b01fa81a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:59.599183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae351dc-8ffc-4e15-bc7f-f2b01fa81a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:59.599491 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae351dc-8ffc-4e15-bc7f-f2b01fa81a8a admin admin] PATH_INFO: `/v3/projects/368f024c633146e4bd9668fc560d4c5e` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:59.600693 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae351dc-8ffc-4e15-bc7f-f2b01fa81a8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=368f024c633146e4bd9668fc560d4c5e)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:59.602661 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae351dc-8ffc-4e15-bc7f-f2b01fa81a8a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:59.612297 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:59.657150 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-aae351dc-8ffc-4e15-bc7f-f2b01fa81a8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '368f024c633146e4bd9668fc560d4c5e', 'request_id': 'req-aae351dc-8ffc-4e15-bc7f-f2b01fa81a8a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:59.663255 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-aae351dc-8ffc-4e15-bc7f-f2b01fa81a8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '368f024c633146e4bd9668fc560d4c5e', 'request_id': 'req-aae351dc-8ffc-4e15-bc7f-f2b01fa81a8a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:59.669751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-aae351dc-8ffc-4e15-bc7f-f2b01fa81a8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '368f024c633146e4bd9668fc560d4c5e', 'request_id': 'req-aae351dc-8ffc-4e15-bc7f-f2b01fa81a8a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:59.684635 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-aae351dc-8ffc-4e15-bc7f-f2b01fa81a8a admin admin] The token cache is being invalidate because project 368f024c633146e4bd9668fc560d4c5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:59.684932 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-aae351dc-8ffc-4e15-bc7f-f2b01fa81a8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:59.685701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-aae351dc-8ffc-4e15-bc7f-f2b01fa81a8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:59.687618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1109/2221] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:59 2022] DELETE /identity/v3/projects/368f024c633146e4bd9668fc560d4c5e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:59.691481 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ed71c-fad8-4c9c-934c-abef43530803 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:59.702846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ed71c-fad8-4c9c-934c-abef43530803 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:59.714639 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:59.766531 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfa2c4-8516-4f1f-a324-b79ead023788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:59.767977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfa2c4-8516-4f1f-a324-b79ead023788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:59.768761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfa2c4-8516-4f1f-a324-b79ead023788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:59.768761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfa2c4-8516-4f1f-a324-b79ead023788 admin admin] PATH_INFO: `/v3/users/70f22e469ab84822a387d9f1a599ad03` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:59.770167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfa2c4-8516-4f1f-a324-b79ead023788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70f22e469ab84822a387d9f1a599ad03)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:59.772253 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfa2c4-8516-4f1f-a324-b79ead023788 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:59.828179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b3bfa2c4-8516-4f1f-a324-b79ead023788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70f22e469ab84822a387d9f1a599ad03'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:59.828787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b3bfa2c4-8516-4f1f-a324-b79ead023788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70f22e469ab84822a387d9f1a599ad03'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:59.840846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b3bfa2c4-8516-4f1f-a324-b79ead023788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70f22e469ab84822a387d9f1a599ad03'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:59.848479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b3bfa2c4-8516-4f1f-a324-b79ead023788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70f22e469ab84822a387d9f1a599ad03'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:59.849416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b3bfa2c4-8516-4f1f-a324-b79ead023788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70f22e469ab84822a387d9f1a599ad03'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:59.863033 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1113/2222] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:59 2022] DELETE /identity/v3/users/70f22e469ab84822a387d9f1a599ad03 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:00.433652 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8167ea-d24d-4f45-a98d-23d2852d987a None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:00.434496 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8167ea-d24d-4f45-a98d-23d2852d987a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:00.434784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8167ea-d24d-4f45-a98d-23d2852d987a None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:00.436933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1110/2223] 10.222.0.57 () {54 vars in 921 bytes} [Tue Jul 12 18:29:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:29:00.442964 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755713db-6474-436a-bd22-40f342faf130 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:00.443508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755713db-6474-436a-bd22-40f342faf130 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:00.444128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755713db-6474-436a-bd22-40f342faf130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:00.459375 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8167ea-d24d-4f45-a98d-23d2852d987a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:00.461069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3f8167ea-d24d-4f45-a98d-23d2852d987a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:00.467967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-755713db-6474-436a-bd22-40f342faf130 None None] MFA Rules not processed for user `206242c775be40c7b96af6de635e2065`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:00.469556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-755713db-6474-436a-bd22-40f342faf130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:00.586779 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1114/2224] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Jul 12 18:29:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:00.589904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755713db-6474-436a-bd22-40f342faf130 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:00.593809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-755713db-6474-436a-bd22-40f342faf130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:00.599587 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8167ea-d24d-4f45-a98d-23d2852d987a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:00.607301 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d58f07-93b8-4bc9-972c-ab1f6c599b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:00.609862 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d58f07-93b8-4bc9-972c-ab1f6c599b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:00.610157 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d58f07-93b8-4bc9-972c-ab1f6c599b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:00.611029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d58f07-93b8-4bc9-972c-ab1f6c599b77 admin admin] PATH_INFO: `/v3/projects/ee15aeabd66440e7a73606a610097145` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:00.612287 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d58f07-93b8-4bc9-972c-ab1f6c599b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee15aeabd66440e7a73606a610097145)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:00.614277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d58f07-93b8-4bc9-972c-ab1f6c599b77 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:00.614922 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755713db-6474-436a-bd22-40f342faf130 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:00.620092 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922391d-0aa6-42f0-9d3c-e5490ada1fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:00.621031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922391d-0aa6-42f0-9d3c-e5490ada1fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:00.621407 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922391d-0aa6-42f0-9d3c-e5490ada1fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:00.621745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922391d-0aa6-42f0-9d3c-e5490ada1fd3 admin admin] PATH_INFO: `/v3/users/aa02dab0099b4104a4c09ba02d8d7b17` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:00.622990 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922391d-0aa6-42f0-9d3c-e5490ada1fd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa02dab0099b4104a4c09ba02d8d7b17)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:00.625965 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922391d-0aa6-42f0-9d3c-e5490ada1fd3 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:00.657820 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:00.667785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-23d58f07-93b8-4bc9-972c-ab1f6c599b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee15aeabd66440e7a73606a610097145', 'request_id': 'req-23d58f07-93b8-4bc9-972c-ab1f6c599b77'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:00.674824 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-23d58f07-93b8-4bc9-972c-ab1f6c599b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee15aeabd66440e7a73606a610097145', 'request_id': 'req-23d58f07-93b8-4bc9-972c-ab1f6c599b77'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:00.681696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-23d58f07-93b8-4bc9-972c-ab1f6c599b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee15aeabd66440e7a73606a610097145', 'request_id': 'req-23d58f07-93b8-4bc9-972c-ab1f6c599b77'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:00.685389 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f922391d-0aa6-42f0-9d3c-e5490ada1fd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa02dab0099b4104a4c09ba02d8d7b17'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:00.686733 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f922391d-0aa6-42f0-9d3c-e5490ada1fd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa02dab0099b4104a4c09ba02d8d7b17'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:00.695005 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-23d58f07-93b8-4bc9-972c-ab1f6c599b77 admin admin] The token cache is being invalidate because project ee15aeabd66440e7a73606a610097145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:00.695307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-23d58f07-93b8-4bc9-972c-ab1f6c599b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:00.695980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-23d58f07-93b8-4bc9-972c-ab1f6c599b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:00.697914 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1111/2225] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:00 2022] DELETE /identity/v3/projects/ee15aeabd66440e7a73606a610097145 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:00.702407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d58f07-93b8-4bc9-972c-ab1f6c599b77 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:00.703777 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-23d58f07-93b8-4bc9-972c-ab1f6c599b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:00.705089 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f922391d-0aa6-42f0-9d3c-e5490ada1fd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa02dab0099b4104a4c09ba02d8d7b17'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:00.712415 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f922391d-0aa6-42f0-9d3c-e5490ada1fd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa02dab0099b4104a4c09ba02d8d7b17'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:00.713339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f922391d-0aa6-42f0-9d3c-e5490ada1fd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa02dab0099b4104a4c09ba02d8d7b17'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:00.726691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1115/2226] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:00 2022] DELETE /identity/v3/users/aa02dab0099b4104a4c09ba02d8d7b17 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:00.728022 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c5485-2d8f-4dd1-84da-a192fd034ff2 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:00.728313 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c5485-2d8f-4dd1-84da-a192fd034ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:00.728597 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c5485-2d8f-4dd1-84da-a192fd034ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:00.747951 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:00.748222 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-fe9c5485-2d8f-4dd1-84da-a192fd034ff2 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:00.750401 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-fe9c5485-2d8f-4dd1-84da-a192fd034ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:00.797473 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d58f07-93b8-4bc9-972c-ab1f6c599b77 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:00.832629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1116/2227] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:00.840394 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b75550-41a6-4503-92f4-3a6965ae24f5 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:00.840831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b75550-41a6-4503-92f4-3a6965ae24f5 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:00.841123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b75550-41a6-4503-92f4-3a6965ae24f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:00.864144 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b7b75550-41a6-4503-92f4-3a6965ae24f5 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:00.865543 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b7b75550-41a6-4503-92f4-3a6965ae24f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:00.879788 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1117/2228] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:00.880971 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b75550-41a6-4503-92f4-3a6965ae24f5 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:00.886719 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f602757-b1c0-4b0a-bd7a-9ba74480bf79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206242c775be40c7b96af6de635e2065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:00.887418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f602757-b1c0-4b0a-bd7a-9ba74480bf79 service placement] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:00.887809 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f602757-b1c0-4b0a-bd7a-9ba74480bf79 service placement] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:00.888177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f602757-b1c0-4b0a-bd7a-9ba74480bf79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:00.890896 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4f602757-b1c0-4b0a-bd7a-9ba74480bf79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:00.893038 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b75550-41a6-4503-92f4-3a6965ae24f5 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:00.898193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6407d-5e9e-45d3-b44d-45973dffc82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:00.899260 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6407d-5e9e-45d3-b44d-45973dffc82a admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:00.899914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6407d-5e9e-45d3-b44d-45973dffc82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:00.900258 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6407d-5e9e-45d3-b44d-45973dffc82a admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:00.901793 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6407d-5e9e-45d3-b44d-45973dffc82a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:29:00.902173 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6407d-5e9e-45d3-b44d-45973dffc82a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:00.903563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f602757-b1c0-4b0a-bd7a-9ba74480bf79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:00.904446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6407d-5e9e-45d3-b44d-45973dffc82a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:00.906091 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f602757-b1c0-4b0a-bd7a-9ba74480bf79 service placement] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:00.917876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1112/2229] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:00.921745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1118/2230] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:29:00.926430 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f602757-b1c0-4b0a-bd7a-9ba74480bf79 service placement] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:00.940918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f602757-b1c0-4b0a-bd7a-9ba74480bf79 service placement] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:00.959204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae779ae-c996-411d-933c-0e1a971035fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:00.959906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae779ae-c996-411d-933c-0e1a971035fe admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:00.960319 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae779ae-c996-411d-933c-0e1a971035fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:00.960643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae779ae-c996-411d-933c-0e1a971035fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:00.961390 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae779ae-c996-411d-933c-0e1a971035fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:00.964948 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae779ae-c996-411d-933c-0e1a971035fe admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:00.980121 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6407d-5e9e-45d3-b44d-45973dffc82a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:00.983104 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ddf6407d-5e9e-45d3-b44d-45973dffc82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:01.007103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1113/2231] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:00 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:01.008689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae779ae-c996-411d-933c-0e1a971035fe admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:01.022234 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6407d-5e9e-45d3-b44d-45973dffc82a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:01.088211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b88a9-06ee-4a52-b109-41db090b0322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:01.089077 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b88a9-06ee-4a52-b109-41db090b0322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.089382 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b88a9-06ee-4a52-b109-41db090b0322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.089661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b88a9-06ee-4a52-b109-41db090b0322 admin admin] PATH_INFO: `/v3/projects/a8dbd90f2e5b461fbcb3c60f40f0a3dc` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.090848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b88a9-06ee-4a52-b109-41db090b0322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8dbd90f2e5b461fbcb3c60f40f0a3dc)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:01.092790 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b88a9-06ee-4a52-b109-41db090b0322 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:01.094800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae779ae-c996-411d-933c-0e1a971035fe admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:01.099595 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde38e46-3b05-410e-a10a-521dae173503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:01.100258 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde38e46-3b05-410e-a10a-521dae173503 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.100544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde38e46-3b05-410e-a10a-521dae173503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.100828 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde38e46-3b05-410e-a10a-521dae173503 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.101541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde38e46-3b05-410e-a10a-521dae173503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:01.103554 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde38e46-3b05-410e-a10a-521dae173503 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:01.118479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:01.129135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1114/2232] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:01 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:29:01.129135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde38e46-3b05-410e-a10a-521dae173503 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:01.129135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-fde38e46-3b05-410e-a10a-521dae173503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:01.143163 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1f3b88a9-06ee-4a52-b109-41db090b0322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8dbd90f2e5b461fbcb3c60f40f0a3dc', 'request_id': 'req-1f3b88a9-06ee-4a52-b109-41db090b0322'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.150919 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1f3b88a9-06ee-4a52-b109-41db090b0322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8dbd90f2e5b461fbcb3c60f40f0a3dc', 'request_id': 'req-1f3b88a9-06ee-4a52-b109-41db090b0322'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.156753 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1f3b88a9-06ee-4a52-b109-41db090b0322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8dbd90f2e5b461fbcb3c60f40f0a3dc', 'request_id': 'req-1f3b88a9-06ee-4a52-b109-41db090b0322'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.163233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:01.171798 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1f3b88a9-06ee-4a52-b109-41db090b0322 admin admin] The token cache is being invalidate because project a8dbd90f2e5b461fbcb3c60f40f0a3dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:01.172099 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1f3b88a9-06ee-4a52-b109-41db090b0322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.172833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1f3b88a9-06ee-4a52-b109-41db090b0322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.174680 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1119/2233] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:00 2022] DELETE /identity/v3/projects/a8dbd90f2e5b461fbcb3c60f40f0a3dc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:01.175449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b88a9-06ee-4a52-b109-41db090b0322 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:01.180562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1f3b88a9-06ee-4a52-b109-41db090b0322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:01.196866 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde38e46-3b05-410e-a10a-521dae173503 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:01.247402 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b88a9-06ee-4a52-b109-41db090b0322 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:01.254615 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf17a3-5873-486d-bbca-b0411bfd17cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:01.255351 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf17a3-5873-486d-bbca-b0411bfd17cc admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.255590 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf17a3-5873-486d-bbca-b0411bfd17cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.255866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf17a3-5873-486d-bbca-b0411bfd17cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.255964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a4248-4cd2-4a37-aa49-339034a4051f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:01.256656 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a4248-4cd2-4a37-aa49-339034a4051f service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.256899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a4248-4cd2-4a37-aa49-339034a4051f service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.257017 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf17a3-5873-486d-bbca-b0411bfd17cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:01.257173 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a4248-4cd2-4a37-aa49-339034a4051f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.259159 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf17a3-5873-486d-bbca-b0411bfd17cc admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:01.261373 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-050a4248-4cd2-4a37-aa49-339034a4051f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:01.275744 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1120/2234] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:01.278745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf17a3-5873-486d-bbca-b0411bfd17cc admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:01.280594 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0ecf17a3-5873-486d-bbca-b0411bfd17cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:01.298618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf17a3-5873-486d-bbca-b0411bfd17cc admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:01.303495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee22c6-06e3-43c8-9d21-b74d04a40828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:01.304431 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee22c6-06e3-43c8-9d21-b74d04a40828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.304783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee22c6-06e3-43c8-9d21-b74d04a40828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.305069 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee22c6-06e3-43c8-9d21-b74d04a40828 admin admin] PATH_INFO: `/v3/users/807cf671dde8483fbae66b6883341ec7` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.306299 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee22c6-06e3-43c8-9d21-b74d04a40828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=807cf671dde8483fbae66b6883341ec7)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:01.308241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee22c6-06e3-43c8-9d21-b74d04a40828 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:01.342774 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a4248-4cd2-4a37-aa49-339034a4051f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:01.344653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a4248-4cd2-4a37-aa49-339034a4051f service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:01.355042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1115/2235] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:01.355836 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a4248-4cd2-4a37-aa49-339034a4051f service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:01.372131 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a4248-4cd2-4a37-aa49-339034a4051f service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:01.378396 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cae00d-1260-42c0-ac83-beb1d42ad843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:01.379532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cae00d-1260-42c0-ac83-beb1d42ad843 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.379848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cae00d-1260-42c0-ac83-beb1d42ad843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.380245 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cae00d-1260-42c0-ac83-beb1d42ad843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.380557 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ecee22c6-06e3-43c8-9d21-b74d04a40828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '807cf671dde8483fbae66b6883341ec7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.381203 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cae00d-1260-42c0-ac83-beb1d42ad843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:01.381357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ecee22c6-06e3-43c8-9d21-b74d04a40828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '807cf671dde8483fbae66b6883341ec7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.383021 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cae00d-1260-42c0-ac83-beb1d42ad843 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:01.397072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1116/2236] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:01.398143 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cae00d-1260-42c0-ac83-beb1d42ad843 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:01.398871 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ecee22c6-06e3-43c8-9d21-b74d04a40828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '807cf671dde8483fbae66b6883341ec7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.400030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-58cae00d-1260-42c0-ac83-beb1d42ad843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:01.406723 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ecee22c6-06e3-43c8-9d21-b74d04a40828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '807cf671dde8483fbae66b6883341ec7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.407435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ecee22c6-06e3-43c8-9d21-b74d04a40828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '807cf671dde8483fbae66b6883341ec7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.413732 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cae00d-1260-42c0-ac83-beb1d42ad843 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:01.418678 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190885fd-6e80-491a-bc85-83d0b25a7cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:01.419552 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190885fd-6e80-491a-bc85-83d0b25a7cef admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.419889 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190885fd-6e80-491a-bc85-83d0b25a7cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.420733 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190885fd-6e80-491a-bc85-83d0b25a7cef admin admin] PATH_INFO: `/v3/projects/85af25a024f74af6b99a9f389cf8e1c5/users/2d168f207f3748b78f86f5252629bc25/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.429791 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1121/2237] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:01 2022] DELETE /identity/v3/users/807cf671dde8483fbae66b6883341ec7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:01.438942 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190885fd-6e80-491a-bc85-83d0b25a7cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=85af25a024f74af6b99a9f389cf8e1c5, user_id=2d168f207f3748b78f86f5252629bc25, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:01.441637 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190885fd-6e80-491a-bc85-83d0b25a7cef admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:01.456819 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1117/2238] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:01 2022] PUT /identity/v3/projects/85af25a024f74af6b99a9f389cf8e1c5/users/2d168f207f3748b78f86f5252629bc25/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:29:01.467749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c7e03-5a0a-4dde-a189-8c9840c2c3c3 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.468307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c7e03-5a0a-4dde-a189-8c9840c2c3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.468913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c7e03-5a0a-4dde-a189-8c9840c2c3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.510145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f23c7e03-5a0a-4dde-a189-8c9840c2c3c3 None None] MFA Rules not processed for user `2d168f207f3748b78f86f5252629bc25`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:01.510145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f23c7e03-5a0a-4dde-a189-8c9840c2c3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:01.511896 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:01.587885 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1122/2239] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:01.592046 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190885fd-6e80-491a-bc85-83d0b25a7cef admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:01.638514 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c7e03-5a0a-4dde-a189-8c9840c2c3c3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:01.640269 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f23c7e03-5a0a-4dde-a189-8c9840c2c3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:01.674447 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:01.678532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190885fd-6e80-491a-bc85-83d0b25a7cef admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:01.687856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0469ecd-1806-4d73-98e2-950fe2d5b92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:01.689866 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0469ecd-1806-4d73-98e2-950fe2d5b92e admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.690218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0469ecd-1806-4d73-98e2-950fe2d5b92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.690562 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0469ecd-1806-4d73-98e2-950fe2d5b92e admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.691325 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0469ecd-1806-4d73-98e2-950fe2d5b92e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:01.693334 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0469ecd-1806-4d73-98e2-950fe2d5b92e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:01.720990 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c7e03-5a0a-4dde-a189-8c9840c2c3c3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:01.723470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1118/2240] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:01 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:01.727516 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0469ecd-1806-4d73-98e2-950fe2d5b92e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:01.783632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30192ef1-dc2a-4129-be9d-70dcca1cca1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:01.784561 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30192ef1-dc2a-4129-be9d-70dcca1cca1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.784851 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30192ef1-dc2a-4129-be9d-70dcca1cca1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.785131 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30192ef1-dc2a-4129-be9d-70dcca1cca1a admin admin] PATH_INFO: `/v3/projects/4a4c9d9808a44a18b7d85c035b50a2a5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.786362 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30192ef1-dc2a-4129-be9d-70dcca1cca1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a4c9d9808a44a18b7d85c035b50a2a5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:01.788359 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30192ef1-dc2a-4129-be9d-70dcca1cca1a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:01.796166 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0469ecd-1806-4d73-98e2-950fe2d5b92e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:01.801840 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c42eee-8998-45d5-92a0-eb985850639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:01.802556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c42eee-8998-45d5-92a0-eb985850639d admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.802871 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c42eee-8998-45d5-92a0-eb985850639d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.803230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c42eee-8998-45d5-92a0-eb985850639d admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.804033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c42eee-8998-45d5-92a0-eb985850639d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:01.805992 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c42eee-8998-45d5-92a0-eb985850639d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:01.826363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1119/2241] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:01 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:29:01.830766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c42eee-8998-45d5-92a0-eb985850639d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:01.837482 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-30192ef1-dc2a-4129-be9d-70dcca1cca1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a4c9d9808a44a18b7d85c035b50a2a5', 'request_id': 'req-30192ef1-dc2a-4129-be9d-70dcca1cca1a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.840316 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c42eee-8998-45d5-92a0-eb985850639d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:01.845156 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-30192ef1-dc2a-4129-be9d-70dcca1cca1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a4c9d9808a44a18b7d85c035b50a2a5', 'request_id': 'req-30192ef1-dc2a-4129-be9d-70dcca1cca1a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.847244 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:01.851844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-30192ef1-dc2a-4129-be9d-70dcca1cca1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a4c9d9808a44a18b7d85c035b50a2a5', 'request_id': 'req-30192ef1-dc2a-4129-be9d-70dcca1cca1a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.867201 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-30192ef1-dc2a-4129-be9d-70dcca1cca1a admin admin] The token cache is being invalidate because project 4a4c9d9808a44a18b7d85c035b50a2a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:01.867201 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-30192ef1-dc2a-4129-be9d-70dcca1cca1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.867445 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-30192ef1-dc2a-4129-be9d-70dcca1cca1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.868890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1123/2242] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:01 2022] DELETE /identity/v3/projects/4a4c9d9808a44a18b7d85c035b50a2a5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:01.874354 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29d3ee-8a7b-4750-9291-a905d38fb5b4 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.874641 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29d3ee-8a7b-4750-9291-a905d38fb5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.874915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29d3ee-8a7b-4750-9291-a905d38fb5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.893315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8e29d3ee-8a7b-4750-9291-a905d38fb5b4 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:01.894532 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8e29d3ee-8a7b-4750-9291-a905d38fb5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:01.899451 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589602a5-bab3-4acf-a463-7c5363bec5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:01.900136 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589602a5-bab3-4acf-a463-7c5363bec5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.900401 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589602a5-bab3-4acf-a463-7c5363bec5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.900710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589602a5-bab3-4acf-a463-7c5363bec5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.901447 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589602a5-bab3-4acf-a463-7c5363bec5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:01.903039 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589602a5-bab3-4acf-a463-7c5363bec5c6 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:01.903994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1124/2243] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:01.912807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e29090-7ea8-449b-a502-7c4d6a19e145 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.913100 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e29090-7ea8-449b-a502-7c4d6a19e145 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.913203 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1120/2244] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:29:01.916300 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e29090-7ea8-449b-a502-7c4d6a19e145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.916977 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589602a5-bab3-4acf-a463-7c5363bec5c6 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:01.918688 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-589602a5-bab3-4acf-a463-7c5363bec5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:01.931129 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589602a5-bab3-4acf-a463-7c5363bec5c6 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:01.935238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-27e29090-7ea8-449b-a502-7c4d6a19e145 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:01.936586 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445db4c-dc0a-4489-9b22-88f0790b7f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:01.936957 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-27e29090-7ea8-449b-a502-7c4d6a19e145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:01.937529 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445db4c-dc0a-4489-9b22-88f0790b7f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.937850 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445db4c-dc0a-4489-9b22-88f0790b7f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.938127 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445db4c-dc0a-4489-9b22-88f0790b7f2e admin admin] PATH_INFO: `/v3/projects/e8797ca3914442829b7812591b5946c4/users/f458a1776a0c475eaebca342d3ac9d3a/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.945002 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1125/2245] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:01.949110 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e29090-7ea8-449b-a502-7c4d6a19e145 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:01.954243 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445db4c-dc0a-4489-9b22-88f0790b7f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8797ca3914442829b7812591b5946c4, user_id=f458a1776a0c475eaebca342d3ac9d3a, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:01.957528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445db4c-dc0a-4489-9b22-88f0790b7f2e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:01.959258 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e29090-7ea8-449b-a502-7c4d6a19e145 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:01.964435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730311e-8e3f-437a-98a9-60445b400887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:01.965109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730311e-8e3f-437a-98a9-60445b400887 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.965465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730311e-8e3f-437a-98a9-60445b400887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.965834 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730311e-8e3f-437a-98a9-60445b400887 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.966587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730311e-8e3f-437a-98a9-60445b400887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:29:01.966900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730311e-8e3f-437a-98a9-60445b400887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:01.968586 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730311e-8e3f-437a-98a9-60445b400887 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:01.970945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1121/2246] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:01 2022] PUT /identity/v3/projects/e8797ca3914442829b7812591b5946c4/users/f458a1776a0c475eaebca342d3ac9d3a/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:29:01.974987 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445db4c-dc0a-4489-9b22-88f0790b7f2e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:01.984152 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1126/2247] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:29:01.985027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730311e-8e3f-437a-98a9-60445b400887 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:02.003294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730311e-8e3f-437a-98a9-60445b400887 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:02.039620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:02.061712 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445db4c-dc0a-4489-9b22-88f0790b7f2e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:02.068092 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db16eea-dcdb-48eb-ae79-888e7dde02e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:02.068930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db16eea-dcdb-48eb-ae79-888e7dde02e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:02.069342 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db16eea-dcdb-48eb-ae79-888e7dde02e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:02.069716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db16eea-dcdb-48eb-ae79-888e7dde02e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:02.070588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db16eea-dcdb-48eb-ae79-888e7dde02e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:02.072520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db16eea-dcdb-48eb-ae79-888e7dde02e7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:02.084414 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1122/2248] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:29:02.085527 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e8954-8620-463c-9b82-e23a450104fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:02.086374 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e8954-8620-463c-9b82-e23a450104fa admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:02.086662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e8954-8620-463c-9b82-e23a450104fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:02.086955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e8954-8620-463c-9b82-e23a450104fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:02.087724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e8954-8620-463c-9b82-e23a450104fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:02.089784 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e8954-8620-463c-9b82-e23a450104fa admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:02.092995 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db16eea-dcdb-48eb-ae79-888e7dde02e7 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:02.104358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db16eea-dcdb-48eb-ae79-888e7dde02e7 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:02.114602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d4d37-ca30-4335-abe1-b5c8d0d669bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:02.115536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d4d37-ca30-4335-abe1-b5c8d0d669bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:02.115973 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d4d37-ca30-4335-abe1-b5c8d0d669bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:02.116296 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d4d37-ca30-4335-abe1-b5c8d0d669bf admin admin] PATH_INFO: `/v3/projects/e8797ca3914442829b7812591b5946c4/users/f458a1776a0c475eaebca342d3ac9d3a/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:02.118899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d4d37-ca30-4335-abe1-b5c8d0d669bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8797ca3914442829b7812591b5946c4, user_id=f458a1776a0c475eaebca342d3ac9d3a, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:02.121529 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d4d37-ca30-4335-abe1-b5c8d0d669bf admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:02.126485 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1127/2249] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:01 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:02.130583 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e8954-8620-463c-9b82-e23a450104fa admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:02.137737 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1123/2250] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:02 2022] PUT /identity/v3/projects/e8797ca3914442829b7812591b5946c4/users/f458a1776a0c475eaebca342d3ac9d3a/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:02.149599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482ebb1-7594-4ab6-9e7e-803d7b1d4cbc None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:02.149966 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482ebb1-7594-4ab6-9e7e-803d7b1d4cbc None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:02.150267 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482ebb1-7594-4ab6-9e7e-803d7b1d4cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:02.180214 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8482ebb1-7594-4ab6-9e7e-803d7b1d4cbc None None] MFA Rules not processed for user `f458a1776a0c475eaebca342d3ac9d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:02.181473 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8482ebb1-7594-4ab6-9e7e-803d7b1d4cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:02.196515 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e8954-8620-463c-9b82-e23a450104fa admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:02.249297 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:02.261403 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e666ad-0fe9-4a72-8cca-419a5b10e6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:02.262544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e666ad-0fe9-4a72-8cca-419a5b10e6ee admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:02.263435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e666ad-0fe9-4a72-8cca-419a5b10e6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:02.263741 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e666ad-0fe9-4a72-8cca-419a5b10e6ee admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:02.264579 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e666ad-0fe9-4a72-8cca-419a5b10e6ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:02.266813 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e666ad-0fe9-4a72-8cca-419a5b10e6ee admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:02.270487 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1124/2251] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:02.281319 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482ebb1-7594-4ab6-9e7e-803d7b1d4cbc None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:02.282892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8482ebb1-7594-4ab6-9e7e-803d7b1d4cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:02.295933 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1128/2252] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:02 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:29:02.296959 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e666ad-0fe9-4a72-8cca-419a5b10e6ee admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:02.307078 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e666ad-0fe9-4a72-8cca-419a5b10e6ee admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:02.312674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe0977-f993-4dde-96fe-2e1e3ac58379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:02.313442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe0977-f993-4dde-96fe-2e1e3ac58379 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:02.313727 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe0977-f993-4dde-96fe-2e1e3ac58379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:02.314005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe0977-f993-4dde-96fe-2e1e3ac58379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:02.314733 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe0977-f993-4dde-96fe-2e1e3ac58379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:02.316367 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe0977-f993-4dde-96fe-2e1e3ac58379 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:02.327570 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1129/2253] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:02.334515 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe0977-f993-4dde-96fe-2e1e3ac58379 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:02.344566 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe0977-f993-4dde-96fe-2e1e3ac58379 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:02.350516 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482ebb1-7594-4ab6-9e7e-803d7b1d4cbc None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:02.350685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e254661-2130-4fc6-87f2-1a63c5a74036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:02.351209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e254661-2130-4fc6-87f2-1a63c5a74036 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:02.351517 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e254661-2130-4fc6-87f2-1a63c5a74036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:02.351789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e254661-2130-4fc6-87f2-1a63c5a74036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:02.352506 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e254661-2130-4fc6-87f2-1a63c5a74036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:02.354131 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e254661-2130-4fc6-87f2-1a63c5a74036 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:02.356583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11f257-3747-4eb2-969a-75b8b7f65c87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:02.357346 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11f257-3747-4eb2-969a-75b8b7f65c87 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:02.358214 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11f257-3747-4eb2-969a-75b8b7f65c87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:02.358564 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11f257-3747-4eb2-969a-75b8b7f65c87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:02.360808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6d11f257-3747-4eb2-969a-75b8b7f65c87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:02.371962 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1130/2254] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:02.376922 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e254661-2130-4fc6-87f2-1a63c5a74036 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:02.389555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e254661-2130-4fc6-87f2-1a63c5a74036 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:02.395146 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd0382-be7c-4a00-a3bb-aa5ea75280ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:02.396114 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd0382-be7c-4a00-a3bb-aa5ea75280ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:02.396392 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd0382-be7c-4a00-a3bb-aa5ea75280ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:02.396671 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd0382-be7c-4a00-a3bb-aa5ea75280ac admin admin] PATH_INFO: `/v3/projects/5e14a7d5357a4f5c84649761533d63f7/users/a8469877559643e9b14633b579787a2f/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:02.433850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd0382-be7c-4a00-a3bb-aa5ea75280ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e14a7d5357a4f5c84649761533d63f7, user_id=a8469877559643e9b14633b579787a2f, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:02.436841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd0382-be7c-4a00-a3bb-aa5ea75280ac admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:02.457421 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1131/2255] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:02 2022] PUT /identity/v3/projects/5e14a7d5357a4f5c84649761533d63f7/users/a8469877559643e9b14633b579787a2f/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:29:02.458658 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11f257-3747-4eb2-969a-75b8b7f65c87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:02.460135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11f257-3747-4eb2-969a-75b8b7f65c87 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:02.468958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf1645-afa5-4511-a669-81d2074b0baa None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:02.469529 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf1645-afa5-4511-a669-81d2074b0baa None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:02.469812 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf1645-afa5-4511-a669-81d2074b0baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:02.489480 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1125/2256] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:29:02.502876 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-dfcf1645-afa5-4511-a669-81d2074b0baa None None] MFA Rules not processed for user `a8469877559643e9b14633b579787a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:02.504410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-dfcf1645-afa5-4511-a669-81d2074b0baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:02.597195 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1132/2257] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:02.601726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11f257-3747-4eb2-969a-75b8b7f65c87 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:02.617804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11f257-3747-4eb2-969a-75b8b7f65c87 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:02.627931 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:02.712631 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b20f92-f63b-4365-847c-b29ce47e7e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:02.713599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b20f92-f63b-4365-847c-b29ce47e7e51 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:02.713885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b20f92-f63b-4365-847c-b29ce47e7e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:02.714223 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b20f92-f63b-4365-847c-b29ce47e7e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:02.714945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b20f92-f63b-4365-847c-b29ce47e7e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:02.717199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b20f92-f63b-4365-847c-b29ce47e7e51 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:02.747967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1126/2258] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:02 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:02.750070 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf1645-afa5-4511-a669-81d2074b0baa None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:02.761369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf1645-afa5-4511-a669-81d2074b0baa None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:02.827812 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f004b6f-178d-4093-8efa-5aab10d5f26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:02.828605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f004b6f-178d-4093-8efa-5aab10d5f26f admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:02.829112 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f004b6f-178d-4093-8efa-5aab10d5f26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:02.829438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f004b6f-178d-4093-8efa-5aab10d5f26f admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:02.830180 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f004b6f-178d-4093-8efa-5aab10d5f26f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:02.832293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f004b6f-178d-4093-8efa-5aab10d5f26f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:02.854460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1133/2259] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:02 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:02.858972 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b20f92-f63b-4365-847c-b29ce47e7e51 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:02.872052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b20f92-f63b-4365-847c-b29ce47e7e51 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:02.877581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc87121-49ec-40c5-8a2a-02d08ce8b0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:02.878362 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc87121-49ec-40c5-8a2a-02d08ce8b0ad admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:02.878593 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc87121-49ec-40c5-8a2a-02d08ce8b0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:02.878870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc87121-49ec-40c5-8a2a-02d08ce8b0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:02.879628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc87121-49ec-40c5-8a2a-02d08ce8b0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:02.881241 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc87121-49ec-40c5-8a2a-02d08ce8b0ad admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:02.895586 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1127/2260] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:29:02.896582 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f004b6f-178d-4093-8efa-5aab10d5f26f admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:02.906948 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f004b6f-178d-4093-8efa-5aab10d5f26f admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:02.911783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b2130-6d88-4c78-afc6-3c6524d6b878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:02.912658 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b2130-6d88-4c78-afc6-3c6524d6b878 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:02.912955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b2130-6d88-4c78-afc6-3c6524d6b878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:02.913207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b2130-6d88-4c78-afc6-3c6524d6b878 admin admin] PATH_INFO: `/v3/projects/5b5e784f4ca34b48a29ee4f009ffdf2a/users/1edd1b3faf45467b950b738e22c3177d/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:02.926179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:02.929598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b2130-6d88-4c78-afc6-3c6524d6b878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5e784f4ca34b48a29ee4f009ffdf2a, user_id=1edd1b3faf45467b950b738e22c3177d, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:02.932751 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b2130-6d88-4c78-afc6-3c6524d6b878 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:02.946814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1134/2261] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:02 2022] PUT /identity/v3/projects/5b5e784f4ca34b48a29ee4f009ffdf2a/users/1edd1b3faf45467b950b738e22c3177d/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:29:02.951645 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc87121-49ec-40c5-8a2a-02d08ce8b0ad admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:02.961803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc87121-49ec-40c5-8a2a-02d08ce8b0ad admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:03.016407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cf991-6f08-47c8-b651-27fa15655527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:03.017060 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cf991-6f08-47c8-b651-27fa15655527 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:03.017368 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cf991-6f08-47c8-b651-27fa15655527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:03.017639 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cf991-6f08-47c8-b651-27fa15655527 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:03.018356 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cf991-6f08-47c8-b651-27fa15655527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:03.019936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cf991-6f08-47c8-b651-27fa15655527 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:03.029588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1128/2262] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:29:03.033683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b2130-6d88-4c78-afc6-3c6524d6b878 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:03.044014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b2130-6d88-4c78-afc6-3c6524d6b878 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:03.049072 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58a47f-bf61-4196-a5d1-a8ab63d569cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:03.049967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58a47f-bf61-4196-a5d1-a8ab63d569cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:03.050246 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58a47f-bf61-4196-a5d1-a8ab63d569cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:03.050518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58a47f-bf61-4196-a5d1-a8ab63d569cf admin admin] PATH_INFO: `/v3/projects/5b5e784f4ca34b48a29ee4f009ffdf2a/users/1edd1b3faf45467b950b738e22c3177d/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:03.052470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58a47f-bf61-4196-a5d1-a8ab63d569cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5e784f4ca34b48a29ee4f009ffdf2a, user_id=1edd1b3faf45467b950b738e22c3177d, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:03.055333 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58a47f-bf61-4196-a5d1-a8ab63d569cf admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:03.065983 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1135/2263] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:03 2022] PUT /identity/v3/projects/5b5e784f4ca34b48a29ee4f009ffdf2a/users/1edd1b3faf45467b950b738e22c3177d/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:03.077551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec56ae-dd85-45d7-ae78-99328b971168 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:03.077845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec56ae-dd85-45d7-ae78-99328b971168 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:03.078124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec56ae-dd85-45d7-ae78-99328b971168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:03.105546 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-18ec56ae-dd85-45d7-ae78-99328b971168 None None] MFA Rules not processed for user `1edd1b3faf45467b950b738e22c3177d`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:03.106986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-18ec56ae-dd85-45d7-ae78-99328b971168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:03.176385 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1129/2264] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:03.187819 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58a47f-bf61-4196-a5d1-a8ab63d569cf admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:03.242776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58a47f-bf61-4196-a5d1-a8ab63d569cf admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:03.246475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116d6d5-6bac-4146-9f6d-f9577998704e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:03.247103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116d6d5-6bac-4146-9f6d-f9577998704e service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:03.247386 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116d6d5-6bac-4146-9f6d-f9577998704e service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:03.247664 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116d6d5-6bac-4146-9f6d-f9577998704e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:03.256535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116d6d5-6bac-4146-9f6d-f9577998704e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:03.257988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116d6d5-6bac-4146-9f6d-f9577998704e service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:03.267347 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1136/2265] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:03.650101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec56ae-dd85-45d7-ae78-99328b971168 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:03.654703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:03.735985 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec56ae-dd85-45d7-ae78-99328b971168 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:03.743951 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b562e-2829-4ab4-9aee-09ad481fde15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:03.744903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b562e-2829-4ab4-9aee-09ad481fde15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:03.745183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b562e-2829-4ab4-9aee-09ad481fde15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:03.745490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b562e-2829-4ab4-9aee-09ad481fde15 admin admin] PATH_INFO: `/v3/users/a8469877559643e9b14633b579787a2f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:03.746750 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b562e-2829-4ab4-9aee-09ad481fde15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8469877559643e9b14633b579787a2f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:03.749149 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b562e-2829-4ab4-9aee-09ad481fde15 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:03.805876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4c4b562e-2829-4ab4-9aee-09ad481fde15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8469877559643e9b14633b579787a2f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:03.806572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4c4b562e-2829-4ab4-9aee-09ad481fde15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8469877559643e9b14633b579787a2f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:03.815591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4c4b562e-2829-4ab4-9aee-09ad481fde15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8469877559643e9b14633b579787a2f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:03.816715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4c4b562e-2829-4ab4-9aee-09ad481fde15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8469877559643e9b14633b579787a2f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:03.824726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4c4b562e-2829-4ab4-9aee-09ad481fde15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8469877559643e9b14633b579787a2f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:03.844513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1130/2266] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:03 2022] DELETE /identity/v3/users/a8469877559643e9b14633b579787a2f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:03.849353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c83b25-5456-4c2a-b94d-2f5e3d564880 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:03.849833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c83b25-5456-4c2a-b94d-2f5e3d564880 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:03.850423 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c83b25-5456-4c2a-b94d-2f5e3d564880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:03.868033 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e4c83b25-5456-4c2a-b94d-2f5e3d564880 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:03.869349 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e4c83b25-5456-4c2a-b94d-2f5e3d564880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:03.932176 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1137/2267] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:03.942107 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b562e-2829-4ab4-9aee-09ad481fde15 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:03.943528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4c4b562e-2829-4ab4-9aee-09ad481fde15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:04.002951 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b562e-2829-4ab4-9aee-09ad481fde15 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:04.006749 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13202e9a-10e4-463f-921d-0db5a6d847ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:04.007395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13202e9a-10e4-463f-921d-0db5a6d847ec service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:04.007681 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13202e9a-10e4-463f-921d-0db5a6d847ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:04.007960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13202e9a-10e4-463f-921d-0db5a6d847ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:04.018280 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13202e9a-10e4-463f-921d-0db5a6d847ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:04.019715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13202e9a-10e4-463f-921d-0db5a6d847ec service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:04.029474 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1131/2268] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:04.334735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c83b25-5456-4c2a-b94d-2f5e3d564880 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:04.335913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e4c83b25-5456-4c2a-b94d-2f5e3d564880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:04.348993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c83b25-5456-4c2a-b94d-2f5e3d564880 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:04.354249 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a757a0-eeb6-42ef-8e40-c8b8af4d02ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:04.355134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a757a0-eeb6-42ef-8e40-c8b8af4d02ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:04.355414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a757a0-eeb6-42ef-8e40-c8b8af4d02ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:04.355683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a757a0-eeb6-42ef-8e40-c8b8af4d02ad admin admin] PATH_INFO: `/v3/projects/5e14a7d5357a4f5c84649761533d63f7` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:04.356852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a757a0-eeb6-42ef-8e40-c8b8af4d02ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e14a7d5357a4f5c84649761533d63f7)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:04.359324 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a757a0-eeb6-42ef-8e40-c8b8af4d02ad admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:04.405400 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a8a757a0-eeb6-42ef-8e40-c8b8af4d02ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e14a7d5357a4f5c84649761533d63f7', 'request_id': 'req-a8a757a0-eeb6-42ef-8e40-c8b8af4d02ad'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:04.413448 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a8a757a0-eeb6-42ef-8e40-c8b8af4d02ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e14a7d5357a4f5c84649761533d63f7', 'request_id': 'req-a8a757a0-eeb6-42ef-8e40-c8b8af4d02ad'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:04.419084 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a8a757a0-eeb6-42ef-8e40-c8b8af4d02ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e14a7d5357a4f5c84649761533d63f7', 'request_id': 'req-a8a757a0-eeb6-42ef-8e40-c8b8af4d02ad'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:04.430380 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a8a757a0-eeb6-42ef-8e40-c8b8af4d02ad admin admin] The token cache is being invalidate because project 5e14a7d5357a4f5c84649761533d63f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:04.430667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a8a757a0-eeb6-42ef-8e40-c8b8af4d02ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:04.431295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a8a757a0-eeb6-42ef-8e40-c8b8af4d02ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:04.432852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1138/2269] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:04 2022] DELETE /identity/v3/projects/5e14a7d5357a4f5c84649761533d63f7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:04.437450 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13202e9a-10e4-463f-921d-0db5a6d847ec service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:04.447082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13202e9a-10e4-463f-921d-0db5a6d847ec service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:04.466577 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:04.506133 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1ca1a-6de0-45f6-b30c-02aeb31077dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:04.507004 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1ca1a-6de0-45f6-b30c-02aeb31077dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:04.507291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1ca1a-6de0-45f6-b30c-02aeb31077dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:04.507570 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1ca1a-6de0-45f6-b30c-02aeb31077dc admin admin] PATH_INFO: `/v3/users/1edd1b3faf45467b950b738e22c3177d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:04.508811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1ca1a-6de0-45f6-b30c-02aeb31077dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1edd1b3faf45467b950b738e22c3177d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:04.510763 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1ca1a-6de0-45f6-b30c-02aeb31077dc admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:04.557503 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-9dd1ca1a-6de0-45f6-b30c-02aeb31077dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1edd1b3faf45467b950b738e22c3177d'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:04.558160 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-9dd1ca1a-6de0-45f6-b30c-02aeb31077dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1edd1b3faf45467b950b738e22c3177d'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:04.566245 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-9dd1ca1a-6de0-45f6-b30c-02aeb31077dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1edd1b3faf45467b950b738e22c3177d'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:04.567294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-9dd1ca1a-6de0-45f6-b30c-02aeb31077dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1edd1b3faf45467b950b738e22c3177d'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:04.576769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-9dd1ca1a-6de0-45f6-b30c-02aeb31077dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1edd1b3faf45467b950b738e22c3177d'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:04.600661 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1132/2270] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:04 2022] DELETE /identity/v3/users/1edd1b3faf45467b950b738e22c3177d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:04.907946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a757a0-eeb6-42ef-8e40-c8b8af4d02ad admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:04.909431 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a8a757a0-eeb6-42ef-8e40-c8b8af4d02ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:04.919952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:04.926268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a757a0-eeb6-42ef-8e40-c8b8af4d02ad admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:05.053713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91958f3-c360-4eab-8209-7c32abaecffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:05.054814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91958f3-c360-4eab-8209-7c32abaecffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:05.055185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91958f3-c360-4eab-8209-7c32abaecffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:05.055528 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91958f3-c360-4eab-8209-7c32abaecffa admin admin] PATH_INFO: `/v3/projects/5b5e784f4ca34b48a29ee4f009ffdf2a` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:05.056808 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91958f3-c360-4eab-8209-7c32abaecffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b5e784f4ca34b48a29ee4f009ffdf2a)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:05.058859 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91958f3-c360-4eab-8209-7c32abaecffa admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:05.108810 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a91958f3-c360-4eab-8209-7c32abaecffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b5e784f4ca34b48a29ee4f009ffdf2a', 'request_id': 'req-a91958f3-c360-4eab-8209-7c32abaecffa'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:05.116157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a91958f3-c360-4eab-8209-7c32abaecffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b5e784f4ca34b48a29ee4f009ffdf2a', 'request_id': 'req-a91958f3-c360-4eab-8209-7c32abaecffa'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:05.122158 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a91958f3-c360-4eab-8209-7c32abaecffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b5e784f4ca34b48a29ee4f009ffdf2a', 'request_id': 'req-a91958f3-c360-4eab-8209-7c32abaecffa'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:05.134524 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a91958f3-c360-4eab-8209-7c32abaecffa admin admin] The token cache is being invalidate because project 5b5e784f4ca34b48a29ee4f009ffdf2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:05.134846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a91958f3-c360-4eab-8209-7c32abaecffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:05.135504 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a91958f3-c360-4eab-8209-7c32abaecffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:05.137070 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1139/2271] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:04 2022] DELETE /identity/v3/projects/5b5e784f4ca34b48a29ee4f009ffdf2a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:05.143563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15847a21-bb18-465a-895d-a6e6849fd20d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:05.144062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15847a21-bb18-465a-895d-a6e6849fd20d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:05.144157 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15847a21-bb18-465a-895d-a6e6849fd20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:05.163208 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-15847a21-bb18-465a-895d-a6e6849fd20d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:05.164411 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-15847a21-bb18-465a-895d-a6e6849fd20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:05.230952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1133/2272] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:05.234808 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93a598-4f90-4fc5-ad78-acd3b2b39eee None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:05.235096 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93a598-4f90-4fc5-ad78-acd3b2b39eee None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:05.235377 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93a598-4f90-4fc5-ad78-acd3b2b39eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:05.255659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-3d93a598-4f90-4fc5-ad78-acd3b2b39eee None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:05.256946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3d93a598-4f90-4fc5-ad78-acd3b2b39eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:05.266079 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1140/2273] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:05.271722 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15847a21-bb18-465a-895d-a6e6849fd20d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:05.287364 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15847a21-bb18-465a-895d-a6e6849fd20d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:05.292826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94bfb5-ad1f-4b17-bc5e-05579f2d0e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:05.293516 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94bfb5-ad1f-4b17-bc5e-05579f2d0e23 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:05.293806 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94bfb5-ad1f-4b17-bc5e-05579f2d0e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:05.294080 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94bfb5-ad1f-4b17-bc5e-05579f2d0e23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:05.294777 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94bfb5-ad1f-4b17-bc5e-05579f2d0e23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:29:05.295082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94bfb5-ad1f-4b17-bc5e-05579f2d0e23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:05.296673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94bfb5-ad1f-4b17-bc5e-05579f2d0e23 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:05.312285 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1134/2274] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:29:05.316791 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93a598-4f90-4fc5-ad78-acd3b2b39eee None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:05.329361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93a598-4f90-4fc5-ad78-acd3b2b39eee None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:05.336681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63686a9c-cf87-4391-b6b6-b46f583fd871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:05.337604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63686a9c-cf87-4391-b6b6-b46f583fd871 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:05.341175 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63686a9c-cf87-4391-b6b6-b46f583fd871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:05.342618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63686a9c-cf87-4391-b6b6-b46f583fd871 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:05.344184 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63686a9c-cf87-4391-b6b6-b46f583fd871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:05.352597 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63686a9c-cf87-4391-b6b6-b46f583fd871 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:05.385572 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1141/2275] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:05 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:29:05.389683 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94bfb5-ad1f-4b17-bc5e-05579f2d0e23 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:05.406720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94bfb5-ad1f-4b17-bc5e-05579f2d0e23 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:05.448074 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:05.500655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d60dd-e85b-4889-8919-060dfd28993c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:05.501369 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d60dd-e85b-4889-8919-060dfd28993c admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:05.501657 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d60dd-e85b-4889-8919-060dfd28993c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:05.501929 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d60dd-e85b-4889-8919-060dfd28993c admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:05.502627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d60dd-e85b-4889-8919-060dfd28993c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:05.504612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d60dd-e85b-4889-8919-060dfd28993c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:05.531464 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1135/2276] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:05 2022] POST /identity/v3/users => generated 285 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:05.543071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63686a9c-cf87-4391-b6b6-b46f583fd871 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:05.557194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63686a9c-cf87-4391-b6b6-b46f583fd871 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:05.573275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbd614-062b-48c8-b37a-bf05c0fd47b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:05.573922 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbd614-062b-48c8-b37a-bf05c0fd47b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:05.574275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbd614-062b-48c8-b37a-bf05c0fd47b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:05.574624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbd614-062b-48c8-b37a-bf05c0fd47b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:05.575724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbd614-062b-48c8-b37a-bf05c0fd47b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:05.577940 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbd614-062b-48c8-b37a-bf05c0fd47b8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:05.591399 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1142/2277] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:05.596625 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d60dd-e85b-4889-8919-060dfd28993c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:05.614429 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d60dd-e85b-4889-8919-060dfd28993c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:05.625144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b016db-0e3d-4be1-82db-3f664b02137a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:05.625846 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b016db-0e3d-4be1-82db-3f664b02137a admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:05.626123 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b016db-0e3d-4be1-82db-3f664b02137a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:05.626697 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b016db-0e3d-4be1-82db-3f664b02137a admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:05.627426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b016db-0e3d-4be1-82db-3f664b02137a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:05.629178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b016db-0e3d-4be1-82db-3f664b02137a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:05.641490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1136/2278] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:05.645793 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbd614-062b-48c8-b37a-bf05c0fd47b8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:05.664741 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbd614-062b-48c8-b37a-bf05c0fd47b8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:05.671327 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad2c51-982e-4f18-913a-5596677bf936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:05.673636 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad2c51-982e-4f18-913a-5596677bf936 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:05.674145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad2c51-982e-4f18-913a-5596677bf936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:05.674496 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad2c51-982e-4f18-913a-5596677bf936 admin admin] PATH_INFO: `/v3/projects/6d04a3f2df5542dca23cba5e6dab55cd/users/2279b71fb6a14244a7e7730f06425797/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:05.692664 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad2c51-982e-4f18-913a-5596677bf936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d04a3f2df5542dca23cba5e6dab55cd, user_id=2279b71fb6a14244a7e7730f06425797, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:05.694034 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad2c51-982e-4f18-913a-5596677bf936 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:05.711995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1143/2279] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:05 2022] PUT /identity/v3/projects/6d04a3f2df5542dca23cba5e6dab55cd/users/2279b71fb6a14244a7e7730f06425797/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:29:05.725121 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a3615-8258-4f61-84ab-2a4e893c4ed7 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:05.725121 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a3615-8258-4f61-84ab-2a4e893c4ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:05.725121 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a3615-8258-4f61-84ab-2a4e893c4ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:05.752210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6e3a3615-8258-4f61-84ab-2a4e893c4ed7 None None] MFA Rules not processed for user `2279b71fb6a14244a7e7730f06425797`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:05.753511 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6e3a3615-8258-4f61-84ab-2a4e893c4ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:05.818183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1137/2280] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:05.822691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad2c51-982e-4f18-913a-5596677bf936 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:05.860377 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:05.898976 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad2c51-982e-4f18-913a-5596677bf936 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:05.904089 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c4011-fe95-4a37-a3c5-963a1adb5be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:05.904755 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c4011-fe95-4a37-a3c5-963a1adb5be1 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:05.905071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c4011-fe95-4a37-a3c5-963a1adb5be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:05.905384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c4011-fe95-4a37-a3c5-963a1adb5be1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:05.906079 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c4011-fe95-4a37-a3c5-963a1adb5be1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:05.908126 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c4011-fe95-4a37-a3c5-963a1adb5be1 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:05.936897 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1144/2281] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:05 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:05.940691 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a3615-8258-4f61-84ab-2a4e893c4ed7 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:05.951549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a3615-8258-4f61-84ab-2a4e893c4ed7 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:06.014208 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb96d63-34e8-4834-9969-13b3959db32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:06.014976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb96d63-34e8-4834-9969-13b3959db32a admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:06.015319 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb96d63-34e8-4834-9969-13b3959db32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:06.015603 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb96d63-34e8-4834-9969-13b3959db32a admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:06.016291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb96d63-34e8-4834-9969-13b3959db32a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:06.018281 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb96d63-34e8-4834-9969-13b3959db32a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:06.050665 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1138/2282] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:05 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:06.056433 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c4011-fe95-4a37-a3c5-963a1adb5be1 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:06.086683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c4011-fe95-4a37-a3c5-963a1adb5be1 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:06.096499 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f777093-e27f-4219-8f76-39e82ce2855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:06.097325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f777093-e27f-4219-8f76-39e82ce2855a admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:06.098377 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f777093-e27f-4219-8f76-39e82ce2855a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:06.098829 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f777093-e27f-4219-8f76-39e82ce2855a admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:06.099454 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f777093-e27f-4219-8f76-39e82ce2855a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:06.101484 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f777093-e27f-4219-8f76-39e82ce2855a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:06.120263 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1145/2283] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:06.125605 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb96d63-34e8-4834-9969-13b3959db32a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:06.135967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb96d63-34e8-4834-9969-13b3959db32a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:06.141026 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4526f4-abcb-447c-8746-4d69da69f2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:06.141692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4526f4-abcb-447c-8746-4d69da69f2ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:06.141973 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4526f4-abcb-447c-8746-4d69da69f2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:06.142447 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4526f4-abcb-447c-8746-4d69da69f2ce admin admin] PATH_INFO: `/v3/projects/0dfdfde49cca48309977de8a2fa94ca3/users/2717bb2a50964e289f88f8e54be07141/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:06.159142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4526f4-abcb-447c-8746-4d69da69f2ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dfdfde49cca48309977de8a2fa94ca3, user_id=2717bb2a50964e289f88f8e54be07141, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:06.161818 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4526f4-abcb-447c-8746-4d69da69f2ce admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:06.178538 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1139/2284] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:06 2022] PUT /identity/v3/projects/0dfdfde49cca48309977de8a2fa94ca3/users/2717bb2a50964e289f88f8e54be07141/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:06.182652 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f777093-e27f-4219-8f76-39e82ce2855a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:06.192963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f777093-e27f-4219-8f76-39e82ce2855a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:06.251731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758918d-293e-4fea-bf2a-50d4df25e037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:06.252409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758918d-293e-4fea-bf2a-50d4df25e037 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:06.252690 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758918d-293e-4fea-bf2a-50d4df25e037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:06.252969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758918d-293e-4fea-bf2a-50d4df25e037 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:06.253729 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758918d-293e-4fea-bf2a-50d4df25e037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:06.255386 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758918d-293e-4fea-bf2a-50d4df25e037 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:06.269190 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1146/2285] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:29:06.273425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4526f4-abcb-447c-8746-4d69da69f2ce admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:06.280699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:06.284708 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4526f4-abcb-447c-8746-4d69da69f2ce admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:06.290679 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c5ebf-078e-4934-b05d-88cc200ec375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:06.291804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c5ebf-078e-4934-b05d-88cc200ec375 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:06.292346 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c5ebf-078e-4934-b05d-88cc200ec375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:06.292625 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c5ebf-078e-4934-b05d-88cc200ec375 admin admin] PATH_INFO: `/v3/projects/0dfdfde49cca48309977de8a2fa94ca3/users/2717bb2a50964e289f88f8e54be07141/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:06.296040 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c5ebf-078e-4934-b05d-88cc200ec375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dfdfde49cca48309977de8a2fa94ca3, user_id=2717bb2a50964e289f88f8e54be07141, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:06.298545 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c5ebf-078e-4934-b05d-88cc200ec375 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:06.309544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1140/2286] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:06 2022] PUT /identity/v3/projects/0dfdfde49cca48309977de8a2fa94ca3/users/2717bb2a50964e289f88f8e54be07141/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:06.320617 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463bc50-4775-45d2-ba86-d1772ee1453a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:06.320906 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463bc50-4775-45d2-ba86-d1772ee1453a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:06.321212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463bc50-4775-45d2-ba86-d1772ee1453a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:06.347632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-3463bc50-4775-45d2-ba86-d1772ee1453a None None] MFA Rules not processed for user `2717bb2a50964e289f88f8e54be07141`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:06.348833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3463bc50-4775-45d2-ba86-d1772ee1453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:06.423720 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1147/2287] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:06 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:06.436187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c5ebf-078e-4934-b05d-88cc200ec375 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:06.438410 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2b6c5ebf-078e-4934-b05d-88cc200ec375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:06.497618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c5ebf-078e-4934-b05d-88cc200ec375 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:06.502007 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735cb5b-632b-47a0-9890-2c9a565afaa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:06.502607 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735cb5b-632b-47a0-9890-2c9a565afaa1 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:06.502894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735cb5b-632b-47a0-9890-2c9a565afaa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:06.503170 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735cb5b-632b-47a0-9890-2c9a565afaa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:06.512713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735cb5b-632b-47a0-9890-2c9a565afaa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:06.514251 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735cb5b-632b-47a0-9890-2c9a565afaa1 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:06.523728 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1141/2288] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:06 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:06.689835 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463bc50-4775-45d2-ba86-d1772ee1453a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:06.691218 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3463bc50-4775-45d2-ba86-d1772ee1453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:06.723553 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:06.784451 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463bc50-4775-45d2-ba86-d1772ee1453a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:06.790980 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99642e-39a5-4302-8ba3-ef19842e1215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:06.791952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99642e-39a5-4302-8ba3-ef19842e1215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:06.792321 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99642e-39a5-4302-8ba3-ef19842e1215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:06.792562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99642e-39a5-4302-8ba3-ef19842e1215 admin admin] PATH_INFO: `/v3/users/2f7e6ba54fc84b5c9154762cdfeef21c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:06.793890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99642e-39a5-4302-8ba3-ef19842e1215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f7e6ba54fc84b5c9154762cdfeef21c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:06.799141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99642e-39a5-4302-8ba3-ef19842e1215 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:06.849901 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735cb5b-632b-47a0-9890-2c9a565afaa1 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:06.851317 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6735cb5b-632b-47a0-9890-2c9a565afaa1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:06.861570 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ba99642e-39a5-4302-8ba3-ef19842e1215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7e6ba54fc84b5c9154762cdfeef21c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:06.862233 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ba99642e-39a5-4302-8ba3-ef19842e1215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7e6ba54fc84b5c9154762cdfeef21c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:06.867829 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735cb5b-632b-47a0-9890-2c9a565afaa1 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:06.873009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc9ee6-ef4c-42cf-9e2e-31db81ce010f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:06.873986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc9ee6-ef4c-42cf-9e2e-31db81ce010f service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:06.874440 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc9ee6-ef4c-42cf-9e2e-31db81ce010f service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:06.874886 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc9ee6-ef4c-42cf-9e2e-31db81ce010f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:06.876448 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ba99642e-39a5-4302-8ba3-ef19842e1215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7e6ba54fc84b5c9154762cdfeef21c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:06.877023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2cbc9ee6-ef4c-42cf-9e2e-31db81ce010f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:06.884777 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ba99642e-39a5-4302-8ba3-ef19842e1215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7e6ba54fc84b5c9154762cdfeef21c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:06.885977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ba99642e-39a5-4302-8ba3-ef19842e1215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7e6ba54fc84b5c9154762cdfeef21c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:06.905537 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1148/2289] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:06 2022] DELETE /identity/v3/users/2f7e6ba54fc84b5c9154762cdfeef21c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:06.910923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f327a1-6be6-47ee-bf58-4353475715e1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:06.910923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f327a1-6be6-47ee-bf58-4353475715e1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:06.910923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f327a1-6be6-47ee-bf58-4353475715e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:06.929924 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-83f327a1-6be6-47ee-bf58-4353475715e1 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:06.931134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-83f327a1-6be6-47ee-bf58-4353475715e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:06.980900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc9ee6-ef4c-42cf-9e2e-31db81ce010f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:06.982486 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc9ee6-ef4c-42cf-9e2e-31db81ce010f service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:06.995830 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1142/2290] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:29:06.997872 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1149/2291] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:07.011142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc9ee6-ef4c-42cf-9e2e-31db81ce010f service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:07.013035 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2cbc9ee6-ef4c-42cf-9e2e-31db81ce010f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:07.101379 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc9ee6-ef4c-42cf-9e2e-31db81ce010f service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:07.165326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:07.183267 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57f0cd-3218-4552-b5ac-8db760ac6665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:07.184811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57f0cd-3218-4552-b5ac-8db760ac6665 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:07.185133 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57f0cd-3218-4552-b5ac-8db760ac6665 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:07.186190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57f0cd-3218-4552-b5ac-8db760ac6665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:07.199485 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57f0cd-3218-4552-b5ac-8db760ac6665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:07.201881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57f0cd-3218-4552-b5ac-8db760ac6665 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:07.213767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1143/2292] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:07.589061 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f327a1-6be6-47ee-bf58-4353475715e1 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:07.591716 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-83f327a1-6be6-47ee-bf58-4353475715e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:07.614605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f327a1-6be6-47ee-bf58-4353475715e1 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:07.630947 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b596b3-39fe-417e-82de-60f5ae745609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:07.631331 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b596b3-39fe-417e-82de-60f5ae745609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:07.631580 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b596b3-39fe-417e-82de-60f5ae745609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:07.631945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b596b3-39fe-417e-82de-60f5ae745609 admin admin] PATH_INFO: `/v3/projects/856aab00318c422d9b1381f148d24850` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:07.636259 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b596b3-39fe-417e-82de-60f5ae745609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=856aab00318c422d9b1381f148d24850)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:07.638520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b596b3-39fe-417e-82de-60f5ae745609 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:07.693751 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:07.700984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-63b596b3-39fe-417e-82de-60f5ae745609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856aab00318c422d9b1381f148d24850', 'request_id': 'req-63b596b3-39fe-417e-82de-60f5ae745609'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:07.711785 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-63b596b3-39fe-417e-82de-60f5ae745609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856aab00318c422d9b1381f148d24850', 'request_id': 'req-63b596b3-39fe-417e-82de-60f5ae745609'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:07.719782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-63b596b3-39fe-417e-82de-60f5ae745609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856aab00318c422d9b1381f148d24850', 'request_id': 'req-63b596b3-39fe-417e-82de-60f5ae745609'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:07.731525 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-63b596b3-39fe-417e-82de-60f5ae745609 admin admin] The token cache is being invalidate because project 856aab00318c422d9b1381f148d24850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:07.731853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-63b596b3-39fe-417e-82de-60f5ae745609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:07.732484 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-63b596b3-39fe-417e-82de-60f5ae745609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:07.734405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1150/2293] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:07 2022] DELETE /identity/v3/projects/856aab00318c422d9b1381f148d24850 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:07.739697 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b72c7-7590-4bd9-8047-a0c362790a8d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:07.740011 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b72c7-7590-4bd9-8047-a0c362790a8d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:07.740386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b72c7-7590-4bd9-8047-a0c362790a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:07.760706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-9d9b72c7-7590-4bd9-8047-a0c362790a8d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:07.764686 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9d9b72c7-7590-4bd9-8047-a0c362790a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:07.829107 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1144/2294] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:07.837386 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abc850-3494-482e-b1f6-4311d61dddc0 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:07.837699 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abc850-3494-482e-b1f6-4311d61dddc0 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:07.837992 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abc850-3494-482e-b1f6-4311d61dddc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:07.856448 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d2abc850-3494-482e-b1f6-4311d61dddc0 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:07.858233 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d2abc850-3494-482e-b1f6-4311d61dddc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:07.866227 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1151/2295] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:07.872470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b72c7-7590-4bd9-8047-a0c362790a8d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:07.883521 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b72c7-7590-4bd9-8047-a0c362790a8d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:07.890460 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a81ec-32d6-495d-8989-928ea29cacbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:07.891125 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a81ec-32d6-495d-8989-928ea29cacbf admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:07.891410 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a81ec-32d6-495d-8989-928ea29cacbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:07.891685 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a81ec-32d6-495d-8989-928ea29cacbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:07.892420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a81ec-32d6-495d-8989-928ea29cacbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:29:07.892732 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a81ec-32d6-495d-8989-928ea29cacbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:07.894701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a81ec-32d6-495d-8989-928ea29cacbf admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:07.910968 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1145/2296] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:29:07.912241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abc850-3494-482e-b1f6-4311d61dddc0 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:07.923040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abc850-3494-482e-b1f6-4311d61dddc0 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:07.930381 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c344d9-4920-4c88-acc3-9934044fb4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:07.931071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c344d9-4920-4c88-acc3-9934044fb4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:07.931377 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c344d9-4920-4c88-acc3-9934044fb4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:07.931652 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c344d9-4920-4c88-acc3-9934044fb4c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:07.932339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c344d9-4920-4c88-acc3-9934044fb4c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:07.934307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c344d9-4920-4c88-acc3-9934044fb4c1 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:07.961603 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1152/2297] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:07 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:07.973532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a81ec-32d6-495d-8989-928ea29cacbf admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:07.978576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a81ec-32d6-495d-8989-928ea29cacbf admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:08.055985 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b42b4e-604c-48d1-a23a-744c0c3eee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:08.056724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b42b4e-604c-48d1-a23a-744c0c3eee08 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:08.057074 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b42b4e-604c-48d1-a23a-744c0c3eee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:08.057379 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b42b4e-604c-48d1-a23a-744c0c3eee08 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:08.058074 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b42b4e-604c-48d1-a23a-744c0c3eee08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:08.062952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b42b4e-604c-48d1-a23a-744c0c3eee08 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:08.087567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1146/2298] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:07 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:08.091566 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c344d9-4920-4c88-acc3-9934044fb4c1 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:08.103052 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c344d9-4920-4c88-acc3-9934044fb4c1 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:08.107982 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6e4d2-aa9f-4422-81d5-52b787f13bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:08.109132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6e4d2-aa9f-4422-81d5-52b787f13bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:08.109723 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6e4d2-aa9f-4422-81d5-52b787f13bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:08.110138 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6e4d2-aa9f-4422-81d5-52b787f13bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:08.111030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6e4d2-aa9f-4422-81d5-52b787f13bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:08.112783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6e4d2-aa9f-4422-81d5-52b787f13bfa admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:08.124249 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1153/2299] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:08.128274 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b42b4e-604c-48d1-a23a-744c0c3eee08 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:08.141152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b42b4e-604c-48d1-a23a-744c0c3eee08 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:08.146171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1da50-596c-41b9-bc4d-e9ead1d0e018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:08.146908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1da50-596c-41b9-bc4d-e9ead1d0e018 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:08.147255 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1da50-596c-41b9-bc4d-e9ead1d0e018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:08.147530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1da50-596c-41b9-bc4d-e9ead1d0e018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:08.148906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1da50-596c-41b9-bc4d-e9ead1d0e018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:08.150608 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1da50-596c-41b9-bc4d-e9ead1d0e018 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:08.163514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1147/2300] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:08.167796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6e4d2-aa9f-4422-81d5-52b787f13bfa admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:08.189058 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6e4d2-aa9f-4422-81d5-52b787f13bfa admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:08.194211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dd0d3-9744-4e50-8bf7-bf28e348e2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:08.195160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dd0d3-9744-4e50-8bf7-bf28e348e2c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:08.195617 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dd0d3-9744-4e50-8bf7-bf28e348e2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:08.196050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dd0d3-9744-4e50-8bf7-bf28e348e2c9 admin admin] PATH_INFO: `/v3/projects/d3ce2df2a9bd48ba97e70fc9ac52e5d8/users/b331ba96a2b94bd5bd3bffd43c18a427/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:08.213342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3dd0d3-9744-4e50-8bf7-bf28e348e2c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ce2df2a9bd48ba97e70fc9ac52e5d8, user_id=b331ba96a2b94bd5bd3bffd43c18a427, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:08.216084 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3dd0d3-9744-4e50-8bf7-bf28e348e2c9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:08.228721 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1154/2301] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:08 2022] PUT /identity/v3/projects/d3ce2df2a9bd48ba97e70fc9ac52e5d8/users/b331ba96a2b94bd5bd3bffd43c18a427/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:08.233867 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5410d-cdbc-4774-9bb0-ce530788a1c2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:08.234339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5410d-cdbc-4774-9bb0-ce530788a1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:08.234439 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5410d-cdbc-4774-9bb0-ce530788a1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:08.253085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a5a5410d-cdbc-4774-9bb0-ce530788a1c2 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:08.254321 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a5a5410d-cdbc-4774-9bb0-ce530788a1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:08.307086 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:08.323843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1148/2302] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:08.333904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dd0d3-9744-4e50-8bf7-bf28e348e2c9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:08.335893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6a3dd0d3-9744-4e50-8bf7-bf28e348e2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:08.395463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5410d-cdbc-4774-9bb0-ce530788a1c2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:08.396873 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a5a5410d-cdbc-4774-9bb0-ce530788a1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:08.398525 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dd0d3-9744-4e50-8bf7-bf28e348e2c9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:08.403135 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12056b8-f0d8-4363-84a8-f6787b6647f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:08.403764 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12056b8-f0d8-4363-84a8-f6787b6647f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:08.404105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12056b8-f0d8-4363-84a8-f6787b6647f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:08.405007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12056b8-f0d8-4363-84a8-f6787b6647f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:08.410673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5410d-cdbc-4774-9bb0-ce530788a1c2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:08.415787 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52a335-a157-44ed-97da-8f4eff6b8fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:08.416666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52a335-a157-44ed-97da-8f4eff6b8fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:08.416944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52a335-a157-44ed-97da-8f4eff6b8fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:08.417049 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12056b8-f0d8-4363-84a8-f6787b6647f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:08.417274 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52a335-a157-44ed-97da-8f4eff6b8fa4 admin admin] PATH_INFO: `/v3/users/2279b71fb6a14244a7e7730f06425797` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:08.418437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12056b8-f0d8-4363-84a8-f6787b6647f0 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:08.418544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52a335-a157-44ed-97da-8f4eff6b8fa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2279b71fb6a14244a7e7730f06425797)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:08.420417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52a335-a157-44ed-97da-8f4eff6b8fa4 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:08.428616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1155/2303] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:08.475568 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6e52a335-a157-44ed-97da-8f4eff6b8fa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2279b71fb6a14244a7e7730f06425797'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:08.476547 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6e52a335-a157-44ed-97da-8f4eff6b8fa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2279b71fb6a14244a7e7730f06425797'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:08.485081 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6e52a335-a157-44ed-97da-8f4eff6b8fa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2279b71fb6a14244a7e7730f06425797'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:08.486218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6e52a335-a157-44ed-97da-8f4eff6b8fa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2279b71fb6a14244a7e7730f06425797'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:08.496536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6e52a335-a157-44ed-97da-8f4eff6b8fa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2279b71fb6a14244a7e7730f06425797'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:08.529520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1149/2304] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:08 2022] DELETE /identity/v3/users/2279b71fb6a14244a7e7730f06425797 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:29:08.534291 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f14a2d-7fe9-4715-a28d-15a59bf14c15 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:08.534866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f14a2d-7fe9-4715-a28d-15a59bf14c15 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:08.535301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f14a2d-7fe9-4715-a28d-15a59bf14c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:08.558474 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-73f14a2d-7fe9-4715-a28d-15a59bf14c15 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:08.559819 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-73f14a2d-7fe9-4715-a28d-15a59bf14c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:08.663907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1156/2305] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:08.675844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52a335-a157-44ed-97da-8f4eff6b8fa4 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:08.677994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6e52a335-a157-44ed-97da-8f4eff6b8fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:08.793643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52a335-a157-44ed-97da-8f4eff6b8fa4 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:08.807320 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d9435-e610-40dc-9d93-4c56c3c69592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:08.808666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d9435-e610-40dc-9d93-4c56c3c69592 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:08.808932 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d9435-e610-40dc-9d93-4c56c3c69592 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:08.809309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d9435-e610-40dc-9d93-4c56c3c69592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:08.821531 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d9435-e610-40dc-9d93-4c56c3c69592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:08.822983 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d9435-e610-40dc-9d93-4c56c3c69592 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:08.840059 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1150/2306] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:09.557207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f14a2d-7fe9-4715-a28d-15a59bf14c15 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:09.558701 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-73f14a2d-7fe9-4715-a28d-15a59bf14c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:09.585193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f14a2d-7fe9-4715-a28d-15a59bf14c15 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:09.605442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849aa3b-c565-4766-bf19-e775e6675309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:09.606542 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849aa3b-c565-4766-bf19-e775e6675309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:09.607056 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849aa3b-c565-4766-bf19-e775e6675309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:09.608578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849aa3b-c565-4766-bf19-e775e6675309 admin admin] PATH_INFO: `/v3/projects/6d04a3f2df5542dca23cba5e6dab55cd` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:09.610174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849aa3b-c565-4766-bf19-e775e6675309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d04a3f2df5542dca23cba5e6dab55cd)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:09.612543 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849aa3b-c565-4766-bf19-e775e6675309 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:09.615660 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:09.693414 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675c8fc-09d8-4c3b-9be1-58f4270f10ee None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:09.694048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675c8fc-09d8-4c3b-9be1-58f4270f10ee None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:09.694220 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675c8fc-09d8-4c3b-9be1-58f4270f10ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:09.700010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9849aa3b-c565-4766-bf19-e775e6675309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d04a3f2df5542dca23cba5e6dab55cd', 'request_id': 'req-9849aa3b-c565-4766-bf19-e775e6675309'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:09.714085 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9849aa3b-c565-4766-bf19-e775e6675309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d04a3f2df5542dca23cba5e6dab55cd', 'request_id': 'req-9849aa3b-c565-4766-bf19-e775e6675309'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:09.729726 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9849aa3b-c565-4766-bf19-e775e6675309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d04a3f2df5542dca23cba5e6dab55cd', 'request_id': 'req-9849aa3b-c565-4766-bf19-e775e6675309'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:09.732293 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b675c8fc-09d8-4c3b-9be1-58f4270f10ee None None] MFA Rules not processed for user `b331ba96a2b94bd5bd3bffd43c18a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:09.733784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b675c8fc-09d8-4c3b-9be1-58f4270f10ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:09.744750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9849aa3b-c565-4766-bf19-e775e6675309 admin admin] The token cache is being invalidate because project 6d04a3f2df5542dca23cba5e6dab55cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:09.744750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9849aa3b-c565-4766-bf19-e775e6675309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:09.745387 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9849aa3b-c565-4766-bf19-e775e6675309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:09.749825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1157/2307] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:09 2022] DELETE /identity/v3/projects/6d04a3f2df5542dca23cba5e6dab55cd => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:09.753525 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849aa3b-c565-4766-bf19-e775e6675309 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:09.755339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9849aa3b-c565-4766-bf19-e775e6675309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:09.846455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:09.858286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1151/2308] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:09.878647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675c8fc-09d8-4c3b-9be1-58f4270f10ee None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:09.880155 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b675c8fc-09d8-4c3b-9be1-58f4270f10ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:09.906859 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849aa3b-c565-4766-bf19-e775e6675309 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:09.918919 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf5af3-1139-4f31-894a-a34daeffbcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:09.919858 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf5af3-1139-4f31-894a-a34daeffbcbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:09.920147 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf5af3-1139-4f31-894a-a34daeffbcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:09.920478 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf5af3-1139-4f31-894a-a34daeffbcbc admin admin] PATH_INFO: `/v3/users/2717bb2a50964e289f88f8e54be07141` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:09.924407 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf5af3-1139-4f31-894a-a34daeffbcbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2717bb2a50964e289f88f8e54be07141)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:09.926449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf5af3-1139-4f31-894a-a34daeffbcbc admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:09.965775 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675c8fc-09d8-4c3b-9be1-58f4270f10ee None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:09.969880 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ad423-0a84-4d8c-8b82-1fa41f96f50b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:09.970822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ad423-0a84-4d8c-8b82-1fa41f96f50b service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:09.971158 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ad423-0a84-4d8c-8b82-1fa41f96f50b service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:09.971440 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ad423-0a84-4d8c-8b82-1fa41f96f50b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:09.983199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ad423-0a84-4d8c-8b82-1fa41f96f50b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:09.984863 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ad423-0a84-4d8c-8b82-1fa41f96f50b service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:09.998727 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1152/2309] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:29:10.019767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-eddf5af3-1139-4f31-894a-a34daeffbcbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2717bb2a50964e289f88f8e54be07141'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:10.020501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-eddf5af3-1139-4f31-894a-a34daeffbcbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2717bb2a50964e289f88f8e54be07141'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:10.037039 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-eddf5af3-1139-4f31-894a-a34daeffbcbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2717bb2a50964e289f88f8e54be07141'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:10.046522 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-eddf5af3-1139-4f31-894a-a34daeffbcbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2717bb2a50964e289f88f8e54be07141'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:10.047467 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-eddf5af3-1139-4f31-894a-a34daeffbcbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2717bb2a50964e289f88f8e54be07141'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:10.062284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1158/2310] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:09 2022] DELETE /identity/v3/users/2717bb2a50964e289f88f8e54be07141 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:29:10.407734 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ad423-0a84-4d8c-8b82-1fa41f96f50b service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:10.426139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ad423-0a84-4d8c-8b82-1fa41f96f50b service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:10.504075 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4af055-05ba-4078-af6b-bd6a199bc6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:10.505038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4af055-05ba-4078-af6b-bd6a199bc6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:10.505353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4af055-05ba-4078-af6b-bd6a199bc6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:10.505632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4af055-05ba-4078-af6b-bd6a199bc6a9 admin admin] PATH_INFO: `/v3/projects/0dfdfde49cca48309977de8a2fa94ca3` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:10.507015 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4af055-05ba-4078-af6b-bd6a199bc6a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dfdfde49cca48309977de8a2fa94ca3)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:10.509127 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4af055-05ba-4078-af6b-bd6a199bc6a9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:10.557970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8a4af055-05ba-4078-af6b-bd6a199bc6a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dfdfde49cca48309977de8a2fa94ca3', 'request_id': 'req-8a4af055-05ba-4078-af6b-bd6a199bc6a9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:10.564029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8a4af055-05ba-4078-af6b-bd6a199bc6a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dfdfde49cca48309977de8a2fa94ca3', 'request_id': 'req-8a4af055-05ba-4078-af6b-bd6a199bc6a9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:10.570280 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8a4af055-05ba-4078-af6b-bd6a199bc6a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dfdfde49cca48309977de8a2fa94ca3', 'request_id': 'req-8a4af055-05ba-4078-af6b-bd6a199bc6a9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:10.584881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8a4af055-05ba-4078-af6b-bd6a199bc6a9 admin admin] The token cache is being invalidate because project 0dfdfde49cca48309977de8a2fa94ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:10.585165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8a4af055-05ba-4078-af6b-bd6a199bc6a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:10.585804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8a4af055-05ba-4078-af6b-bd6a199bc6a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:10.587337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1153/2311] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:10 2022] DELETE /identity/v3/projects/0dfdfde49cca48309977de8a2fa94ca3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:10.592427 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a830a8-da15-4a8f-a512-6a31ae4d56cc None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:10.593222 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a830a8-da15-4a8f-a512-6a31ae4d56cc None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:10.593222 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a830a8-da15-4a8f-a512-6a31ae4d56cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:10.612782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-03a830a8-da15-4a8f-a512-6a31ae4d56cc None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:10.614049 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-03a830a8-da15-4a8f-a512-6a31ae4d56cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:10.619481 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:10.679309 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1159/2312] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:10.687039 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3d27e-f977-48d2-9820-cefc7b8ce2cc None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:10.687362 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3d27e-f977-48d2-9820-cefc7b8ce2cc None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:10.687636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3d27e-f977-48d2-9820-cefc7b8ce2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:10.706345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-77f3d27e-f977-48d2-9820-cefc7b8ce2cc None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:10.707553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-77f3d27e-f977-48d2-9820-cefc7b8ce2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:10.715492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1154/2313] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:10.720053 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a830a8-da15-4a8f-a512-6a31ae4d56cc None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:10.729754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a830a8-da15-4a8f-a512-6a31ae4d56cc None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:10.735063 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcdeb8-ebb5-4629-9172-d4e96a4804a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:10.735713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcdeb8-ebb5-4629-9172-d4e96a4804a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:10.735995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcdeb8-ebb5-4629-9172-d4e96a4804a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:10.736301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcdeb8-ebb5-4629-9172-d4e96a4804a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:10.737029 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddcdeb8-ebb5-4629-9172-d4e96a4804a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:29:10.737383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddcdeb8-ebb5-4629-9172-d4e96a4804a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:10.738992 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddcdeb8-ebb5-4629-9172-d4e96a4804a5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:10.750799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1160/2314] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:29:10.755781 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3d27e-f977-48d2-9820-cefc7b8ce2cc None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:10.765352 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3d27e-f977-48d2-9820-cefc7b8ce2cc None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:10.769987 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df0ab1-d846-4da6-81fc-f9a7b4465293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:10.770630 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df0ab1-d846-4da6-81fc-f9a7b4465293 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:10.770976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df0ab1-d846-4da6-81fc-f9a7b4465293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:10.771233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df0ab1-d846-4da6-81fc-f9a7b4465293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:10.771974 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df0ab1-d846-4da6-81fc-f9a7b4465293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:10.773915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df0ab1-d846-4da6-81fc-f9a7b4465293 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:10.798719 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1155/2315] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:10 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:10.802804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcdeb8-ebb5-4629-9172-d4e96a4804a5 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:10.813758 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcdeb8-ebb5-4629-9172-d4e96a4804a5 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:10.869554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5e968-9e14-44a3-8094-2b7c0dbb80e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:10.870220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5e968-9e14-44a3-8094-2b7c0dbb80e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:10.870510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5e968-9e14-44a3-8094-2b7c0dbb80e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:10.870789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5e968-9e14-44a3-8094-2b7c0dbb80e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:10.871468 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5e968-9e14-44a3-8094-2b7c0dbb80e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:10.874122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5e968-9e14-44a3-8094-2b7c0dbb80e8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:10.893486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1161/2316] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:10 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:10.897591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df0ab1-d846-4da6-81fc-f9a7b4465293 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:10.903025 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:10.909182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df0ab1-d846-4da6-81fc-f9a7b4465293 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:10.914716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb271d3-63c9-4c25-93dc-10ffe103af67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:10.915370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb271d3-63c9-4c25-93dc-10ffe103af67 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:10.915653 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb271d3-63c9-4c25-93dc-10ffe103af67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:10.915950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb271d3-63c9-4c25-93dc-10ffe103af67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:10.916668 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb271d3-63c9-4c25-93dc-10ffe103af67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:10.918695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb271d3-63c9-4c25-93dc-10ffe103af67 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:10.929042 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1156/2317] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:10.932947 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5e968-9e14-44a3-8094-2b7c0dbb80e8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:10.944585 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5e968-9e14-44a3-8094-2b7c0dbb80e8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:10.949286 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd4d74-a47b-4cf9-8f84-c21542cc22b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:10.949943 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd4d74-a47b-4cf9-8f84-c21542cc22b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:10.950480 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd4d74-a47b-4cf9-8f84-c21542cc22b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:10.950796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd4d74-a47b-4cf9-8f84-c21542cc22b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:10.952127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd4d74-a47b-4cf9-8f84-c21542cc22b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:10.953778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd4d74-a47b-4cf9-8f84-c21542cc22b0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:10.966257 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1162/2318] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:29:10.971765 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb271d3-63c9-4c25-93dc-10ffe103af67 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:10.983995 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb271d3-63c9-4c25-93dc-10ffe103af67 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:10.989522 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8957d00-d7d1-40a8-b488-2f21593799ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:10.990661 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8957d00-d7d1-40a8-b488-2f21593799ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:10.991048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8957d00-d7d1-40a8-b488-2f21593799ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:10.991415 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8957d00-d7d1-40a8-b488-2f21593799ac admin admin] PATH_INFO: `/v3/projects/9fd44bc315d14f229925408ce81be45e/users/930d7c35906a47fa972751ec25ba8118/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:11.009618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8957d00-d7d1-40a8-b488-2f21593799ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd44bc315d14f229925408ce81be45e, user_id=930d7c35906a47fa972751ec25ba8118, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:11.013103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8957d00-d7d1-40a8-b488-2f21593799ac admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:11.027645 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1157/2319] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:10 2022] PUT /identity/v3/projects/9fd44bc315d14f229925408ce81be45e/users/930d7c35906a47fa972751ec25ba8118/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:11.038261 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94261c7c-6ea0-4247-a757-31db4156bc20 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:11.038586 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94261c7c-6ea0-4247-a757-31db4156bc20 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:11.038869 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94261c7c-6ea0-4247-a757-31db4156bc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:11.074457 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-94261c7c-6ea0-4247-a757-31db4156bc20 None None] MFA Rules not processed for user `930d7c35906a47fa972751ec25ba8118`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:11.075934 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-94261c7c-6ea0-4247-a757-31db4156bc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:11.159528 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1163/2320] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:11.164315 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8957d00-d7d1-40a8-b488-2f21593799ac admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:11.246760 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8957d00-d7d1-40a8-b488-2f21593799ac admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:11.252213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dccb5f-d7b6-456d-9edd-7d49e9e7d3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:11.252907 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dccb5f-d7b6-456d-9edd-7d49e9e7d3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:11.253187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dccb5f-d7b6-456d-9edd-7d49e9e7d3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:11.253639 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dccb5f-d7b6-456d-9edd-7d49e9e7d3c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:11.254329 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dccb5f-d7b6-456d-9edd-7d49e9e7d3c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:11.256369 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dccb5f-d7b6-456d-9edd-7d49e9e7d3c8 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:11.285320 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1158/2321] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:11 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:11.287296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94261c7c-6ea0-4247-a757-31db4156bc20 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:11.304060 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94261c7c-6ea0-4247-a757-31db4156bc20 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:11.308358 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:11.369817 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7d366-e72e-490a-88d8-066b02e5a5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:11.370500 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7d366-e72e-490a-88d8-066b02e5a5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:11.370862 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7d366-e72e-490a-88d8-066b02e5a5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:11.371061 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7d366-e72e-490a-88d8-066b02e5a5e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:11.371940 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7d366-e72e-490a-88d8-066b02e5a5e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:11.374533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7d366-e72e-490a-88d8-066b02e5a5e9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:11.401293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1164/2322] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:11 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:11.403395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dccb5f-d7b6-456d-9edd-7d49e9e7d3c8 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:11.426541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dccb5f-d7b6-456d-9edd-7d49e9e7d3c8 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:11.432667 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265f61a-38e8-4a09-bc27-bae759cf5210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:11.433503 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265f61a-38e8-4a09-bc27-bae759cf5210 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:11.434123 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265f61a-38e8-4a09-bc27-bae759cf5210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:11.434562 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265f61a-38e8-4a09-bc27-bae759cf5210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:11.435406 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265f61a-38e8-4a09-bc27-bae759cf5210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:11.437020 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265f61a-38e8-4a09-bc27-bae759cf5210 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:11.448289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1159/2323] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:11.452675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7d366-e72e-490a-88d8-066b02e5a5e9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:11.467999 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7d366-e72e-490a-88d8-066b02e5a5e9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:11.474542 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d83dd-32b5-4a4b-bd42-9911a7a73ca0 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:11.474755 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ab8bf-a10c-4eca-b281-f8cc22a7245c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:11.474912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d83dd-32b5-4a4b-bd42-9911a7a73ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:11.475116 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d83dd-32b5-4a4b-bd42-9911a7a73ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:11.476273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ab8bf-a10c-4eca-b281-f8cc22a7245c admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:11.476796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ab8bf-a10c-4eca-b281-f8cc22a7245c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:11.477142 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ab8bf-a10c-4eca-b281-f8cc22a7245c admin admin] PATH_INFO: `/v3/projects/3a0b231978564b06bde3263f7eb96522/users/51266ad0d6544a3abcb0670b235a6e2a/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:11.496640 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ab8bf-a10c-4eca-b281-f8cc22a7245c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0b231978564b06bde3263f7eb96522, user_id=51266ad0d6544a3abcb0670b235a6e2a, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:11.497425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-342d83dd-32b5-4a4b-bd42-9911a7a73ca0 None None] MFA Rules not processed for user `b331ba96a2b94bd5bd3bffd43c18a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:11.498736 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-342d83dd-32b5-4a4b-bd42-9911a7a73ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:11.499644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ab8bf-a10c-4eca-b281-f8cc22a7245c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:11.515781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1165/2324] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:11 2022] PUT /identity/v3/projects/3a0b231978564b06bde3263f7eb96522/users/51266ad0d6544a3abcb0670b235a6e2a/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:11.520530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ab8bf-a10c-4eca-b281-f8cc22a7245c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:11.579061 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1160/2325] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:11.648371 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ab8bf-a10c-4eca-b281-f8cc22a7245c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:11.656932 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032697e-74b4-47b5-8359-ffc635cf153e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:11.657652 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032697e-74b4-47b5-8359-ffc635cf153e admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:11.658122 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032697e-74b4-47b5-8359-ffc635cf153e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:11.658613 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032697e-74b4-47b5-8359-ffc635cf153e admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:11.659498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032697e-74b4-47b5-8359-ffc635cf153e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:11.661363 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032697e-74b4-47b5-8359-ffc635cf153e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:11.675002 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1166/2326] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:11.680494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d83dd-32b5-4a4b-bd42-9911a7a73ca0 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:11.701204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d83dd-32b5-4a4b-bd42-9911a7a73ca0 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:11.708370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d887d5-82b5-4a0c-b01e-e26c3c5fe549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:11.710192 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d887d5-82b5-4a0c-b01e-e26c3c5fe549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:11.710550 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d887d5-82b5-4a0c-b01e-e26c3c5fe549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:11.710897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d887d5-82b5-4a0c-b01e-e26c3c5fe549 admin admin] PATH_INFO: `/v3/projects/3a0b231978564b06bde3263f7eb96522/users/51266ad0d6544a3abcb0670b235a6e2a/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:11.713288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d887d5-82b5-4a0c-b01e-e26c3c5fe549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0b231978564b06bde3263f7eb96522, user_id=51266ad0d6544a3abcb0670b235a6e2a, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:11.717840 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d887d5-82b5-4a0c-b01e-e26c3c5fe549 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:11.747967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1161/2327] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:11 2022] PUT /identity/v3/projects/3a0b231978564b06bde3263f7eb96522/users/51266ad0d6544a3abcb0670b235a6e2a/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:11.760416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906085a2-c5db-4fd2-b5d7-536805f5f42c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:11.760753 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906085a2-c5db-4fd2-b5d7-536805f5f42c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:11.761043 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906085a2-c5db-4fd2-b5d7-536805f5f42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:11.793320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-906085a2-c5db-4fd2-b5d7-536805f5f42c None None] MFA Rules not processed for user `51266ad0d6544a3abcb0670b235a6e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:11.795509 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-906085a2-c5db-4fd2-b5d7-536805f5f42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:11.880185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:11.904925 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1167/2328] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:11.915949 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d887d5-82b5-4a0c-b01e-e26c3c5fe549 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:11.917761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-54d887d5-82b5-4a0c-b01e-e26c3c5fe549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:11.960892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:11.989334 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d887d5-82b5-4a0c-b01e-e26c3c5fe549 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:11.993560 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93fe96-8c92-454c-8fe7-99943cb6db23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:11.994769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93fe96-8c92-454c-8fe7-99943cb6db23 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:11.995152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93fe96-8c92-454c-8fe7-99943cb6db23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:11.995487 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93fe96-8c92-454c-8fe7-99943cb6db23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:12.007559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93fe96-8c92-454c-8fe7-99943cb6db23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:12.009091 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93fe96-8c92-454c-8fe7-99943cb6db23 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:12.021428 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1162/2329] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:12.294498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906085a2-c5db-4fd2-b5d7-536805f5f42c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:12.296660 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-906085a2-c5db-4fd2-b5d7-536805f5f42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:12.387365 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906085a2-c5db-4fd2-b5d7-536805f5f42c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:12.394980 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49f5d2-2681-4db9-bcf3-98b12317c6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:12.396244 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49f5d2-2681-4db9-bcf3-98b12317c6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:12.396830 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49f5d2-2681-4db9-bcf3-98b12317c6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:12.397284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49f5d2-2681-4db9-bcf3-98b12317c6d0 admin admin] PATH_INFO: `/v3/users/2d168f207f3748b78f86f5252629bc25` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:12.402264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49f5d2-2681-4db9-bcf3-98b12317c6d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d168f207f3748b78f86f5252629bc25)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:12.405237 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49f5d2-2681-4db9-bcf3-98b12317c6d0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:12.473956 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-be49f5d2-2681-4db9-bcf3-98b12317c6d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d168f207f3748b78f86f5252629bc25'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:12.476150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-be49f5d2-2681-4db9-bcf3-98b12317c6d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d168f207f3748b78f86f5252629bc25'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:12.497315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-be49f5d2-2681-4db9-bcf3-98b12317c6d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d168f207f3748b78f86f5252629bc25'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:12.514507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-be49f5d2-2681-4db9-bcf3-98b12317c6d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d168f207f3748b78f86f5252629bc25'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:12.515349 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-be49f5d2-2681-4db9-bcf3-98b12317c6d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d168f207f3748b78f86f5252629bc25'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:12.535642 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1168/2330] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:12 2022] DELETE /identity/v3/users/2d168f207f3748b78f86f5252629bc25 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:12.538007 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e9b7f-0231-467a-914b-f5052da1f381 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:12.538313 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e9b7f-0231-467a-914b-f5052da1f381 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:12.538594 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e9b7f-0231-467a-914b-f5052da1f381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:12.566911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-399e9b7f-0231-467a-914b-f5052da1f381 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:12.568418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-399e9b7f-0231-467a-914b-f5052da1f381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:12.664898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1163/2331] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:12.675962 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49f5d2-2681-4db9-bcf3-98b12317c6d0 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:12.679649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-be49f5d2-2681-4db9-bcf3-98b12317c6d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:12.764293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49f5d2-2681-4db9-bcf3-98b12317c6d0 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:12.767601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e9b7f-0231-467a-914b-f5052da1f381 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:12.768545 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe158ed-d2f4-437d-8e3a-d7bdeed5be15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:12.769202 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe158ed-d2f4-437d-8e3a-d7bdeed5be15 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:12.769521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe158ed-d2f4-437d-8e3a-d7bdeed5be15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:12.769797 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe158ed-d2f4-437d-8e3a-d7bdeed5be15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:12.770151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-399e9b7f-0231-467a-914b-f5052da1f381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:12.782072 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe158ed-d2f4-437d-8e3a-d7bdeed5be15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:12.783692 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe158ed-d2f4-437d-8e3a-d7bdeed5be15 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:12.785797 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e9b7f-0231-467a-914b-f5052da1f381 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:12.795527 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1169/2332] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:12.796262 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03843c1-c4b6-4a3d-8cf7-a0fa432c0e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:12.797551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03843c1-c4b6-4a3d-8cf7-a0fa432c0e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:12.797981 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03843c1-c4b6-4a3d-8cf7-a0fa432c0e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:12.798509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03843c1-c4b6-4a3d-8cf7-a0fa432c0e49 admin admin] PATH_INFO: `/v3/users/930d7c35906a47fa972751ec25ba8118` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:12.800221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03843c1-c4b6-4a3d-8cf7-a0fa432c0e49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=930d7c35906a47fa972751ec25ba8118)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:12.803466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03843c1-c4b6-4a3d-8cf7-a0fa432c0e49 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:12.868690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d03843c1-c4b6-4a3d-8cf7-a0fa432c0e49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '930d7c35906a47fa972751ec25ba8118'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:12.869786 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d03843c1-c4b6-4a3d-8cf7-a0fa432c0e49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '930d7c35906a47fa972751ec25ba8118'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:12.879615 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d03843c1-c4b6-4a3d-8cf7-a0fa432c0e49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '930d7c35906a47fa972751ec25ba8118'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:12.880479 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d03843c1-c4b6-4a3d-8cf7-a0fa432c0e49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '930d7c35906a47fa972751ec25ba8118'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:12.895091 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d03843c1-c4b6-4a3d-8cf7-a0fa432c0e49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '930d7c35906a47fa972751ec25ba8118'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:12.938028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1164/2333] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:12 2022] DELETE /identity/v3/users/930d7c35906a47fa972751ec25ba8118 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:29:12.943003 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fac835-1966-4d97-b09a-52796e5ed99b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:12.943323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fac835-1966-4d97-b09a-52796e5ed99b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:12.943712 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fac835-1966-4d97-b09a-52796e5ed99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:12.966383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d5fac835-1966-4d97-b09a-52796e5ed99b None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:12.968287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d5fac835-1966-4d97-b09a-52796e5ed99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:12.981381 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:13.068152 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1170/2334] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:13.078483 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03843c1-c4b6-4a3d-8cf7-a0fa432c0e49 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:13.080191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d03843c1-c4b6-4a3d-8cf7-a0fa432c0e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:13.151472 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:13.157166 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03843c1-c4b6-4a3d-8cf7-a0fa432c0e49 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:13.164305 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4020a8f-2468-43f4-a433-8ecd3f565c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:13.165072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4020a8f-2468-43f4-a433-8ecd3f565c71 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:13.165477 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4020a8f-2468-43f4-a433-8ecd3f565c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:13.165807 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4020a8f-2468-43f4-a433-8ecd3f565c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:13.184026 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4020a8f-2468-43f4-a433-8ecd3f565c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:13.188225 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4020a8f-2468-43f4-a433-8ecd3f565c71 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:13.200805 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fac835-1966-4d97-b09a-52796e5ed99b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:13.202156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1165/2335] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:13.202285 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d5fac835-1966-4d97-b09a-52796e5ed99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:13.228663 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fac835-1966-4d97-b09a-52796e5ed99b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:13.244972 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa7243-5289-4403-a748-6a67af6cebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:13.245898 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa7243-5289-4403-a748-6a67af6cebe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:13.246601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa7243-5289-4403-a748-6a67af6cebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:13.246882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa7243-5289-4403-a748-6a67af6cebe3 admin admin] PATH_INFO: `/v3/projects/85af25a024f74af6b99a9f389cf8e1c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:13.248231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa7243-5289-4403-a748-6a67af6cebe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85af25a024f74af6b99a9f389cf8e1c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:13.250827 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa7243-5289-4403-a748-6a67af6cebe3 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:13.351480 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3caa7243-5289-4403-a748-6a67af6cebe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85af25a024f74af6b99a9f389cf8e1c5', 'request_id': 'req-3caa7243-5289-4403-a748-6a67af6cebe3'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.362528 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3caa7243-5289-4403-a748-6a67af6cebe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85af25a024f74af6b99a9f389cf8e1c5', 'request_id': 'req-3caa7243-5289-4403-a748-6a67af6cebe3'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.371840 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3caa7243-5289-4403-a748-6a67af6cebe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85af25a024f74af6b99a9f389cf8e1c5', 'request_id': 'req-3caa7243-5289-4403-a748-6a67af6cebe3'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.389857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3caa7243-5289-4403-a748-6a67af6cebe3 admin admin] The token cache is being invalidate because project 85af25a024f74af6b99a9f389cf8e1c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:13.390153 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3caa7243-5289-4403-a748-6a67af6cebe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.390833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3caa7243-5289-4403-a748-6a67af6cebe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.392716 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1171/2336] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:13 2022] DELETE /identity/v3/projects/85af25a024f74af6b99a9f389cf8e1c5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:29:13.396950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4020a8f-2468-43f4-a433-8ecd3f565c71 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:13.426349 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4020a8f-2468-43f4-a433-8ecd3f565c71 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:13.491734 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33a7fb-5ff1-4c18-9004-b5025a22e167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:13.492732 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33a7fb-5ff1-4c18-9004-b5025a22e167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:13.493083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33a7fb-5ff1-4c18-9004-b5025a22e167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:13.493420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33a7fb-5ff1-4c18-9004-b5025a22e167 admin admin] PATH_INFO: `/v3/users/f458a1776a0c475eaebca342d3ac9d3a` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:13.494713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33a7fb-5ff1-4c18-9004-b5025a22e167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f458a1776a0c475eaebca342d3ac9d3a)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:13.496774 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33a7fb-5ff1-4c18-9004-b5025a22e167 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:13.547486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa7243-5289-4403-a748-6a67af6cebe3 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:13.549105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3caa7243-5289-4403-a748-6a67af6cebe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:13.564698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa7243-5289-4403-a748-6a67af6cebe3 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:13.572495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bf33a7fb-5ff1-4c18-9004-b5025a22e167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f458a1776a0c475eaebca342d3ac9d3a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.573418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bf33a7fb-5ff1-4c18-9004-b5025a22e167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f458a1776a0c475eaebca342d3ac9d3a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.576667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f9e8-8919-4567-87cf-f88a6cc19337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:13.578323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f9e8-8919-4567-87cf-f88a6cc19337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:13.578863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f9e8-8919-4567-87cf-f88a6cc19337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:13.579775 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f9e8-8919-4567-87cf-f88a6cc19337 admin admin] PATH_INFO: `/v3/projects/9fd44bc315d14f229925408ce81be45e` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:13.581543 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1f9e8-8919-4567-87cf-f88a6cc19337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fd44bc315d14f229925408ce81be45e)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:13.583715 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1f9e8-8919-4567-87cf-f88a6cc19337 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:13.584845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bf33a7fb-5ff1-4c18-9004-b5025a22e167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f458a1776a0c475eaebca342d3ac9d3a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.586021 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bf33a7fb-5ff1-4c18-9004-b5025a22e167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f458a1776a0c475eaebca342d3ac9d3a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.597065 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bf33a7fb-5ff1-4c18-9004-b5025a22e167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f458a1776a0c475eaebca342d3ac9d3a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.625993 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1166/2337] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:13 2022] DELETE /identity/v3/users/f458a1776a0c475eaebca342d3ac9d3a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:29:13.644791 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7fc1f9e8-8919-4567-87cf-f88a6cc19337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd44bc315d14f229925408ce81be45e', 'request_id': 'req-7fc1f9e8-8919-4567-87cf-f88a6cc19337'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.656325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7fc1f9e8-8919-4567-87cf-f88a6cc19337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd44bc315d14f229925408ce81be45e', 'request_id': 'req-7fc1f9e8-8919-4567-87cf-f88a6cc19337'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.664404 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7fc1f9e8-8919-4567-87cf-f88a6cc19337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd44bc315d14f229925408ce81be45e', 'request_id': 'req-7fc1f9e8-8919-4567-87cf-f88a6cc19337'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.678639 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7fc1f9e8-8919-4567-87cf-f88a6cc19337 admin admin] The token cache is being invalidate because project 9fd44bc315d14f229925408ce81be45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:13.679275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7fc1f9e8-8919-4567-87cf-f88a6cc19337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.679809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7fc1f9e8-8919-4567-87cf-f88a6cc19337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.681992 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1172/2338] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:13 2022] DELETE /identity/v3/projects/9fd44bc315d14f229925408ce81be45e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:13.686394 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33a7fb-5ff1-4c18-9004-b5025a22e167 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:13.688322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bf33a7fb-5ff1-4c18-9004-b5025a22e167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:13.790956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33a7fb-5ff1-4c18-9004-b5025a22e167 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:13.808991 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:13.871114 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f34249-5291-47d9-98fa-fc8596d8eec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:13.872053 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f34249-5291-47d9-98fa-fc8596d8eec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:13.872343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f34249-5291-47d9-98fa-fc8596d8eec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:13.872619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f34249-5291-47d9-98fa-fc8596d8eec9 admin admin] PATH_INFO: `/v3/users/51266ad0d6544a3abcb0670b235a6e2a` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:13.875723 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f34249-5291-47d9-98fa-fc8596d8eec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51266ad0d6544a3abcb0670b235a6e2a)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:13.877082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f34249-5291-47d9-98fa-fc8596d8eec9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:13.963573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-54f34249-5291-47d9-98fa-fc8596d8eec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51266ad0d6544a3abcb0670b235a6e2a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.964415 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-54f34249-5291-47d9-98fa-fc8596d8eec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51266ad0d6544a3abcb0670b235a6e2a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.975510 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-54f34249-5291-47d9-98fa-fc8596d8eec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51266ad0d6544a3abcb0670b235a6e2a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.976246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-54f34249-5291-47d9-98fa-fc8596d8eec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51266ad0d6544a3abcb0670b235a6e2a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:13.980972 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f9e8-8919-4567-87cf-f88a6cc19337 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:13.983191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7fc1f9e8-8919-4567-87cf-f88a6cc19337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:14.002556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f9e8-8919-4567-87cf-f88a6cc19337 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:14.003331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-54f34249-5291-47d9-98fa-fc8596d8eec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51266ad0d6544a3abcb0670b235a6e2a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:14.008179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d503215-4f70-474b-9b8e-8deb9d71f3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:14.010680 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d503215-4f70-474b-9b8e-8deb9d71f3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:14.011111 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d503215-4f70-474b-9b8e-8deb9d71f3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:14.011538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d503215-4f70-474b-9b8e-8deb9d71f3c5 admin admin] PATH_INFO: `/v3/projects/e8797ca3914442829b7812591b5946c4` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:14.013333 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d503215-4f70-474b-9b8e-8deb9d71f3c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8797ca3914442829b7812591b5946c4)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:14.016535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d503215-4f70-474b-9b8e-8deb9d71f3c5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:14.040027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:14.055181 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1167/2339] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:13 2022] DELETE /identity/v3/users/51266ad0d6544a3abcb0670b235a6e2a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:14.087412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8d503215-4f70-474b-9b8e-8deb9d71f3c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8797ca3914442829b7812591b5946c4', 'request_id': 'req-8d503215-4f70-474b-9b8e-8deb9d71f3c5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:14.097472 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8d503215-4f70-474b-9b8e-8deb9d71f3c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8797ca3914442829b7812591b5946c4', 'request_id': 'req-8d503215-4f70-474b-9b8e-8deb9d71f3c5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:14.105275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8d503215-4f70-474b-9b8e-8deb9d71f3c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8797ca3914442829b7812591b5946c4', 'request_id': 'req-8d503215-4f70-474b-9b8e-8deb9d71f3c5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:14.120815 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8d503215-4f70-474b-9b8e-8deb9d71f3c5 admin admin] The token cache is being invalidate because project e8797ca3914442829b7812591b5946c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:14.121248 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8d503215-4f70-474b-9b8e-8deb9d71f3c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:14.122024 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8d503215-4f70-474b-9b8e-8deb9d71f3c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:14.125686 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1173/2340] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:13 2022] DELETE /identity/v3/projects/e8797ca3914442829b7812591b5946c4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:14.131896 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b2562-7e77-48b1-ad7f-42afa6cf5ca2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:14.132196 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b2562-7e77-48b1-ad7f-42afa6cf5ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:14.132506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b2562-7e77-48b1-ad7f-42afa6cf5ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:14.151639 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-0e8b2562-7e77-48b1-ad7f-42afa6cf5ca2 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:14.152864 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0e8b2562-7e77-48b1-ad7f-42afa6cf5ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:14.224295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1168/2341] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:14.240983 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff87aa-1543-471a-b963-92476c0509ab None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:14.241702 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff87aa-1543-471a-b963-92476c0509ab None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:14.242126 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff87aa-1543-471a-b963-92476c0509ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:14.269187 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e3ff87aa-1543-471a-b963-92476c0509ab None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:14.270517 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e3ff87aa-1543-471a-b963-92476c0509ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:14.279999 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1174/2342] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:14.284696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b2562-7e77-48b1-ad7f-42afa6cf5ca2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:14.296396 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b2562-7e77-48b1-ad7f-42afa6cf5ca2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:14.301863 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b156268-b55d-4389-a26f-bb250cdb27e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:14.302649 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b156268-b55d-4389-a26f-bb250cdb27e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:14.303009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b156268-b55d-4389-a26f-bb250cdb27e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:14.303409 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b156268-b55d-4389-a26f-bb250cdb27e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:14.304239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b156268-b55d-4389-a26f-bb250cdb27e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:29:14.304628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b156268-b55d-4389-a26f-bb250cdb27e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:14.306323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b156268-b55d-4389-a26f-bb250cdb27e9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:14.322414 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1169/2343] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:29:14.323651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff87aa-1543-471a-b963-92476c0509ab None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:14.333215 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff87aa-1543-471a-b963-92476c0509ab None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:14.337925 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc8160-7d30-458e-bf14-4516fe0a5f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:14.338571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc8160-7d30-458e-bf14-4516fe0a5f24 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:14.338856 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc8160-7d30-458e-bf14-4516fe0a5f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:14.339232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc8160-7d30-458e-bf14-4516fe0a5f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:14.339958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc8160-7d30-458e-bf14-4516fe0a5f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:14.342419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc8160-7d30-458e-bf14-4516fe0a5f24 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:14.398351 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b156268-b55d-4389-a26f-bb250cdb27e9 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:14.400807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1175/2344] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:14 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:29:14.413588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b156268-b55d-4389-a26f-bb250cdb27e9 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:14.467442 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:14.541120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49bcae-552a-44a0-a48d-041ff9ee8934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:14.542863 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49bcae-552a-44a0-a48d-041ff9ee8934 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:14.543574 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49bcae-552a-44a0-a48d-041ff9ee8934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:14.544095 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49bcae-552a-44a0-a48d-041ff9ee8934 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:14.548372 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49bcae-552a-44a0-a48d-041ff9ee8934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:14.548372 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49bcae-552a-44a0-a48d-041ff9ee8934 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:14.549939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc8160-7d30-458e-bf14-4516fe0a5f24 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:14.551887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6acc8160-7d30-458e-bf14-4516fe0a5f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:14.573228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc8160-7d30-458e-bf14-4516fe0a5f24 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:14.579897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1170/2345] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:14 2022] POST /identity/v3/users => generated 296 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:14.585634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49bcae-552a-44a0-a48d-041ff9ee8934 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:14.589778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d794f32-208e-44e5-8ad7-88ac40d512b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:14.592765 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d794f32-208e-44e5-8ad7-88ac40d512b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:14.594193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d794f32-208e-44e5-8ad7-88ac40d512b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:14.596432 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d794f32-208e-44e5-8ad7-88ac40d512b2 admin admin] PATH_INFO: `/v3/projects/3a0b231978564b06bde3263f7eb96522` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:14.598715 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d794f32-208e-44e5-8ad7-88ac40d512b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0b231978564b06bde3263f7eb96522)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:14.603150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d794f32-208e-44e5-8ad7-88ac40d512b2 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:14.619972 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49bcae-552a-44a0-a48d-041ff9ee8934 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:14.643351 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c04645-14e0-4c1d-977b-4bb630f2cabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:14.645912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c04645-14e0-4c1d-977b-4bb630f2cabd admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:14.646301 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c04645-14e0-4c1d-977b-4bb630f2cabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:14.646804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c04645-14e0-4c1d-977b-4bb630f2cabd admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:14.648435 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c04645-14e0-4c1d-977b-4bb630f2cabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:14.653458 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c04645-14e0-4c1d-977b-4bb630f2cabd admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:14.683587 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1171/2346] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:14.685117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c04645-14e0-4c1d-977b-4bb630f2cabd admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:14.700426 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1d794f32-208e-44e5-8ad7-88ac40d512b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0b231978564b06bde3263f7eb96522', 'request_id': 'req-1d794f32-208e-44e5-8ad7-88ac40d512b2'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:14.705008 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c04645-14e0-4c1d-977b-4bb630f2cabd admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:14.719689 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1d794f32-208e-44e5-8ad7-88ac40d512b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0b231978564b06bde3263f7eb96522', 'request_id': 'req-1d794f32-208e-44e5-8ad7-88ac40d512b2'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:14.727089 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1d794f32-208e-44e5-8ad7-88ac40d512b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0b231978564b06bde3263f7eb96522', 'request_id': 'req-1d794f32-208e-44e5-8ad7-88ac40d512b2'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:14.742509 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1d794f32-208e-44e5-8ad7-88ac40d512b2 admin admin] The token cache is being invalidate because project 3a0b231978564b06bde3263f7eb96522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:14.743080 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1d794f32-208e-44e5-8ad7-88ac40d512b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:14.743955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1d794f32-208e-44e5-8ad7-88ac40d512b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:14.746271 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1176/2347] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:14 2022] DELETE /identity/v3/projects/3a0b231978564b06bde3263f7eb96522 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:14.751294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75197aa2-9533-4a73-8d1c-1e38f1dba9a4 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:14.751806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75197aa2-9533-4a73-8d1c-1e38f1dba9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:14.752607 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75197aa2-9533-4a73-8d1c-1e38f1dba9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:14.776141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-75197aa2-9533-4a73-8d1c-1e38f1dba9a4 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:14.777737 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-75197aa2-9533-4a73-8d1c-1e38f1dba9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:14.803220 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242d121-4835-4f85-87f0-e4ab3a5d3413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:14.803965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242d121-4835-4f85-87f0-e4ab3a5d3413 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:14.804256 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242d121-4835-4f85-87f0-e4ab3a5d3413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:14.804534 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242d121-4835-4f85-87f0-e4ab3a5d3413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:14.805288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242d121-4835-4f85-87f0-e4ab3a5d3413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:14.807065 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242d121-4835-4f85-87f0-e4ab3a5d3413 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:14.819796 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1172/2348] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:14.824126 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242d121-4835-4f85-87f0-e4ab3a5d3413 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:14.827636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9242d121-4835-4f85-87f0-e4ab3a5d3413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:14.843767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242d121-4835-4f85-87f0-e4ab3a5d3413 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:14.846164 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:14.849640 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55157af7-0c24-4201-8c5d-114070bc13e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:14.851071 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157af7-0c24-4201-8c5d-114070bc13e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:14.851071 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157af7-0c24-4201-8c5d-114070bc13e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:14.851336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157af7-0c24-4201-8c5d-114070bc13e3 admin admin] PATH_INFO: `/v3/projects/6b532463be7c4b429af558023f94b034/users/2b77f23c837d4620be1bda143618ba13/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:14.878625 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55157af7-0c24-4201-8c5d-114070bc13e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b532463be7c4b429af558023f94b034, user_id=2b77f23c837d4620be1bda143618ba13, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:14.878625 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55157af7-0c24-4201-8c5d-114070bc13e3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:14.878912 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1177/2349] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:14.888156 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0de7f2-d11f-4268-8a90-2eb475ccd1ed None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:14.888972 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0de7f2-d11f-4268-8a90-2eb475ccd1ed None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:14.889573 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0de7f2-d11f-4268-8a90-2eb475ccd1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:14.907512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1173/2350] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:14 2022] PUT /identity/v3/projects/6b532463be7c4b429af558023f94b034/users/2b77f23c837d4620be1bda143618ba13/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:29:14.910326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b715432-9bf3-47c0-9e43-81d613bd8290 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:14.910616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b715432-9bf3-47c0-9e43-81d613bd8290 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:14.910764 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2e0de7f2-d11f-4268-8a90-2eb475ccd1ed None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:14.911264 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b715432-9bf3-47c0-9e43-81d613bd8290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:14.911877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2e0de7f2-d11f-4268-8a90-2eb475ccd1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:14.942704 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6b715432-9bf3-47c0-9e43-81d613bd8290 None None] MFA Rules not processed for user `2b77f23c837d4620be1bda143618ba13`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:14.944495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6b715432-9bf3-47c0-9e43-81d613bd8290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:14.990405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1178/2351] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:14.994670 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0de7f2-d11f-4268-8a90-2eb475ccd1ed None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:15.004064 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0de7f2-d11f-4268-8a90-2eb475ccd1ed None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:15.008760 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b952d-cc60-43d8-820e-1b66e2fb6982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:15.010407 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b952d-cc60-43d8-820e-1b66e2fb6982 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:15.010407 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b952d-cc60-43d8-820e-1b66e2fb6982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:15.010407 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b952d-cc60-43d8-820e-1b66e2fb6982 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:15.010672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b952d-cc60-43d8-820e-1b66e2fb6982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:29:15.010968 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b952d-cc60-43d8-820e-1b66e2fb6982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:15.012564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b952d-cc60-43d8-820e-1b66e2fb6982 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:15.025234 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1179/2352] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:29:15.029792 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b952d-cc60-43d8-820e-1b66e2fb6982 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:15.034421 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1174/2353] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:15.040569 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b952d-cc60-43d8-820e-1b66e2fb6982 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:15.045229 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b715432-9bf3-47c0-9e43-81d613bd8290 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:15.045869 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bd11b-0a95-49a7-8f94-c40dfaa64784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:15.047016 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bd11b-0a95-49a7-8f94-c40dfaa64784 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:15.047016 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bd11b-0a95-49a7-8f94-c40dfaa64784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:15.047219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6b715432-9bf3-47c0-9e43-81d613bd8290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:15.047296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bd11b-0a95-49a7-8f94-c40dfaa64784 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:15.047747 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bd11b-0a95-49a7-8f94-c40dfaa64784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:15.049673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bd11b-0a95-49a7-8f94-c40dfaa64784 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:15.054817 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:15.087180 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1180/2354] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:15 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:29:15.088059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bd11b-0a95-49a7-8f94-c40dfaa64784 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:15.129556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b715432-9bf3-47c0-9e43-81d613bd8290 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:15.191780 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bd11b-0a95-49a7-8f94-c40dfaa64784 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:15.196147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4cbf2-1e43-4330-b823-2a0847b8fd4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:15.196861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4cbf2-1e43-4330-b823-2a0847b8fd4f service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:15.197145 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4cbf2-1e43-4330-b823-2a0847b8fd4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:15.197464 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4cbf2-1e43-4330-b823-2a0847b8fd4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:15.201555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911cbc2-a48b-4e41-bb9b-ff4b1895dc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:15.202422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911cbc2-a48b-4e41-bb9b-ff4b1895dc60 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:15.202898 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911cbc2-a48b-4e41-bb9b-ff4b1895dc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:15.203173 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911cbc2-a48b-4e41-bb9b-ff4b1895dc60 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:15.203963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911cbc2-a48b-4e41-bb9b-ff4b1895dc60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:15.206143 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911cbc2-a48b-4e41-bb9b-ff4b1895dc60 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:15.234598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1181/2355] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:15 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:15.235927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911cbc2-a48b-4e41-bb9b-ff4b1895dc60 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:15.248270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911cbc2-a48b-4e41-bb9b-ff4b1895dc60 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:15.254230 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862fd78-708a-4903-aa40-09225328945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:15.256134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862fd78-708a-4903-aa40-09225328945c admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:15.256530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862fd78-708a-4903-aa40-09225328945c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:15.257087 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862fd78-708a-4903-aa40-09225328945c admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:15.259187 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862fd78-708a-4903-aa40-09225328945c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:15.262233 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862fd78-708a-4903-aa40-09225328945c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:15.279873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1182/2356] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:29:15.283431 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862fd78-708a-4903-aa40-09225328945c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:15.292534 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4cbf2-1e43-4330-b823-2a0847b8fd4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:15.294713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4cbf2-1e43-4330-b823-2a0847b8fd4f service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:15.297848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862fd78-708a-4903-aa40-09225328945c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:15.303077 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6693e7c-94cf-4353-a91c-0f84afc75b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:15.303751 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6693e7c-94cf-4353-a91c-0f84afc75b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:15.304042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6693e7c-94cf-4353-a91c-0f84afc75b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:15.304318 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6693e7c-94cf-4353-a91c-0f84afc75b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:15.305048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6693e7c-94cf-4353-a91c-0f84afc75b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:15.307444 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6693e7c-94cf-4353-a91c-0f84afc75b7b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:15.312949 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1175/2357] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:29:15.330285 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1183/2358] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:15.331906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4cbf2-1e43-4330-b823-2a0847b8fd4f service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:15.342910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4cbf2-1e43-4330-b823-2a0847b8fd4f service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:15.348096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86f2e2-d500-4a6f-83e8-54a95ba13319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:15.349197 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86f2e2-d500-4a6f-83e8-54a95ba13319 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:15.349596 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86f2e2-d500-4a6f-83e8-54a95ba13319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:15.349999 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86f2e2-d500-4a6f-83e8-54a95ba13319 admin admin] PATH_INFO: `/v3/projects/0f52e1fb64d14bd3a27d3011e7c9840b/users/4152ed692adf4af597f2df52dc2aa3d5/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:15.366267 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86f2e2-d500-4a6f-83e8-54a95ba13319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f52e1fb64d14bd3a27d3011e7c9840b, user_id=4152ed692adf4af597f2df52dc2aa3d5, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:15.370019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86f2e2-d500-4a6f-83e8-54a95ba13319 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:15.389232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1176/2359] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:15 2022] PUT /identity/v3/projects/0f52e1fb64d14bd3a27d3011e7c9840b/users/4152ed692adf4af597f2df52dc2aa3d5/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:29:15.401788 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1be40d-8276-4790-b893-869d6054a89d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:15.402165 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1be40d-8276-4790-b893-869d6054a89d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:15.402570 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1be40d-8276-4790-b893-869d6054a89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:15.434327 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1d1be40d-8276-4790-b893-869d6054a89d None None] MFA Rules not processed for user `4152ed692adf4af597f2df52dc2aa3d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:15.436541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1d1be40d-8276-4790-b893-869d6054a89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:15.461357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:15.529817 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1184/2360] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:15.549037 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86f2e2-d500-4a6f-83e8-54a95ba13319 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:15.550903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6d86f2e2-d500-4a6f-83e8-54a95ba13319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:15.620669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86f2e2-d500-4a6f-83e8-54a95ba13319 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:15.624975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c66329-3749-41a8-bd0d-a57b81965865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:15.625740 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c66329-3749-41a8-bd0d-a57b81965865 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:15.626066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c66329-3749-41a8-bd0d-a57b81965865 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:15.626344 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c66329-3749-41a8-bd0d-a57b81965865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:15.631973 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:15.635663 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c66329-3749-41a8-bd0d-a57b81965865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:15.637241 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c66329-3749-41a8-bd0d-a57b81965865 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:15.657101 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1177/2361] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:15.681130 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1be40d-8276-4790-b893-869d6054a89d None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:15.756465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1be40d-8276-4790-b893-869d6054a89d None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:15.761322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8386cf9-43b2-4c00-8cde-2b3b6f5e03bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:15.762196 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8386cf9-43b2-4c00-8cde-2b3b6f5e03bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:15.762476 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8386cf9-43b2-4c00-8cde-2b3b6f5e03bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:15.762749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8386cf9-43b2-4c00-8cde-2b3b6f5e03bc admin admin] PATH_INFO: `/v3/users/4152ed692adf4af597f2df52dc2aa3d5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:15.763973 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8386cf9-43b2-4c00-8cde-2b3b6f5e03bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4152ed692adf4af597f2df52dc2aa3d5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:15.765938 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8386cf9-43b2-4c00-8cde-2b3b6f5e03bc admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:15.824913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d8386cf9-43b2-4c00-8cde-2b3b6f5e03bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4152ed692adf4af597f2df52dc2aa3d5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:15.826134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d8386cf9-43b2-4c00-8cde-2b3b6f5e03bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4152ed692adf4af597f2df52dc2aa3d5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:15.839438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d8386cf9-43b2-4c00-8cde-2b3b6f5e03bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4152ed692adf4af597f2df52dc2aa3d5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:15.847022 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d8386cf9-43b2-4c00-8cde-2b3b6f5e03bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4152ed692adf4af597f2df52dc2aa3d5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:15.847811 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d8386cf9-43b2-4c00-8cde-2b3b6f5e03bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4152ed692adf4af597f2df52dc2aa3d5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:15.862550 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1185/2362] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:15 2022] DELETE /identity/v3/users/4152ed692adf4af597f2df52dc2aa3d5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:15.867137 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f8d25-254f-40e3-8776-34a848d83067 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:15.867663 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f8d25-254f-40e3-8776-34a848d83067 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:15.867663 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f8d25-254f-40e3-8776-34a848d83067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:15.887564 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-274f8d25-254f-40e3-8776-34a848d83067 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:15.888945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-274f8d25-254f-40e3-8776-34a848d83067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:15.972106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1178/2363] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:15.986731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8386cf9-43b2-4c00-8cde-2b3b6f5e03bc admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:15.989769 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d8386cf9-43b2-4c00-8cde-2b3b6f5e03bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:16.071406 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:16.090647 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8386cf9-43b2-4c00-8cde-2b3b6f5e03bc admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:16.095532 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143282bf-07ab-4f80-86b4-90e4cac448e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:16.096574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143282bf-07ab-4f80-86b4-90e4cac448e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:16.096898 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143282bf-07ab-4f80-86b4-90e4cac448e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:16.097419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143282bf-07ab-4f80-86b4-90e4cac448e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:16.109381 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143282bf-07ab-4f80-86b4-90e4cac448e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:16.111004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143282bf-07ab-4f80-86b4-90e4cac448e7 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:16.133339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1186/2364] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:16.409032 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f8d25-254f-40e3-8776-34a848d83067 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:16.411399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-274f8d25-254f-40e3-8776-34a848d83067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:16.424251 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f8d25-254f-40e3-8776-34a848d83067 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:16.429379 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7efa0-a834-4ddb-b72b-2f17adf4f51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:16.430259 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7efa0-a834-4ddb-b72b-2f17adf4f51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:16.430545 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7efa0-a834-4ddb-b72b-2f17adf4f51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:16.430825 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7efa0-a834-4ddb-b72b-2f17adf4f51a admin admin] PATH_INFO: `/v3/projects/0f52e1fb64d14bd3a27d3011e7c9840b` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:16.432751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7efa0-a834-4ddb-b72b-2f17adf4f51a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f52e1fb64d14bd3a27d3011e7c9840b)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:16.434584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7efa0-a834-4ddb-b72b-2f17adf4f51a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:16.492597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6fb7efa0-a834-4ddb-b72b-2f17adf4f51a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f52e1fb64d14bd3a27d3011e7c9840b', 'request_id': 'req-6fb7efa0-a834-4ddb-b72b-2f17adf4f51a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:16.498177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6fb7efa0-a834-4ddb-b72b-2f17adf4f51a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f52e1fb64d14bd3a27d3011e7c9840b', 'request_id': 'req-6fb7efa0-a834-4ddb-b72b-2f17adf4f51a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:16.504581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6fb7efa0-a834-4ddb-b72b-2f17adf4f51a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f52e1fb64d14bd3a27d3011e7c9840b', 'request_id': 'req-6fb7efa0-a834-4ddb-b72b-2f17adf4f51a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:16.517517 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6fb7efa0-a834-4ddb-b72b-2f17adf4f51a admin admin] The token cache is being invalidate because project 0f52e1fb64d14bd3a27d3011e7c9840b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:16.517805 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6fb7efa0-a834-4ddb-b72b-2f17adf4f51a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:16.518557 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6fb7efa0-a834-4ddb-b72b-2f17adf4f51a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:16.520609 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1179/2365] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:16 2022] DELETE /identity/v3/projects/0f52e1fb64d14bd3a27d3011e7c9840b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:16.526487 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39c842-1637-4271-93e9-ba49aef70a4d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:16.526782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39c842-1637-4271-93e9-ba49aef70a4d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:16.527070 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39c842-1637-4271-93e9-ba49aef70a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:16.545785 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2b39c842-1637-4271-93e9-ba49aef70a4d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:16.547019 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2b39c842-1637-4271-93e9-ba49aef70a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:16.617319 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1187/2366] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:16.625409 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68bbe8-f363-4257-87bc-34e31961d33a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:16.625727 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68bbe8-f363-4257-87bc-34e31961d33a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:16.626009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68bbe8-f363-4257-87bc-34e31961d33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:16.644106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1e68bbe8-f363-4257-87bc-34e31961d33a None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:16.645328 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1e68bbe8-f363-4257-87bc-34e31961d33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:16.653576 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1180/2367] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:16.658185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39c842-1637-4271-93e9-ba49aef70a4d None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:16.668043 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39c842-1637-4271-93e9-ba49aef70a4d None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:16.673424 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d13d76-1880-4f49-9fe1-63fee46096b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:16.674071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d13d76-1880-4f49-9fe1-63fee46096b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:16.674353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d13d76-1880-4f49-9fe1-63fee46096b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:16.674628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d13d76-1880-4f49-9fe1-63fee46096b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:16.675376 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d13d76-1880-4f49-9fe1-63fee46096b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:29:16.675683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d13d76-1880-4f49-9fe1-63fee46096b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:16.677295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d13d76-1880-4f49-9fe1-63fee46096b6 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:16.688836 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1188/2368] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:29:16.692971 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68bbe8-f363-4257-87bc-34e31961d33a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:16.702331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68bbe8-f363-4257-87bc-34e31961d33a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:16.706937 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fccc6c-1830-4f02-bf22-b0c555086da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:16.707578 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fccc6c-1830-4f02-bf22-b0c555086da6 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:16.707863 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fccc6c-1830-4f02-bf22-b0c555086da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:16.708139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fccc6c-1830-4f02-bf22-b0c555086da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:16.708832 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fccc6c-1830-4f02-bf22-b0c555086da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:16.710799 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fccc6c-1830-4f02-bf22-b0c555086da6 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:16.741189 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1181/2369] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:16 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:29:16.743181 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d13d76-1880-4f49-9fe1-63fee46096b6 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:16.753458 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d13d76-1880-4f49-9fe1-63fee46096b6 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:16.815655 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600b5b3-55d1-4e0b-9948-b028f3757b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:16.816329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600b5b3-55d1-4e0b-9948-b028f3757b9a admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:16.816614 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600b5b3-55d1-4e0b-9948-b028f3757b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:16.816896 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600b5b3-55d1-4e0b-9948-b028f3757b9a admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:16.817683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600b5b3-55d1-4e0b-9948-b028f3757b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:16.819576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600b5b3-55d1-4e0b-9948-b028f3757b9a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:16.840842 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1189/2370] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:16 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:16.846532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fccc6c-1830-4f02-bf22-b0c555086da6 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:16.858725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fccc6c-1830-4f02-bf22-b0c555086da6 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:16.864209 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263697f-dd98-4a3d-838b-712dad871b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:16.864874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263697f-dd98-4a3d-838b-712dad871b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:16.865155 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263697f-dd98-4a3d-838b-712dad871b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:16.865462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263697f-dd98-4a3d-838b-712dad871b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:16.866239 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263697f-dd98-4a3d-838b-712dad871b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:16.868285 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263697f-dd98-4a3d-838b-712dad871b8d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:16.879158 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1182/2371] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:16.883256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600b5b3-55d1-4e0b-9948-b028f3757b9a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:16.894405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600b5b3-55d1-4e0b-9948-b028f3757b9a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:16.900058 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b948382-73bf-4029-be9a-b0bc7a98c50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:16.900719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b948382-73bf-4029-be9a-b0bc7a98c50f admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:16.901043 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b948382-73bf-4029-be9a-b0bc7a98c50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:16.901332 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b948382-73bf-4029-be9a-b0bc7a98c50f admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:16.902098 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b948382-73bf-4029-be9a-b0bc7a98c50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:16.903672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b948382-73bf-4029-be9a-b0bc7a98c50f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:16.915653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1190/2372] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:16.920390 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263697f-dd98-4a3d-838b-712dad871b8d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:16.933411 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263697f-dd98-4a3d-838b-712dad871b8d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:16.939089 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de74db-7b23-4ae2-a9ed-ea9c0033203e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:16.939983 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de74db-7b23-4ae2-a9ed-ea9c0033203e admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:16.940266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de74db-7b23-4ae2-a9ed-ea9c0033203e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:16.940859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de74db-7b23-4ae2-a9ed-ea9c0033203e admin admin] PATH_INFO: `/v3/projects/89ea6c1699784e6b96bf01c33df0745e/users/59b89f676dca4e7bb355cfec7ae25ff8/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:16.957129 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de74db-7b23-4ae2-a9ed-ea9c0033203e admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ea6c1699784e6b96bf01c33df0745e, user_id=59b89f676dca4e7bb355cfec7ae25ff8, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:16.959911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de74db-7b23-4ae2-a9ed-ea9c0033203e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:16.973117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1183/2373] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:16 2022] PUT /identity/v3/projects/89ea6c1699784e6b96bf01c33df0745e/users/59b89f676dca4e7bb355cfec7ae25ff8/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:29:16.984337 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaa575-d254-4e8d-b0f9-c5939626f0ff None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:16.984647 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaa575-d254-4e8d-b0f9-c5939626f0ff None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:16.984927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaa575-d254-4e8d-b0f9-c5939626f0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:17.014569 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-bceaa575-d254-4e8d-b0f9-c5939626f0ff None None] MFA Rules not processed for user `59b89f676dca4e7bb355cfec7ae25ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:17.015882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-bceaa575-d254-4e8d-b0f9-c5939626f0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:17.057638 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:17.088662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1191/2374] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:17.100259 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de74db-7b23-4ae2-a9ed-ea9c0033203e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:17.103539 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-83de74db-7b23-4ae2-a9ed-ea9c0033203e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:17.121129 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:17.176478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de74db-7b23-4ae2-a9ed-ea9c0033203e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:17.180247 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e3abf-ee33-4aa7-b18d-6e5ae29e4730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:17.180906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e3abf-ee33-4aa7-b18d-6e5ae29e4730 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:17.181189 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e3abf-ee33-4aa7-b18d-6e5ae29e4730 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:17.181500 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e3abf-ee33-4aa7-b18d-6e5ae29e4730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:17.191463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e3abf-ee33-4aa7-b18d-6e5ae29e4730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:17.194442 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e3abf-ee33-4aa7-b18d-6e5ae29e4730 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:17.208720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1184/2375] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:22.751926 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaa575-d254-4e8d-b0f9-c5939626f0ff None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:22.815694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaa575-d254-4e8d-b0f9-c5939626f0ff None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:22.820516 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70944ed0-40de-47ec-bc27-9f58aff99006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:22.821460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70944ed0-40de-47ec-bc27-9f58aff99006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:22.821743 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70944ed0-40de-47ec-bc27-9f58aff99006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:22.822016 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70944ed0-40de-47ec-bc27-9f58aff99006 admin admin] PATH_INFO: `/v3/users/59b89f676dca4e7bb355cfec7ae25ff8` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:22.823236 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70944ed0-40de-47ec-bc27-9f58aff99006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b89f676dca4e7bb355cfec7ae25ff8)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:22.825489 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70944ed0-40de-47ec-bc27-9f58aff99006 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:22.884082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-70944ed0-40de-47ec-bc27-9f58aff99006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b89f676dca4e7bb355cfec7ae25ff8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:22.884808 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-70944ed0-40de-47ec-bc27-9f58aff99006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b89f676dca4e7bb355cfec7ae25ff8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:22.899213 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-70944ed0-40de-47ec-bc27-9f58aff99006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b89f676dca4e7bb355cfec7ae25ff8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:22.908624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-70944ed0-40de-47ec-bc27-9f58aff99006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b89f676dca4e7bb355cfec7ae25ff8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:22.909338 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-70944ed0-40de-47ec-bc27-9f58aff99006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b89f676dca4e7bb355cfec7ae25ff8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:22.940459 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1192/2376] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:22 2022] DELETE /identity/v3/users/59b89f676dca4e7bb355cfec7ae25ff8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:22.947272 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33483d-db54-40e8-a30a-7c97193bb1da None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:22.947781 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33483d-db54-40e8-a30a-7c97193bb1da None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:22.947781 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33483d-db54-40e8-a30a-7c97193bb1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:22.971567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-0d33483d-db54-40e8-a30a-7c97193bb1da None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:22.972837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0d33483d-db54-40e8-a30a-7c97193bb1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:23.084983 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1185/2377] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:23.097771 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70944ed0-40de-47ec-bc27-9f58aff99006 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:23.099552 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-70944ed0-40de-47ec-bc27-9f58aff99006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:23.179049 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70944ed0-40de-47ec-bc27-9f58aff99006 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:23.182952 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f932e66-4b7a-4679-91f0-49c9fc6595d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:23.183749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f932e66-4b7a-4679-91f0-49c9fc6595d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:23.184680 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f932e66-4b7a-4679-91f0-49c9fc6595d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:23.185064 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f932e66-4b7a-4679-91f0-49c9fc6595d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:23.197180 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f932e66-4b7a-4679-91f0-49c9fc6595d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:23.198988 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f932e66-4b7a-4679-91f0-49c9fc6595d1 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:23.209738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1193/2378] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:23.783084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33483d-db54-40e8-a30a-7c97193bb1da None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:23.784583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0d33483d-db54-40e8-a30a-7c97193bb1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:23.804669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33483d-db54-40e8-a30a-7c97193bb1da None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:23.811765 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4140f4-909d-4ac5-afbf-265535a6db09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:23.812669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4140f4-909d-4ac5-afbf-265535a6db09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:23.812981 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4140f4-909d-4ac5-afbf-265535a6db09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:23.813512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4140f4-909d-4ac5-afbf-265535a6db09 admin admin] PATH_INFO: `/v3/projects/89ea6c1699784e6b96bf01c33df0745e` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:23.815327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4140f4-909d-4ac5-afbf-265535a6db09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ea6c1699784e6b96bf01c33df0745e)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:23.818741 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4140f4-909d-4ac5-afbf-265535a6db09 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:23.898258 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5a4140f4-909d-4ac5-afbf-265535a6db09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ea6c1699784e6b96bf01c33df0745e', 'request_id': 'req-5a4140f4-909d-4ac5-afbf-265535a6db09'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:23.910105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5a4140f4-909d-4ac5-afbf-265535a6db09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ea6c1699784e6b96bf01c33df0745e', 'request_id': 'req-5a4140f4-909d-4ac5-afbf-265535a6db09'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:23.917659 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5a4140f4-909d-4ac5-afbf-265535a6db09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ea6c1699784e6b96bf01c33df0745e', 'request_id': 'req-5a4140f4-909d-4ac5-afbf-265535a6db09'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:23.934700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5a4140f4-909d-4ac5-afbf-265535a6db09 admin admin] The token cache is being invalidate because project 89ea6c1699784e6b96bf01c33df0745e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:23.935090 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5a4140f4-909d-4ac5-afbf-265535a6db09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:23.936021 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5a4140f4-909d-4ac5-afbf-265535a6db09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:23.938698 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1186/2379] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:23 2022] DELETE /identity/v3/projects/89ea6c1699784e6b96bf01c33df0745e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:24.049322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f932e66-4b7a-4679-91f0-49c9fc6595d1 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:24.050977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3f932e66-4b7a-4679-91f0-49c9fc6595d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:24.068542 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f932e66-4b7a-4679-91f0-49c9fc6595d1 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:24.073924 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:24.141440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24c071-3f25-4e57-b259-fc5f531332f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:24.142615 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24c071-3f25-4e57-b259-fc5f531332f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:24.142978 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24c071-3f25-4e57-b259-fc5f531332f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:24.143258 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24c071-3f25-4e57-b259-fc5f531332f2 admin admin] PATH_INFO: `/v3/users/8d31caf469e04329855cc553a140a8ba` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:24.144906 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24c071-3f25-4e57-b259-fc5f531332f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d31caf469e04329855cc553a140a8ba)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:24.147092 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24c071-3f25-4e57-b259-fc5f531332f2 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:24.209759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ae24c071-3f25-4e57-b259-fc5f531332f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d31caf469e04329855cc553a140a8ba'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:24.211716 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ae24c071-3f25-4e57-b259-fc5f531332f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d31caf469e04329855cc553a140a8ba'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:24.223520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ae24c071-3f25-4e57-b259-fc5f531332f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d31caf469e04329855cc553a140a8ba'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:24.241048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ae24c071-3f25-4e57-b259-fc5f531332f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d31caf469e04329855cc553a140a8ba'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:24.241823 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ae24c071-3f25-4e57-b259-fc5f531332f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d31caf469e04329855cc553a140a8ba'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:24.255985 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1194/2380] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:24 2022] DELETE /identity/v3/users/8d31caf469e04329855cc553a140a8ba => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:24.442131 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4140f4-909d-4ac5-afbf-265535a6db09 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:24.443714 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5a4140f4-909d-4ac5-afbf-265535a6db09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:24.459522 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4140f4-909d-4ac5-afbf-265535a6db09 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:24.502514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:24.524543 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbbf05-fb93-4167-9cb8-762dcd3cda12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:24.525451 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbbf05-fb93-4167-9cb8-762dcd3cda12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:24.525735 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbbf05-fb93-4167-9cb8-762dcd3cda12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:24.526013 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbbf05-fb93-4167-9cb8-762dcd3cda12 admin admin] PATH_INFO: `/v3/projects/fbf385f9a98e4338b9a7f200cda03f6d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:24.527208 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbbf05-fb93-4167-9cb8-762dcd3cda12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf385f9a98e4338b9a7f200cda03f6d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:24.529176 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbbf05-fb93-4167-9cb8-762dcd3cda12 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:24.581555 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-72fbbf05-fb93-4167-9cb8-762dcd3cda12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf385f9a98e4338b9a7f200cda03f6d', 'request_id': 'req-72fbbf05-fb93-4167-9cb8-762dcd3cda12'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:24.587193 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-72fbbf05-fb93-4167-9cb8-762dcd3cda12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf385f9a98e4338b9a7f200cda03f6d', 'request_id': 'req-72fbbf05-fb93-4167-9cb8-762dcd3cda12'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:24.593505 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-72fbbf05-fb93-4167-9cb8-762dcd3cda12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf385f9a98e4338b9a7f200cda03f6d', 'request_id': 'req-72fbbf05-fb93-4167-9cb8-762dcd3cda12'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:24.606467 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-72fbbf05-fb93-4167-9cb8-762dcd3cda12 admin admin] The token cache is being invalidate because project fbf385f9a98e4338b9a7f200cda03f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:24.606755 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-72fbbf05-fb93-4167-9cb8-762dcd3cda12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:24.607962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-72fbbf05-fb93-4167-9cb8-762dcd3cda12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:24.609704 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1187/2381] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:24 2022] DELETE /identity/v3/projects/fbf385f9a98e4338b9a7f200cda03f6d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:29:24.613945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24c071-3f25-4e57-b259-fc5f531332f2 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:24.615041 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ae24c071-3f25-4e57-b259-fc5f531332f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:24.628665 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24c071-3f25-4e57-b259-fc5f531332f2 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:24.699667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca7f3f-c96c-4a15-a592-287842a64678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:24.699667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca7f3f-c96c-4a15-a592-287842a64678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:24.699667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca7f3f-c96c-4a15-a592-287842a64678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:24.699667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca7f3f-c96c-4a15-a592-287842a64678 admin admin] PATH_INFO: `/v3/users/a2d232bb0d4244958ea95a51089b0504` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:24.701506 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca7f3f-c96c-4a15-a592-287842a64678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d232bb0d4244958ea95a51089b0504)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:24.703499 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca7f3f-c96c-4a15-a592-287842a64678 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:24.727737 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:24.756169 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a7ca7f3f-c96c-4a15-a592-287842a64678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d232bb0d4244958ea95a51089b0504'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:24.756946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a7ca7f3f-c96c-4a15-a592-287842a64678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d232bb0d4244958ea95a51089b0504'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:24.769698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a7ca7f3f-c96c-4a15-a592-287842a64678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d232bb0d4244958ea95a51089b0504'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:24.777968 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a7ca7f3f-c96c-4a15-a592-287842a64678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d232bb0d4244958ea95a51089b0504'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:24.778890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a7ca7f3f-c96c-4a15-a592-287842a64678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d232bb0d4244958ea95a51089b0504'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:24.792727 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1195/2382] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:24 2022] DELETE /identity/v3/users/a2d232bb0d4244958ea95a51089b0504 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:24.996165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbbf05-fb93-4167-9cb8-762dcd3cda12 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:24.998616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-72fbbf05-fb93-4167-9cb8-762dcd3cda12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:25.012132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbbf05-fb93-4167-9cb8-762dcd3cda12 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:25.079237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c43140-1267-4243-8b0d-05ff5b5fe9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:25.080110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c43140-1267-4243-8b0d-05ff5b5fe9db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:25.080388 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c43140-1267-4243-8b0d-05ff5b5fe9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:25.080662 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c43140-1267-4243-8b0d-05ff5b5fe9db admin admin] PATH_INFO: `/v3/projects/cf306f171b1e47c286c6b6cbd60110ef` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:25.081911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c43140-1267-4243-8b0d-05ff5b5fe9db admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf306f171b1e47c286c6b6cbd60110ef)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:25.083828 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c43140-1267-4243-8b0d-05ff5b5fe9db admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:25.132870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-08c43140-1267-4243-8b0d-05ff5b5fe9db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf306f171b1e47c286c6b6cbd60110ef', 'request_id': 'req-08c43140-1267-4243-8b0d-05ff5b5fe9db'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:25.138844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-08c43140-1267-4243-8b0d-05ff5b5fe9db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf306f171b1e47c286c6b6cbd60110ef', 'request_id': 'req-08c43140-1267-4243-8b0d-05ff5b5fe9db'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:25.145163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-08c43140-1267-4243-8b0d-05ff5b5fe9db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf306f171b1e47c286c6b6cbd60110ef', 'request_id': 'req-08c43140-1267-4243-8b0d-05ff5b5fe9db'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:25.155610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:25.159768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-08c43140-1267-4243-8b0d-05ff5b5fe9db admin admin] The token cache is being invalidate because project cf306f171b1e47c286c6b6cbd60110ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:25.160259 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-08c43140-1267-4243-8b0d-05ff5b5fe9db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:25.161368 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-08c43140-1267-4243-8b0d-05ff5b5fe9db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:25.163034 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1188/2383] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:24 2022] DELETE /identity/v3/projects/cf306f171b1e47c286c6b6cbd60110ef => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:25.168060 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6e26c-68cc-479a-9746-b5e2b12c5ca7 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:25.168515 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6e26c-68cc-479a-9746-b5e2b12c5ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:25.168604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6e26c-68cc-479a-9746-b5e2b12c5ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:25.186829 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-eab6e26c-68cc-479a-9746-b5e2b12c5ca7 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:25.187951 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-eab6e26c-68cc-479a-9746-b5e2b12c5ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:25.255941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1196/2384] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:25.265842 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f1af2-f540-4550-9b83-e3db62365d17 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:25.266267 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f1af2-f540-4550-9b83-e3db62365d17 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:25.266590 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f1af2-f540-4550-9b83-e3db62365d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:25.291320 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-278f1af2-f540-4550-9b83-e3db62365d17 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:25.292602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-278f1af2-f540-4550-9b83-e3db62365d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:25.303126 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1189/2385] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:25.307577 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6e26c-68cc-479a-9746-b5e2b12c5ca7 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:25.317545 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6e26c-68cc-479a-9746-b5e2b12c5ca7 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:25.322185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13290d75-f777-4b93-9e3a-62008e061d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:25.322859 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13290d75-f777-4b93-9e3a-62008e061d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:25.323138 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13290d75-f777-4b93-9e3a-62008e061d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:25.323410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13290d75-f777-4b93-9e3a-62008e061d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:25.324123 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13290d75-f777-4b93-9e3a-62008e061d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:29:25.324429 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13290d75-f777-4b93-9e3a-62008e061d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:25.327016 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13290d75-f777-4b93-9e3a-62008e061d00 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:25.345603 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1197/2386] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:29:25.349804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f1af2-f540-4550-9b83-e3db62365d17 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:25.359227 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f1af2-f540-4550-9b83-e3db62365d17 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:25.363857 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad941486-5310-4a9e-8dd6-3b0e94b1ebea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:25.364496 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad941486-5310-4a9e-8dd6-3b0e94b1ebea admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:25.364782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad941486-5310-4a9e-8dd6-3b0e94b1ebea admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:25.365082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad941486-5310-4a9e-8dd6-3b0e94b1ebea admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:25.365843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad941486-5310-4a9e-8dd6-3b0e94b1ebea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:25.367743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad941486-5310-4a9e-8dd6-3b0e94b1ebea admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:25.393064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1190/2387] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:25 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:25.397198 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13290d75-f777-4b93-9e3a-62008e061d00 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:25.407846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13290d75-f777-4b93-9e3a-62008e061d00 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:25.465767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce89b8-87ac-4361-96be-73e992d61fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:25.467767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce89b8-87ac-4361-96be-73e992d61fff admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:25.468151 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce89b8-87ac-4361-96be-73e992d61fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:25.468412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce89b8-87ac-4361-96be-73e992d61fff admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:25.469032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce89b8-87ac-4361-96be-73e992d61fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:25.471021 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce89b8-87ac-4361-96be-73e992d61fff admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:25.494850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1198/2388] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:25 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:25.499266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad941486-5310-4a9e-8dd6-3b0e94b1ebea admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:25.510724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad941486-5310-4a9e-8dd6-3b0e94b1ebea admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:25.517572 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ae6e5-5150-435b-a635-3ff8bb94e35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:25.518463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ae6e5-5150-435b-a635-3ff8bb94e35d admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:25.518815 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ae6e5-5150-435b-a635-3ff8bb94e35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:25.519198 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ae6e5-5150-435b-a635-3ff8bb94e35d admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:25.520045 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ae6e5-5150-435b-a635-3ff8bb94e35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:25.522217 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ae6e5-5150-435b-a635-3ff8bb94e35d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:25.540811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1191/2389] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:29:25.545092 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce89b8-87ac-4361-96be-73e992d61fff admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:25.555699 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce89b8-87ac-4361-96be-73e992d61fff admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:25.560701 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb009bf-0f53-44d9-a6a8-52f3ab614201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:25.561417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb009bf-0f53-44d9-a6a8-52f3ab614201 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:25.561699 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb009bf-0f53-44d9-a6a8-52f3ab614201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:25.561971 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb009bf-0f53-44d9-a6a8-52f3ab614201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:25.562689 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb009bf-0f53-44d9-a6a8-52f3ab614201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:25.564305 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb009bf-0f53-44d9-a6a8-52f3ab614201 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:25.577628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1199/2390] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:29:25.581732 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ae6e5-5150-435b-a635-3ff8bb94e35d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:25.592561 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ae6e5-5150-435b-a635-3ff8bb94e35d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:25.598163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d990c88-0dc9-42e5-88ba-e69e91ffaa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:25.599063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d990c88-0dc9-42e5-88ba-e69e91ffaa30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:25.599349 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d990c88-0dc9-42e5-88ba-e69e91ffaa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:25.599621 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d990c88-0dc9-42e5-88ba-e69e91ffaa30 admin admin] PATH_INFO: `/v3/projects/e24501344c0d41cb8d626c5c0455e5c7/users/0fac03d79cd8423bbc74dc4dcca98e89/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:25.616344 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d990c88-0dc9-42e5-88ba-e69e91ffaa30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e24501344c0d41cb8d626c5c0455e5c7, user_id=0fac03d79cd8423bbc74dc4dcca98e89, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:25.619070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d990c88-0dc9-42e5-88ba-e69e91ffaa30 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:25.633713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1192/2391] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:25 2022] PUT /identity/v3/projects/e24501344c0d41cb8d626c5c0455e5c7/users/0fac03d79cd8423bbc74dc4dcca98e89/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:29:25.644496 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aab25c-2481-4363-b474-1e890be10eb3 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:25.644994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aab25c-2481-4363-b474-1e890be10eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:25.645299 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aab25c-2481-4363-b474-1e890be10eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:25.660486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:25.675699 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f4aab25c-2481-4363-b474-1e890be10eb3 None None] MFA Rules not processed for user `0fac03d79cd8423bbc74dc4dcca98e89`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:25.676922 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f4aab25c-2481-4363-b474-1e890be10eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:25.745019 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1200/2392] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:25.749913 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d990c88-0dc9-42e5-88ba-e69e91ffaa30 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:25.771200 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aab25c-2481-4363-b474-1e890be10eb3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:25.772601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f4aab25c-2481-4363-b474-1e890be10eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:25.834130 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d990c88-0dc9-42e5-88ba-e69e91ffaa30 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:25.843592 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aab25c-2481-4363-b474-1e890be10eb3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:25.845861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f81743-07e4-4517-91c5-5e20f11b6081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:25.848197 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f81743-07e4-4517-91c5-5e20f11b6081 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:25.848887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f81743-07e4-4517-91c5-5e20f11b6081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:25.849015 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2066d7-d47d-44b3-974f-705d51bf06eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:25.849585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f81743-07e4-4517-91c5-5e20f11b6081 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:25.849890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2066d7-d47d-44b3-974f-705d51bf06eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:25.850177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2066d7-d47d-44b3-974f-705d51bf06eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:25.850503 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2066d7-d47d-44b3-974f-705d51bf06eb admin admin] PATH_INFO: `/v3/users/2b77f23c837d4620be1bda143618ba13` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:25.852302 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f81743-07e4-4517-91c5-5e20f11b6081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:25.852478 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2066d7-d47d-44b3-974f-705d51bf06eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b77f23c837d4620be1bda143618ba13)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:25.854425 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2066d7-d47d-44b3-974f-705d51bf06eb admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:25.854619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f81743-07e4-4517-91c5-5e20f11b6081 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:25.893798 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1193/2393] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:25 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:25.895164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f81743-07e4-4517-91c5-5e20f11b6081 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:25.918183 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6d2066d7-d47d-44b3-974f-705d51bf06eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b77f23c837d4620be1bda143618ba13'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:25.919228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6d2066d7-d47d-44b3-974f-705d51bf06eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b77f23c837d4620be1bda143618ba13'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:25.939967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6d2066d7-d47d-44b3-974f-705d51bf06eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b77f23c837d4620be1bda143618ba13'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:25.949761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6d2066d7-d47d-44b3-974f-705d51bf06eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b77f23c837d4620be1bda143618ba13'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:25.952075 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6d2066d7-d47d-44b3-974f-705d51bf06eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b77f23c837d4620be1bda143618ba13'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:25.976008 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1201/2394] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:25 2022] DELETE /identity/v3/users/2b77f23c837d4620be1bda143618ba13 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:25.981429 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5907e97-2ddc-43e8-9df0-65f6f75d6060 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:25.982786 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5907e97-2ddc-43e8-9df0-65f6f75d6060 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:25.983205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5907e97-2ddc-43e8-9df0-65f6f75d6060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:26.006715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f81743-07e4-4517-91c5-5e20f11b6081 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:26.013328 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e5907e97-2ddc-43e8-9df0-65f6f75d6060 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:26.014848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e5907e97-2ddc-43e8-9df0-65f6f75d6060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:26.030269 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:26.036058 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:26.099526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ff4a3-a543-4d00-a34f-4a8e0eb234ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:26.100471 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ff4a3-a543-4d00-a34f-4a8e0eb234ca admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:26.100936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ff4a3-a543-4d00-a34f-4a8e0eb234ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:26.101230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ff4a3-a543-4d00-a34f-4a8e0eb234ca admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:26.102484 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ff4a3-a543-4d00-a34f-4a8e0eb234ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:26.105570 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ff4a3-a543-4d00-a34f-4a8e0eb234ca admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:26.123167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1202/2395] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:26.133109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5907e97-2ddc-43e8-9df0-65f6f75d6060 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:26.134726 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e5907e97-2ddc-43e8-9df0-65f6f75d6060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:26.141171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1194/2396] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:25 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:29:26.142249 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ff4a3-a543-4d00-a34f-4a8e0eb234ca admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:26.144203 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-045ff4a3-a543-4d00-a34f-4a8e0eb234ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:26.157875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ff4a3-a543-4d00-a34f-4a8e0eb234ca admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:26.165218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16b9c0-dedf-4e28-a986-34442a0d4cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:26.165913 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16b9c0-dedf-4e28-a986-34442a0d4cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:26.166197 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16b9c0-dedf-4e28-a986-34442a0d4cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:26.166474 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16b9c0-dedf-4e28-a986-34442a0d4cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:26.167248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16b9c0-dedf-4e28-a986-34442a0d4cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:26.168841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16b9c0-dedf-4e28-a986-34442a0d4cf6 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:26.179462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1195/2397] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:26.184382 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16b9c0-dedf-4e28-a986-34442a0d4cf6 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:26.196841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16b9c0-dedf-4e28-a986-34442a0d4cf6 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:26.201384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5907e97-2ddc-43e8-9df0-65f6f75d6060 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:26.203619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926078b1-5b4a-4c3c-a90f-5e9c774213a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:26.204415 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926078b1-5b4a-4c3c-a90f-5e9c774213a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:26.205065 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926078b1-5b4a-4c3c-a90f-5e9c774213a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:26.205065 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926078b1-5b4a-4c3c-a90f-5e9c774213a9 admin admin] PATH_INFO: `/v3/projects/6f33ba5ce8e84c8dbadb6abd880fe498/users/a3c41d406eb547a2b3053fccf2440c30/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:26.206519 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f3324-8b91-42d9-93c4-69992a02e37e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:26.207257 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f3324-8b91-42d9-93c4-69992a02e37e service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:26.207614 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f3324-8b91-42d9-93c4-69992a02e37e service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:26.207961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f3324-8b91-42d9-93c4-69992a02e37e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:26.222697 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926078b1-5b4a-4c3c-a90f-5e9c774213a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f33ba5ce8e84c8dbadb6abd880fe498, user_id=a3c41d406eb547a2b3053fccf2440c30, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:26.224205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f3324-8b91-42d9-93c4-69992a02e37e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:26.225680 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926078b1-5b4a-4c3c-a90f-5e9c774213a9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:26.225794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f3324-8b91-42d9-93c4-69992a02e37e service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:26.237293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1203/2398] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:26.245387 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1196/2399] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:26 2022] PUT /identity/v3/projects/6f33ba5ce8e84c8dbadb6abd880fe498/users/a3c41d406eb547a2b3053fccf2440c30/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:26.249485 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f3324-8b91-42d9-93c4-69992a02e37e service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:26.259374 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f3324-8b91-42d9-93c4-69992a02e37e service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:26.335333 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc96a9-f91c-45e1-a45c-324f35e112c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:26.336096 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc96a9-f91c-45e1-a45c-324f35e112c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:26.336309 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc96a9-f91c-45e1-a45c-324f35e112c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:26.336589 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc96a9-f91c-45e1-a45c-324f35e112c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:26.337398 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc96a9-f91c-45e1-a45c-324f35e112c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:26.339107 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc96a9-f91c-45e1-a45c-324f35e112c7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:26.355054 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1204/2400] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:26.359627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926078b1-5b4a-4c3c-a90f-5e9c774213a9 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:26.372205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926078b1-5b4a-4c3c-a90f-5e9c774213a9 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:26.378471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc96a9-f91c-45e1-a45c-324f35e112c7 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:26.382290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e4dc96a9-f91c-45e1-a45c-324f35e112c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:26.393620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43534370-3635-4e3b-abb4-aeea9481ef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:26.394525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43534370-3635-4e3b-abb4-aeea9481ef6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:26.394808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43534370-3635-4e3b-abb4-aeea9481ef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:26.395087 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43534370-3635-4e3b-abb4-aeea9481ef6e admin admin] PATH_INFO: `/v3/projects/6f33ba5ce8e84c8dbadb6abd880fe498/users/a3c41d406eb547a2b3053fccf2440c30/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:26.398342 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43534370-3635-4e3b-abb4-aeea9481ef6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f33ba5ce8e84c8dbadb6abd880fe498, user_id=a3c41d406eb547a2b3053fccf2440c30, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:26.402155 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43534370-3635-4e3b-abb4-aeea9481ef6e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:26.402775 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc96a9-f91c-45e1-a45c-324f35e112c7 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:26.410936 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcc146-ef2e-4365-b73a-f0d22a51a416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:26.414479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcc146-ef2e-4365-b73a-f0d22a51a416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:26.415283 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcc146-ef2e-4365-b73a-f0d22a51a416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:26.415977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcc146-ef2e-4365-b73a-f0d22a51a416 admin admin] PATH_INFO: `/v3/users/a9c7ca3570c2417fb54328d939382a1c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:26.418263 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcc146-ef2e-4365-b73a-f0d22a51a416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9c7ca3570c2417fb54328d939382a1c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:26.421015 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcc146-ef2e-4365-b73a-f0d22a51a416 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:26.445697 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1197/2401] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:26 2022] PUT /identity/v3/projects/6f33ba5ce8e84c8dbadb6abd880fe498/users/a3c41d406eb547a2b3053fccf2440c30/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:26.451443 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db59d2-0eed-4df6-8daf-323b416579d3 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:26.451773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db59d2-0eed-4df6-8daf-323b416579d3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:26.453541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db59d2-0eed-4df6-8daf-323b416579d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:26.482132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-98fcc146-ef2e-4365-b73a-f0d22a51a416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9c7ca3570c2417fb54328d939382a1c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:26.482874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-98fcc146-ef2e-4365-b73a-f0d22a51a416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9c7ca3570c2417fb54328d939382a1c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:26.486031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:26.496575 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e4db59d2-0eed-4df6-8daf-323b416579d3 None None] MFA Rules not processed for user `a3c41d406eb547a2b3053fccf2440c30`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:26.499127 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e4db59d2-0eed-4df6-8daf-323b416579d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:26.504501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-98fcc146-ef2e-4365-b73a-f0d22a51a416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9c7ca3570c2417fb54328d939382a1c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:26.528339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-98fcc146-ef2e-4365-b73a-f0d22a51a416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9c7ca3570c2417fb54328d939382a1c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:26.529168 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-98fcc146-ef2e-4365-b73a-f0d22a51a416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9c7ca3570c2417fb54328d939382a1c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:26.547598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1205/2402] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:26 2022] DELETE /identity/v3/users/a9c7ca3570c2417fb54328d939382a1c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:26.552539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fa23c-1840-4acd-85da-cb4e0387b95e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:26.552901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fa23c-1840-4acd-85da-cb4e0387b95e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:26.553183 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fa23c-1840-4acd-85da-cb4e0387b95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:26.572871 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ce9fa23c-1840-4acd-85da-cb4e0387b95e None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:26.574459 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ce9fa23c-1840-4acd-85da-cb4e0387b95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:26.626282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1198/2403] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:26.643355 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db59d2-0eed-4df6-8daf-323b416579d3 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:26.646018 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e4db59d2-0eed-4df6-8daf-323b416579d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:26.648982 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1206/2404] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:26.665305 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fa23c-1840-4acd-85da-cb4e0387b95e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:26.667162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ce9fa23c-1840-4acd-85da-cb4e0387b95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:26.744804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fa23c-1840-4acd-85da-cb4e0387b95e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:26.749492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db59d2-0eed-4df6-8daf-323b416579d3 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:26.749636 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93c38f-5078-4eb9-9f9c-68c6472dd406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:26.750276 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93c38f-5078-4eb9-9f9c-68c6472dd406 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:26.750566 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93c38f-5078-4eb9-9f9c-68c6472dd406 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:26.750845 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93c38f-5078-4eb9-9f9c-68c6472dd406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:26.761590 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:26.771914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93c38f-5078-4eb9-9f9c-68c6472dd406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:26.773965 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93c38f-5078-4eb9-9f9c-68c6472dd406 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:26.786223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1207/2405] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:26.787101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93c38f-5078-4eb9-9f9c-68c6472dd406 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:26.788461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-cf93c38f-5078-4eb9-9f9c-68c6472dd406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:26.802793 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93c38f-5078-4eb9-9f9c-68c6472dd406 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:26.807920 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788937d7-c6ca-4fec-91b5-b3bdaa189bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:26.808902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788937d7-c6ca-4fec-91b5-b3bdaa189bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:26.809189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788937d7-c6ca-4fec-91b5-b3bdaa189bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:26.809537 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788937d7-c6ca-4fec-91b5-b3bdaa189bd9 admin admin] PATH_INFO: `/v3/projects/6b532463be7c4b429af558023f94b034` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:26.811404 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788937d7-c6ca-4fec-91b5-b3bdaa189bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b532463be7c4b429af558023f94b034)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:26.813344 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a149d80-7269-408b-aaa4-c9985712b5c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:26.813492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788937d7-c6ca-4fec-91b5-b3bdaa189bd9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:26.813994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a149d80-7269-408b-aaa4-c9985712b5c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:26.814276 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a149d80-7269-408b-aaa4-c9985712b5c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:26.814693 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a149d80-7269-408b-aaa4-c9985712b5c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:26.816604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7a149d80-7269-408b-aaa4-c9985712b5c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:26.870171 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-788937d7-c6ca-4fec-91b5-b3bdaa189bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b532463be7c4b429af558023f94b034', 'request_id': 'req-788937d7-c6ca-4fec-91b5-b3bdaa189bd9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:26.881483 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-788937d7-c6ca-4fec-91b5-b3bdaa189bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b532463be7c4b429af558023f94b034', 'request_id': 'req-788937d7-c6ca-4fec-91b5-b3bdaa189bd9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:26.886112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a149d80-7269-408b-aaa4-c9985712b5c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:26.887482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a149d80-7269-408b-aaa4-c9985712b5c9 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:26.888615 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-788937d7-c6ca-4fec-91b5-b3bdaa189bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b532463be7c4b429af558023f94b034', 'request_id': 'req-788937d7-c6ca-4fec-91b5-b3bdaa189bd9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:26.890821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:26.898015 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1199/2406] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:26.904820 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-788937d7-c6ca-4fec-91b5-b3bdaa189bd9 admin admin] The token cache is being invalidate because project 6b532463be7c4b429af558023f94b034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:26.905183 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-788937d7-c6ca-4fec-91b5-b3bdaa189bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:26.906252 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-788937d7-c6ca-4fec-91b5-b3bdaa189bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:26.910010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1208/2407] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:26 2022] DELETE /identity/v3/projects/6b532463be7c4b429af558023f94b034 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:27.210703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a149d80-7269-408b-aaa4-c9985712b5c9 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:27.215218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7a149d80-7269-408b-aaa4-c9985712b5c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:27.232606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a149d80-7269-408b-aaa4-c9985712b5c9 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:27.304151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f8204-8900-46f2-a71d-3aa664a467cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:27.305026 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f8204-8900-46f2-a71d-3aa664a467cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:27.305358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f8204-8900-46f2-a71d-3aa664a467cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:27.305616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f8204-8900-46f2-a71d-3aa664a467cb admin admin] PATH_INFO: `/v3/projects/dd9aae147d6d4d3885d5780d08d2c6ad` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:27.306823 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f8204-8900-46f2-a71d-3aa664a467cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd9aae147d6d4d3885d5780d08d2c6ad)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:27.308986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f8204-8900-46f2-a71d-3aa664a467cb admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:27.358144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ba2f8204-8900-46f2-a71d-3aa664a467cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd9aae147d6d4d3885d5780d08d2c6ad', 'request_id': 'req-ba2f8204-8900-46f2-a71d-3aa664a467cb'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:27.363729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ba2f8204-8900-46f2-a71d-3aa664a467cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd9aae147d6d4d3885d5780d08d2c6ad', 'request_id': 'req-ba2f8204-8900-46f2-a71d-3aa664a467cb'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:27.370175 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ba2f8204-8900-46f2-a71d-3aa664a467cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd9aae147d6d4d3885d5780d08d2c6ad', 'request_id': 'req-ba2f8204-8900-46f2-a71d-3aa664a467cb'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:27.374425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:27.385033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ba2f8204-8900-46f2-a71d-3aa664a467cb admin admin] The token cache is being invalidate because project dd9aae147d6d4d3885d5780d08d2c6ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:27.385362 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ba2f8204-8900-46f2-a71d-3aa664a467cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:27.385985 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ba2f8204-8900-46f2-a71d-3aa664a467cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:27.387581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1200/2408] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:27 2022] DELETE /identity/v3/projects/dd9aae147d6d4d3885d5780d08d2c6ad => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:27.392546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78352850-de75-4c70-808e-e0a6788ae78d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:27.393026 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78352850-de75-4c70-808e-e0a6788ae78d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:27.393121 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78352850-de75-4c70-808e-e0a6788ae78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:27.411535 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-78352850-de75-4c70-808e-e0a6788ae78d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:27.412758 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-78352850-de75-4c70-808e-e0a6788ae78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:27.471082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1209/2409] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:27.479594 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7cfa6-3270-43cd-9496-2675a6a7be99 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:27.479883 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7cfa6-3270-43cd-9496-2675a6a7be99 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:27.480159 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7cfa6-3270-43cd-9496-2675a6a7be99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:27.498969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a3a7cfa6-3270-43cd-9496-2675a6a7be99 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:27.500147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a3a7cfa6-3270-43cd-9496-2675a6a7be99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:27.508173 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1201/2410] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:27.512302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78352850-de75-4c70-808e-e0a6788ae78d None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:27.522010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78352850-de75-4c70-808e-e0a6788ae78d None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:27.526562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f8ef9-571d-4230-97d6-4e2e0be85464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:27.527210 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f8ef9-571d-4230-97d6-4e2e0be85464 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:27.527494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f8ef9-571d-4230-97d6-4e2e0be85464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:27.527770 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f8ef9-571d-4230-97d6-4e2e0be85464 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:27.528496 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f8ef9-571d-4230-97d6-4e2e0be85464 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:29:27.529353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f8ef9-571d-4230-97d6-4e2e0be85464 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:27.530965 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f8ef9-571d-4230-97d6-4e2e0be85464 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:27.542260 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1210/2411] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:29:27.546999 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7cfa6-3270-43cd-9496-2675a6a7be99 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:27.556157 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7cfa6-3270-43cd-9496-2675a6a7be99 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:27.560835 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36aa17-c9ce-49b5-9b95-bb5526500ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:27.561519 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36aa17-c9ce-49b5-9b95-bb5526500ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:27.561807 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36aa17-c9ce-49b5-9b95-bb5526500ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:27.562084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36aa17-c9ce-49b5-9b95-bb5526500ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:27.562774 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36aa17-c9ce-49b5-9b95-bb5526500ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:27.564680 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36aa17-c9ce-49b5-9b95-bb5526500ab2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:27.592841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1202/2412] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:27 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:27.597133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f8ef9-571d-4230-97d6-4e2e0be85464 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:27.612186 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f8ef9-571d-4230-97d6-4e2e0be85464 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:27.673548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192570ac-cc12-4504-b0b3-e3fcbf93840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:27.674326 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192570ac-cc12-4504-b0b3-e3fcbf93840a admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:27.674617 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192570ac-cc12-4504-b0b3-e3fcbf93840a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:27.674903 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192570ac-cc12-4504-b0b3-e3fcbf93840a admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:27.675599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192570ac-cc12-4504-b0b3-e3fcbf93840a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:27.677620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192570ac-cc12-4504-b0b3-e3fcbf93840a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:27.698117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1211/2413] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:27 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:27.702933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36aa17-c9ce-49b5-9b95-bb5526500ab2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:27.713680 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36aa17-c9ce-49b5-9b95-bb5526500ab2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:27.719212 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fce48-7f2a-444a-bf75-24db0a293f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:27.720020 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fce48-7f2a-444a-bf75-24db0a293f67 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:27.720250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fce48-7f2a-444a-bf75-24db0a293f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:27.720871 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fce48-7f2a-444a-bf75-24db0a293f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:27.721776 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fce48-7f2a-444a-bf75-24db0a293f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:27.724341 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fce48-7f2a-444a-bf75-24db0a293f67 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:27.738593 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1203/2414] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:29:27.739903 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192570ac-cc12-4504-b0b3-e3fcbf93840a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:27.750290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192570ac-cc12-4504-b0b3-e3fcbf93840a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:27.755607 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae325fd-df4c-4bdb-932f-cb6d7f1ebc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:27.756475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae325fd-df4c-4bdb-932f-cb6d7f1ebc68 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:27.756763 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae325fd-df4c-4bdb-932f-cb6d7f1ebc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:27.757040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae325fd-df4c-4bdb-932f-cb6d7f1ebc68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:27.757809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae325fd-df4c-4bdb-932f-cb6d7f1ebc68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:27.759419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae325fd-df4c-4bdb-932f-cb6d7f1ebc68 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:27.775889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1212/2415] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:27.780400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fce48-7f2a-444a-bf75-24db0a293f67 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:27.791039 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fce48-7f2a-444a-bf75-24db0a293f67 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:27.795782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f2f17-152c-4122-8f3f-5d1301b5f954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:27.796668 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f2f17-152c-4122-8f3f-5d1301b5f954 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:27.796949 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f2f17-152c-4122-8f3f-5d1301b5f954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:27.797226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f2f17-152c-4122-8f3f-5d1301b5f954 admin admin] PATH_INFO: `/v3/projects/e809a7b4269248e3ba63ca17a3a7fe3e/users/21551f859117440cb405117ad806455c/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:27.813574 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f2f17-152c-4122-8f3f-5d1301b5f954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e809a7b4269248e3ba63ca17a3a7fe3e, user_id=21551f859117440cb405117ad806455c, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:27.816338 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f2f17-152c-4122-8f3f-5d1301b5f954 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:27.829797 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1204/2416] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:27 2022] PUT /identity/v3/projects/e809a7b4269248e3ba63ca17a3a7fe3e/users/21551f859117440cb405117ad806455c/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:27.840182 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec545a8a-a94b-48ec-9a3b-789ec18baa01 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:27.840501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec545a8a-a94b-48ec-9a3b-789ec18baa01 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:27.840779 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec545a8a-a94b-48ec-9a3b-789ec18baa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:27.874753 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ec545a8a-a94b-48ec-9a3b-789ec18baa01 None None] MFA Rules not processed for user `21551f859117440cb405117ad806455c`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:27.876105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ec545a8a-a94b-48ec-9a3b-789ec18baa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:27.922939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:27.942207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1213/2417] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:27.954463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f2f17-152c-4122-8f3f-5d1301b5f954 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:27.956206 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4d6f2f17-152c-4122-8f3f-5d1301b5f954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:28.016249 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f2f17-152c-4122-8f3f-5d1301b5f954 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:28.019976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1c964-c88a-493d-8315-c2a4bde693fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:28.020630 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1c964-c88a-493d-8315-c2a4bde693fc service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:28.020937 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1c964-c88a-493d-8315-c2a4bde693fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:28.021210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1c964-c88a-493d-8315-c2a4bde693fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:28.029715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1c964-c88a-493d-8315-c2a4bde693fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:28.031137 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1c964-c88a-493d-8315-c2a4bde693fc service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:28.040285 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1205/2418] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:29.600817 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec545a8a-a94b-48ec-9a3b-789ec18baa01 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:29.602233 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ec545a8a-a94b-48ec-9a3b-789ec18baa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:29.666401 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec545a8a-a94b-48ec-9a3b-789ec18baa01 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:29.670953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cac383-b797-46c5-970c-e66a23ea2326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:29.671825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cac383-b797-46c5-970c-e66a23ea2326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:29.672106 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cac383-b797-46c5-970c-e66a23ea2326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:29.672381 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cac383-b797-46c5-970c-e66a23ea2326 admin admin] PATH_INFO: `/v3/users/0fac03d79cd8423bbc74dc4dcca98e89` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:29.673584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cac383-b797-46c5-970c-e66a23ea2326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fac03d79cd8423bbc74dc4dcca98e89)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:29.675517 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cac383-b797-46c5-970c-e66a23ea2326 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:29.725413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-37cac383-b797-46c5-970c-e66a23ea2326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fac03d79cd8423bbc74dc4dcca98e89'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:29.726275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-37cac383-b797-46c5-970c-e66a23ea2326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fac03d79cd8423bbc74dc4dcca98e89'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:29.741975 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-37cac383-b797-46c5-970c-e66a23ea2326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fac03d79cd8423bbc74dc4dcca98e89'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:29.753752 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-37cac383-b797-46c5-970c-e66a23ea2326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fac03d79cd8423bbc74dc4dcca98e89'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:29.754203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-37cac383-b797-46c5-970c-e66a23ea2326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fac03d79cd8423bbc74dc4dcca98e89'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:29.773357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1214/2419] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:29 2022] DELETE /identity/v3/users/0fac03d79cd8423bbc74dc4dcca98e89 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:29.776350 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765780d1-e481-4366-8a5b-3c31d8fd2779 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:29.776823 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765780d1-e481-4366-8a5b-3c31d8fd2779 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:29.776940 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765780d1-e481-4366-8a5b-3c31d8fd2779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:29.807610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-765780d1-e481-4366-8a5b-3c31d8fd2779 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:29.820017 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-765780d1-e481-4366-8a5b-3c31d8fd2779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:29.904163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1206/2420] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:29.911315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cac383-b797-46c5-970c-e66a23ea2326 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:29.913043 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-37cac383-b797-46c5-970c-e66a23ea2326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:29.977953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cac383-b797-46c5-970c-e66a23ea2326 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:29.981713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce554c-f439-4c40-b5f9-766db503d036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:29.982367 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce554c-f439-4c40-b5f9-766db503d036 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:29.982657 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce554c-f439-4c40-b5f9-766db503d036 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:29.982956 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce554c-f439-4c40-b5f9-766db503d036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:29.994650 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce554c-f439-4c40-b5f9-766db503d036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:29.996138 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce554c-f439-4c40-b5f9-766db503d036 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:30.016126 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1215/2421] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:30.355115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765780d1-e481-4366-8a5b-3c31d8fd2779 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:30.357527 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-765780d1-e481-4366-8a5b-3c31d8fd2779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:30.371639 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765780d1-e481-4366-8a5b-3c31d8fd2779 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:30.377728 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cfd65-d0fd-4796-859e-93f2a482a9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:30.378588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cfd65-d0fd-4796-859e-93f2a482a9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:30.379235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cfd65-d0fd-4796-859e-93f2a482a9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:30.379630 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cfd65-d0fd-4796-859e-93f2a482a9dd admin admin] PATH_INFO: `/v3/projects/e24501344c0d41cb8d626c5c0455e5c7` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:30.380888 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cfd65-d0fd-4796-859e-93f2a482a9dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e24501344c0d41cb8d626c5c0455e5c7)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:30.383131 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cfd65-d0fd-4796-859e-93f2a482a9dd admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:30.436608 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:30.463678 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e58cfd65-d0fd-4796-859e-93f2a482a9dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e24501344c0d41cb8d626c5c0455e5c7', 'request_id': 'req-e58cfd65-d0fd-4796-859e-93f2a482a9dd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:30.474169 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e58cfd65-d0fd-4796-859e-93f2a482a9dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e24501344c0d41cb8d626c5c0455e5c7', 'request_id': 'req-e58cfd65-d0fd-4796-859e-93f2a482a9dd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:30.482470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e58cfd65-d0fd-4796-859e-93f2a482a9dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e24501344c0d41cb8d626c5c0455e5c7', 'request_id': 'req-e58cfd65-d0fd-4796-859e-93f2a482a9dd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:30.497133 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e58cfd65-d0fd-4796-859e-93f2a482a9dd admin admin] The token cache is being invalidate because project e24501344c0d41cb8d626c5c0455e5c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:30.498019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e58cfd65-d0fd-4796-859e-93f2a482a9dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:30.498675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e58cfd65-d0fd-4796-859e-93f2a482a9dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:30.500320 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1207/2422] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:30 2022] DELETE /identity/v3/projects/e24501344c0d41cb8d626c5c0455e5c7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:30.504521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce554c-f439-4c40-b5f9-766db503d036 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:30.515792 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce554c-f439-4c40-b5f9-766db503d036 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:30.525599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:30.591228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd91b47-8088-4fda-8261-b3cfa329a256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:30.592124 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd91b47-8088-4fda-8261-b3cfa329a256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:30.592408 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd91b47-8088-4fda-8261-b3cfa329a256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:30.595757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd91b47-8088-4fda-8261-b3cfa329a256 admin admin] PATH_INFO: `/v3/users/a3c41d406eb547a2b3053fccf2440c30` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:30.595757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd91b47-8088-4fda-8261-b3cfa329a256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c41d406eb547a2b3053fccf2440c30)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:30.596193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd91b47-8088-4fda-8261-b3cfa329a256 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:30.645744 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3cd91b47-8088-4fda-8261-b3cfa329a256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c41d406eb547a2b3053fccf2440c30'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:30.646419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3cd91b47-8088-4fda-8261-b3cfa329a256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c41d406eb547a2b3053fccf2440c30'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:30.658726 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3cd91b47-8088-4fda-8261-b3cfa329a256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c41d406eb547a2b3053fccf2440c30'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:30.665604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3cd91b47-8088-4fda-8261-b3cfa329a256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c41d406eb547a2b3053fccf2440c30'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:30.666310 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3cd91b47-8088-4fda-8261-b3cfa329a256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c41d406eb547a2b3053fccf2440c30'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:30.680048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1216/2423] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:30 2022] DELETE /identity/v3/users/a3c41d406eb547a2b3053fccf2440c30 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:29:30.961370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cfd65-d0fd-4796-859e-93f2a482a9dd admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:30.963758 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e58cfd65-d0fd-4796-859e-93f2a482a9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:31.002853 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cfd65-d0fd-4796-859e-93f2a482a9dd admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:31.089152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce9b12-8218-4434-a4b0-a0ca266c7a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:31.090461 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce9b12-8218-4434-a4b0-a0ca266c7a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:31.090849 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce9b12-8218-4434-a4b0-a0ca266c7a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:31.091813 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce9b12-8218-4434-a4b0-a0ca266c7a73 admin admin] PATH_INFO: `/v3/projects/6f33ba5ce8e84c8dbadb6abd880fe498` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:31.093373 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce9b12-8218-4434-a4b0-a0ca266c7a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f33ba5ce8e84c8dbadb6abd880fe498)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:31.095309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce9b12-8218-4434-a4b0-a0ca266c7a73 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:31.154664 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1fce9b12-8218-4434-a4b0-a0ca266c7a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f33ba5ce8e84c8dbadb6abd880fe498', 'request_id': 'req-1fce9b12-8218-4434-a4b0-a0ca266c7a73'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:31.160836 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1fce9b12-8218-4434-a4b0-a0ca266c7a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f33ba5ce8e84c8dbadb6abd880fe498', 'request_id': 'req-1fce9b12-8218-4434-a4b0-a0ca266c7a73'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:31.167364 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1fce9b12-8218-4434-a4b0-a0ca266c7a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f33ba5ce8e84c8dbadb6abd880fe498', 'request_id': 'req-1fce9b12-8218-4434-a4b0-a0ca266c7a73'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:31.182408 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1fce9b12-8218-4434-a4b0-a0ca266c7a73 admin admin] The token cache is being invalidate because project 6f33ba5ce8e84c8dbadb6abd880fe498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:31.182694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1fce9b12-8218-4434-a4b0-a0ca266c7a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:31.183476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1fce9b12-8218-4434-a4b0-a0ca266c7a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:31.188649 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1208/2424] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:30 2022] DELETE /identity/v3/projects/6f33ba5ce8e84c8dbadb6abd880fe498 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:31.191750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be13866-8792-4ac3-830c-c8ec06922e7c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:31.191750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be13866-8792-4ac3-830c-c8ec06922e7c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:31.191750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be13866-8792-4ac3-830c-c8ec06922e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:31.213729 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-5be13866-8792-4ac3-830c-c8ec06922e7c None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:31.223928 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5be13866-8792-4ac3-830c-c8ec06922e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:31.351622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1217/2425] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:31.352882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897b128-65b7-4ec8-8b69-89b5bf626ef4 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:31.353183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897b128-65b7-4ec8-8b69-89b5bf626ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:31.353526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897b128-65b7-4ec8-8b69-89b5bf626ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:31.389684 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5897b128-65b7-4ec8-8b69-89b5bf626ef4 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:31.391016 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5897b128-65b7-4ec8-8b69-89b5bf626ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:31.399326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1209/2426] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:31.404364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be13866-8792-4ac3-830c-c8ec06922e7c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:31.416575 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be13866-8792-4ac3-830c-c8ec06922e7c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:31.423572 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c671a4-e2c6-4a53-a4de-ea2f8324432c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:31.424248 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c671a4-e2c6-4a53-a4de-ea2f8324432c admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:31.425053 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c671a4-e2c6-4a53-a4de-ea2f8324432c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:31.425374 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c671a4-e2c6-4a53-a4de-ea2f8324432c admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:31.426126 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c671a4-e2c6-4a53-a4de-ea2f8324432c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:29:31.426440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c671a4-e2c6-4a53-a4de-ea2f8324432c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:31.428067 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c671a4-e2c6-4a53-a4de-ea2f8324432c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:31.441306 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1218/2427] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:29:31.445215 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897b128-65b7-4ec8-8b69-89b5bf626ef4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:31.455955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897b128-65b7-4ec8-8b69-89b5bf626ef4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:31.460734 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d775d18-7ee3-4512-a380-eed02963e10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:31.461543 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d775d18-7ee3-4512-a380-eed02963e10d admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:31.461887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d775d18-7ee3-4512-a380-eed02963e10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:31.462227 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d775d18-7ee3-4512-a380-eed02963e10d admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:31.462987 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d775d18-7ee3-4512-a380-eed02963e10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:31.464939 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d775d18-7ee3-4512-a380-eed02963e10d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:31.491584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1210/2428] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:31 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:31.495717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c671a4-e2c6-4a53-a4de-ea2f8324432c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:31.506840 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c671a4-e2c6-4a53-a4de-ea2f8324432c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:31.518694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bd41b-a1ef-4588-a84c-018348a262d6 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:31.519088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bd41b-a1ef-4588-a84c-018348a262d6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:31.519622 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bd41b-a1ef-4588-a84c-018348a262d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:31.521213 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:31.537878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-3a7bd41b-a1ef-4588-a84c-018348a262d6 None None] MFA Rules not processed for user `1fc73723cc744362941270f74946b3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:31.539089 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3a7bd41b-a1ef-4588-a84c-018348a262d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:31.551456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:31.580598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70edb23-af9d-4321-9023-bf01a89d35ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:31.581520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70edb23-af9d-4321-9023-bf01a89d35ce admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:31.581887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70edb23-af9d-4321-9023-bf01a89d35ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:31.582269 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70edb23-af9d-4321-9023-bf01a89d35ce admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:31.583049 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70edb23-af9d-4321-9023-bf01a89d35ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:31.584986 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70edb23-af9d-4321-9023-bf01a89d35ce admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:31.627776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1219/2429] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:31 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:31.634730 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70edb23-af9d-4321-9023-bf01a89d35ce admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:31.640663 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1211/2430] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:31.652115 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70edb23-af9d-4321-9023-bf01a89d35ce admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:31.659563 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d127503-2010-4193-a209-206d73d6bc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:31.660240 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d127503-2010-4193-a209-206d73d6bc9b admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:31.660520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d127503-2010-4193-a209-206d73d6bc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:31.660790 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d127503-2010-4193-a209-206d73d6bc9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:31.661981 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d127503-2010-4193-a209-206d73d6bc9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:31.663954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d127503-2010-4193-a209-206d73d6bc9b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:31.675271 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1220/2431] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:31.678939 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bd41b-a1ef-4588-a84c-018348a262d6 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:31.690801 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bd41b-a1ef-4588-a84c-018348a262d6 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:31.696365 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf32676-559c-4189-9385-4b0ccadd70ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:31.697030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf32676-559c-4189-9385-4b0ccadd70ce admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:31.697556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf32676-559c-4189-9385-4b0ccadd70ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:31.697767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf32676-559c-4189-9385-4b0ccadd70ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:31.698498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf32676-559c-4189-9385-4b0ccadd70ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:31.701028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf32676-559c-4189-9385-4b0ccadd70ce admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:31.715617 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1212/2432] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:29:31.717370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d127503-2010-4193-a209-206d73d6bc9b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:31.729775 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d127503-2010-4193-a209-206d73d6bc9b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:31.735603 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fb985-b451-4189-b2ee-fb31605dd39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:31.736543 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fb985-b451-4189-b2ee-fb31605dd39c admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:31.736841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fb985-b451-4189-b2ee-fb31605dd39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:31.737093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fb985-b451-4189-b2ee-fb31605dd39c admin admin] PATH_INFO: `/v3/projects/08889ac9586a418886cb39ac0b21e907/users/9c99d24b6b0a41e4bd02fa007a2114a1/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:31.756005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fb985-b451-4189-b2ee-fb31605dd39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08889ac9586a418886cb39ac0b21e907, user_id=9c99d24b6b0a41e4bd02fa007a2114a1, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:31.758742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fb985-b451-4189-b2ee-fb31605dd39c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:31.772978 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1221/2433] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:31 2022] PUT /identity/v3/projects/08889ac9586a418886cb39ac0b21e907/users/9c99d24b6b0a41e4bd02fa007a2114a1/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:31.783126 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a33ab-26fd-4144-a750-54f6a385cc82 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:31.783426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a33ab-26fd-4144-a750-54f6a385cc82 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:31.783738 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a33ab-26fd-4144-a750-54f6a385cc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:31.812409 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-da4a33ab-26fd-4144-a750-54f6a385cc82 None None] MFA Rules not processed for user `9c99d24b6b0a41e4bd02fa007a2114a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:31.813838 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-da4a33ab-26fd-4144-a750-54f6a385cc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:31.879768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1213/2434] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:31.891462 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fb985-b451-4189-b2ee-fb31605dd39c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:31.893197 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-083fb985-b451-4189-b2ee-fb31605dd39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:31.951446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fb985-b451-4189-b2ee-fb31605dd39c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:31.955242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae2356-5f4d-4dab-8838-3d88c6a0d654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:31.955895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae2356-5f4d-4dab-8838-3d88c6a0d654 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:31.956173 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae2356-5f4d-4dab-8838-3d88c6a0d654 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:31.956444 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae2356-5f4d-4dab-8838-3d88c6a0d654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:31.965003 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae2356-5f4d-4dab-8838-3d88c6a0d654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:31.966502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae2356-5f4d-4dab-8838-3d88c6a0d654 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:31.975598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1222/2435] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:32.497670 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb622f3-8630-467c-8921-cc66fc537a9f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:32.498202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb622f3-8630-467c-8921-cc66fc537a9f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:32.498292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb622f3-8630-467c-8921-cc66fc537a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:32.518160 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8bb622f3-8630-467c-8921-cc66fc537a9f None None] MFA Rules not processed for user `b331ba96a2b94bd5bd3bffd43c18a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:32.519460 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8bb622f3-8630-467c-8921-cc66fc537a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:32.586100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1214/2436] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:34.691614 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae2356-5f4d-4dab-8838-3d88c6a0d654 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:34.835360 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae2356-5f4d-4dab-8838-3d88c6a0d654 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:34.869761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bf7af-ef17-483f-85dd-2fe6a496876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:34.875780 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bf7af-ef17-483f-85dd-2fe6a496876d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:34.877166 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bf7af-ef17-483f-85dd-2fe6a496876d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:34.877615 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bf7af-ef17-483f-85dd-2fe6a496876d admin admin] PATH_INFO: `/v3/users/9c99d24b6b0a41e4bd02fa007a2114a1` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:34.883129 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1bf7af-ef17-483f-85dd-2fe6a496876d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c99d24b6b0a41e4bd02fa007a2114a1)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:34.886223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1bf7af-ef17-483f-85dd-2fe6a496876d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:34.921707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:34.979234 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2f1bf7af-ef17-483f-85dd-2fe6a496876d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c99d24b6b0a41e4bd02fa007a2114a1'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:34.979897 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2f1bf7af-ef17-483f-85dd-2fe6a496876d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c99d24b6b0a41e4bd02fa007a2114a1'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:34.997181 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2f1bf7af-ef17-483f-85dd-2fe6a496876d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c99d24b6b0a41e4bd02fa007a2114a1'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:35.006306 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2f1bf7af-ef17-483f-85dd-2fe6a496876d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c99d24b6b0a41e4bd02fa007a2114a1'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:35.007233 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2f1bf7af-ef17-483f-85dd-2fe6a496876d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c99d24b6b0a41e4bd02fa007a2114a1'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:35.029409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1223/2437] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:34 2022] DELETE /identity/v3/users/9c99d24b6b0a41e4bd02fa007a2114a1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:35.032640 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247674b9-758b-413c-9501-3c6c832c8c61 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:35.033107 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247674b9-758b-413c-9501-3c6c832c8c61 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:35.033212 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247674b9-758b-413c-9501-3c6c832c8c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:35.054655 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-247674b9-758b-413c-9501-3c6c832c8c61 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:35.056351 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-247674b9-758b-413c-9501-3c6c832c8c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:35.113794 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:35.138552 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1215/2438] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:35.165845 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bf7af-ef17-483f-85dd-2fe6a496876d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:35.167593 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2f1bf7af-ef17-483f-85dd-2fe6a496876d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:35.316969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bf7af-ef17-483f-85dd-2fe6a496876d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:35.323672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a15c83-e7ab-41a6-a542-19074238dac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:35.324785 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a15c83-e7ab-41a6-a542-19074238dac3 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:35.327040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a15c83-e7ab-41a6-a542-19074238dac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:35.327398 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a15c83-e7ab-41a6-a542-19074238dac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:35.352354 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a15c83-e7ab-41a6-a542-19074238dac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:35.357383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a15c83-e7ab-41a6-a542-19074238dac3 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:35.375682 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1224/2439] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:36.666432 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247674b9-758b-413c-9501-3c6c832c8c61 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:36.668024 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-247674b9-758b-413c-9501-3c6c832c8c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:36.693665 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247674b9-758b-413c-9501-3c6c832c8c61 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:36.710328 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe7d41-603e-410e-8f99-f35b84b51c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:36.713125 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe7d41-603e-410e-8f99-f35b84b51c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:36.714371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe7d41-603e-410e-8f99-f35b84b51c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:36.717048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe7d41-603e-410e-8f99-f35b84b51c57 admin admin] PATH_INFO: `/v3/projects/08889ac9586a418886cb39ac0b21e907` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:36.720147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe7d41-603e-410e-8f99-f35b84b51c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08889ac9586a418886cb39ac0b21e907)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:36.723135 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe7d41-603e-410e-8f99-f35b84b51c57 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:36.745831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f902678-bb8e-4e4b-b33d-bae49689b216 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:36.746385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f902678-bb8e-4e4b-b33d-bae49689b216 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:36.746628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f902678-bb8e-4e4b-b33d-bae49689b216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:36.778759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7f902678-bb8e-4e4b-b33d-bae49689b216 None None] MFA Rules not processed for user `b42aeef31b0449af97c3da52e27307fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:36.780036 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7f902678-bb8e-4e4b-b33d-bae49689b216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:36.814979 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-09fe7d41-603e-410e-8f99-f35b84b51c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08889ac9586a418886cb39ac0b21e907', 'request_id': 'req-09fe7d41-603e-410e-8f99-f35b84b51c57'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:36.824421 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-09fe7d41-603e-410e-8f99-f35b84b51c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08889ac9586a418886cb39ac0b21e907', 'request_id': 'req-09fe7d41-603e-410e-8f99-f35b84b51c57'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:36.833201 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-09fe7d41-603e-410e-8f99-f35b84b51c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08889ac9586a418886cb39ac0b21e907', 'request_id': 'req-09fe7d41-603e-410e-8f99-f35b84b51c57'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:36.851643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-09fe7d41-603e-410e-8f99-f35b84b51c57 admin admin] The token cache is being invalidate because project 08889ac9586a418886cb39ac0b21e907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:36.852211 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-09fe7d41-603e-410e-8f99-f35b84b51c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:36.853174 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-09fe7d41-603e-410e-8f99-f35b84b51c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:36.855062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1216/2440] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:36 2022] DELETE /identity/v3/projects/08889ac9586a418886cb39ac0b21e907 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:36.860462 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1225/2441] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:36.862034 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c911093-7f65-42a1-ae92-d35761cbb55b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:36.862535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c911093-7f65-42a1-ae92-d35761cbb55b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:36.863527 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c911093-7f65-42a1-ae92-d35761cbb55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:36.902201 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8c911093-7f65-42a1-ae92-d35761cbb55b None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:36.904014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8c911093-7f65-42a1-ae92-d35761cbb55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:37.001347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1217/2442] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:37.004548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb5614-e8ed-496b-8825-331dd02a82fa None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:37.004843 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb5614-e8ed-496b-8825-331dd02a82fa None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:37.005126 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb5614-e8ed-496b-8825-331dd02a82fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:37.028822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1beb5614-e8ed-496b-8825-331dd02a82fa None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:37.030520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1beb5614-e8ed-496b-8825-331dd02a82fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:37.038657 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1226/2443] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:37.042860 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c911093-7f65-42a1-ae92-d35761cbb55b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:37.056518 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c911093-7f65-42a1-ae92-d35761cbb55b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:37.060933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a69999-afb2-4d18-a725-7c7156c94852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:37.062264 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a69999-afb2-4d18-a725-7c7156c94852 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:37.062550 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a69999-afb2-4d18-a725-7c7156c94852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:37.062831 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a69999-afb2-4d18-a725-7c7156c94852 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:37.063597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a69999-afb2-4d18-a725-7c7156c94852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:29:37.063940 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a69999-afb2-4d18-a725-7c7156c94852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:37.065659 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a69999-afb2-4d18-a725-7c7156c94852 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:37.079073 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1218/2444] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:29:37.083942 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb5614-e8ed-496b-8825-331dd02a82fa None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:37.094298 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb5614-e8ed-496b-8825-331dd02a82fa None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:37.099375 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3a9e1-f659-4405-8253-8fa42c844e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:37.100314 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3a9e1-f659-4405-8253-8fa42c844e9a admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:37.100700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3a9e1-f659-4405-8253-8fa42c844e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:37.101077 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3a9e1-f659-4405-8253-8fa42c844e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:37.101903 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3a9e1-f659-4405-8253-8fa42c844e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:37.105854 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3a9e1-f659-4405-8253-8fa42c844e9a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:37.144797 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1227/2445] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:37 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:37.148905 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a69999-afb2-4d18-a725-7c7156c94852 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:37.160044 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a69999-afb2-4d18-a725-7c7156c94852 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:37.236916 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6aee7-fcb4-454b-88c3-24fd1c656fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:37.237327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6aee7-fcb4-454b-88c3-24fd1c656fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:37.237869 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6aee7-fcb4-454b-88c3-24fd1c656fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:37.238329 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6aee7-fcb4-454b-88c3-24fd1c656fd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:37.239556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6aee7-fcb4-454b-88c3-24fd1c656fd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:37.241717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6aee7-fcb4-454b-88c3-24fd1c656fd6 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:37.249104 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:37.273377 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1219/2446] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:37 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:37.274781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3a9e1-f659-4405-8253-8fa42c844e9a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:37.295357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3a9e1-f659-4405-8253-8fa42c844e9a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:37.302330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1ae46-37d1-4235-9948-c9ae0019f7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:37.303150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1ae46-37d1-4235-9948-c9ae0019f7aa admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:37.303354 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1ae46-37d1-4235-9948-c9ae0019f7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:37.303490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1ae46-37d1-4235-9948-c9ae0019f7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:37.304227 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1ae46-37d1-4235-9948-c9ae0019f7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:37.305932 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1ae46-37d1-4235-9948-c9ae0019f7aa admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:37.318869 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1228/2447] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:37.322673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6aee7-fcb4-454b-88c3-24fd1c656fd6 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:37.333781 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6aee7-fcb4-454b-88c3-24fd1c656fd6 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:37.339143 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b7123-792a-4b15-8b8d-f5065c63a717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:37.339808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b7123-792a-4b15-8b8d-f5065c63a717 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:37.340091 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b7123-792a-4b15-8b8d-f5065c63a717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:37.340371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b7123-792a-4b15-8b8d-f5065c63a717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:37.341688 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b7123-792a-4b15-8b8d-f5065c63a717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:37.343295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b7123-792a-4b15-8b8d-f5065c63a717 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:37.356571 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1220/2448] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:29:37.357773 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1ae46-37d1-4235-9948-c9ae0019f7aa admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:37.363510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:37.370018 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1ae46-37d1-4235-9948-c9ae0019f7aa admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:37.383186 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2894cf1-cebe-4beb-ac51-3d9101e2b674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:37.384174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2894cf1-cebe-4beb-ac51-3d9101e2b674 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:37.384538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2894cf1-cebe-4beb-ac51-3d9101e2b674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:37.384817 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2894cf1-cebe-4beb-ac51-3d9101e2b674 admin admin] PATH_INFO: `/v3/projects/c872d30db1654c7e9231a1a4425de766/users/416e13f8466e475cb30b541d2a11789a/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:37.401025 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2894cf1-cebe-4beb-ac51-3d9101e2b674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c872d30db1654c7e9231a1a4425de766, user_id=416e13f8466e475cb30b541d2a11789a, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:37.404320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2894cf1-cebe-4beb-ac51-3d9101e2b674 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:37.418524 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1229/2449] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:37 2022] PUT /identity/v3/projects/c872d30db1654c7e9231a1a4425de766/users/416e13f8466e475cb30b541d2a11789a/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:37.429922 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d380d-5f59-4244-9ba4-4bd71e36874c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:37.430173 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d380d-5f59-4244-9ba4-4bd71e36874c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:37.430555 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d380d-5f59-4244-9ba4-4bd71e36874c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:37.458673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e94d380d-5f59-4244-9ba4-4bd71e36874c None None] MFA Rules not processed for user `416e13f8466e475cb30b541d2a11789a`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:37.459953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e94d380d-5f59-4244-9ba4-4bd71e36874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:37.531583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1221/2450] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:37.543000 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2894cf1-cebe-4beb-ac51-3d9101e2b674 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:37.545216 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d2894cf1-cebe-4beb-ac51-3d9101e2b674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:37.607030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2894cf1-cebe-4beb-ac51-3d9101e2b674 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:37.610850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6b458-d048-4d41-a735-82c25967fbf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:37.611640 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6b458-d048-4d41-a735-82c25967fbf8 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:37.611879 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6b458-d048-4d41-a735-82c25967fbf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:37.612148 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6b458-d048-4d41-a735-82c25967fbf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:37.620976 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6b458-d048-4d41-a735-82c25967fbf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:37.623118 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6b458-d048-4d41-a735-82c25967fbf8 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:37.632930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1230/2451] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:37.659476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d380d-5f59-4244-9ba4-4bd71e36874c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:37.733469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d380d-5f59-4244-9ba4-4bd71e36874c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:37.738185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85682fcf-4c9f-41e8-b659-537ea81cf1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:37.738957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85682fcf-4c9f-41e8-b659-537ea81cf1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:37.739271 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85682fcf-4c9f-41e8-b659-537ea81cf1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:37.739550 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85682fcf-4c9f-41e8-b659-537ea81cf1f5 admin admin] PATH_INFO: `/v3/users/416e13f8466e475cb30b541d2a11789a` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:37.740776 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85682fcf-4c9f-41e8-b659-537ea81cf1f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=416e13f8466e475cb30b541d2a11789a)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:37.742739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85682fcf-4c9f-41e8-b659-537ea81cf1f5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:37.803311 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-85682fcf-4c9f-41e8-b659-537ea81cf1f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '416e13f8466e475cb30b541d2a11789a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:37.805012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-85682fcf-4c9f-41e8-b659-537ea81cf1f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '416e13f8466e475cb30b541d2a11789a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:37.817299 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-85682fcf-4c9f-41e8-b659-537ea81cf1f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '416e13f8466e475cb30b541d2a11789a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:37.818033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-85682fcf-4c9f-41e8-b659-537ea81cf1f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '416e13f8466e475cb30b541d2a11789a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:37.827645 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-85682fcf-4c9f-41e8-b659-537ea81cf1f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '416e13f8466e475cb30b541d2a11789a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:37.834241 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:37.854419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1222/2452] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:37 2022] DELETE /identity/v3/users/416e13f8466e475cb30b541d2a11789a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:37.857548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f7b47-7bc1-439a-a37b-d88e62cc264f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:37.858897 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f7b47-7bc1-439a-a37b-d88e62cc264f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:37.859387 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f7b47-7bc1-439a-a37b-d88e62cc264f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:37.891361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8c2f7b47-7bc1-439a-a37b-d88e62cc264f None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:37.892768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8c2f7b47-7bc1-439a-a37b-d88e62cc264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:38.012210 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1231/2453] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:38.022714 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85682fcf-4c9f-41e8-b659-537ea81cf1f5 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:38.024346 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-85682fcf-4c9f-41e8-b659-537ea81cf1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:38.091641 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85682fcf-4c9f-41e8-b659-537ea81cf1f5 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:38.096102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5c594-470c-4488-91ef-29886e1ee35e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:38.096917 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5c594-470c-4488-91ef-29886e1ee35e service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:38.097242 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5c594-470c-4488-91ef-29886e1ee35e service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:38.097607 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5c594-470c-4488-91ef-29886e1ee35e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:38.109872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5c594-470c-4488-91ef-29886e1ee35e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:38.111318 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5c594-470c-4488-91ef-29886e1ee35e service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:38.123051 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1223/2454] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:38.492790 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f7b47-7bc1-439a-a37b-d88e62cc264f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:38.494847 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8c2f7b47-7bc1-439a-a37b-d88e62cc264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:38.523663 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f7b47-7bc1-439a-a37b-d88e62cc264f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:38.535009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90645e2b-51db-409a-9318-8f2609aaad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:38.536261 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90645e2b-51db-409a-9318-8f2609aaad0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:38.538006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90645e2b-51db-409a-9318-8f2609aaad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:38.538714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90645e2b-51db-409a-9318-8f2609aaad0c admin admin] PATH_INFO: `/v3/projects/c872d30db1654c7e9231a1a4425de766` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:38.545669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90645e2b-51db-409a-9318-8f2609aaad0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c872d30db1654c7e9231a1a4425de766)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:38.547842 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90645e2b-51db-409a-9318-8f2609aaad0c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:38.614101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-90645e2b-51db-409a-9318-8f2609aaad0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c872d30db1654c7e9231a1a4425de766', 'request_id': 'req-90645e2b-51db-409a-9318-8f2609aaad0c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:38.622762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-90645e2b-51db-409a-9318-8f2609aaad0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c872d30db1654c7e9231a1a4425de766', 'request_id': 'req-90645e2b-51db-409a-9318-8f2609aaad0c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:38.628981 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-90645e2b-51db-409a-9318-8f2609aaad0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c872d30db1654c7e9231a1a4425de766', 'request_id': 'req-90645e2b-51db-409a-9318-8f2609aaad0c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:38.642798 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-90645e2b-51db-409a-9318-8f2609aaad0c admin admin] The token cache is being invalidate because project c872d30db1654c7e9231a1a4425de766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:38.643091 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-90645e2b-51db-409a-9318-8f2609aaad0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:38.643769 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-90645e2b-51db-409a-9318-8f2609aaad0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:38.645413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1232/2455] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:38 2022] DELETE /identity/v3/projects/c872d30db1654c7e9231a1a4425de766 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:29:38.650310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84093be4-fab0-43a1-97d9-4472d0654c1e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:38.650670 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84093be4-fab0-43a1-97d9-4472d0654c1e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:38.650952 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84093be4-fab0-43a1-97d9-4472d0654c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:38.671133 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-84093be4-fab0-43a1-97d9-4472d0654c1e None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:38.672263 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-84093be4-fab0-43a1-97d9-4472d0654c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:38.733170 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1224/2456] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:38.740802 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba571fe-05fb-4e04-af7a-64a117134d30 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:38.741114 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba571fe-05fb-4e04-af7a-64a117134d30 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:38.741426 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba571fe-05fb-4e04-af7a-64a117134d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:38.748642 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:38.760814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6ba571fe-05fb-4e04-af7a-64a117134d30 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:38.762473 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6ba571fe-05fb-4e04-af7a-64a117134d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:38.770948 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1233/2457] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:38.775216 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84093be4-fab0-43a1-97d9-4472d0654c1e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:38.785419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84093be4-fab0-43a1-97d9-4472d0654c1e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:38.789969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d655a-652f-42cd-93a9-c0389fb24e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:38.790619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d655a-652f-42cd-93a9-c0389fb24e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:38.790902 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d655a-652f-42cd-93a9-c0389fb24e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:38.791176 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d655a-652f-42cd-93a9-c0389fb24e6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:38.791893 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d655a-652f-42cd-93a9-c0389fb24e6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:29:38.792195 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d655a-652f-42cd-93a9-c0389fb24e6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:38.793859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d655a-652f-42cd-93a9-c0389fb24e6a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:38.805880 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1225/2458] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:29:38.810513 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba571fe-05fb-4e04-af7a-64a117134d30 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:38.819586 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba571fe-05fb-4e04-af7a-64a117134d30 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:38.824291 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b640eca-59c7-4cc0-8030-36aa40c43472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:38.824873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b640eca-59c7-4cc0-8030-36aa40c43472 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:38.825929 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b640eca-59c7-4cc0-8030-36aa40c43472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:38.826201 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b640eca-59c7-4cc0-8030-36aa40c43472 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:38.826891 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b640eca-59c7-4cc0-8030-36aa40c43472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:38.828776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b640eca-59c7-4cc0-8030-36aa40c43472 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:38.853157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1234/2459] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:38 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:38.857204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d655a-652f-42cd-93a9-c0389fb24e6a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:38.867147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d655a-652f-42cd-93a9-c0389fb24e6a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:38.926101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b640eca-59c7-4cc0-8030-36aa40c43472 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:38.928640 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3b640eca-59c7-4cc0-8030-36aa40c43472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:38.930058 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb381a58-5bae-42b9-994e-ec7f73161973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:38.930733 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb381a58-5bae-42b9-994e-ec7f73161973 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:38.931014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb381a58-5bae-42b9-994e-ec7f73161973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:38.931290 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb381a58-5bae-42b9-994e-ec7f73161973 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:38.931978 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb381a58-5bae-42b9-994e-ec7f73161973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:38.934081 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb381a58-5bae-42b9-994e-ec7f73161973 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:38.942009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b640eca-59c7-4cc0-8030-36aa40c43472 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:38.955192 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2426b-a4a5-436d-b5d9-f2216eddd0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:38.957754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2426b-a4a5-436d-b5d9-f2216eddd0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:38.958284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2426b-a4a5-436d-b5d9-f2216eddd0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:38.959222 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2426b-a4a5-436d-b5d9-f2216eddd0bd admin admin] PATH_INFO: `/v3/users/21551f859117440cb405117ad806455c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:38.962559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1226/2460] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:38 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:29:38.963222 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2426b-a4a5-436d-b5d9-f2216eddd0bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=21551f859117440cb405117ad806455c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:38.965423 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2426b-a4a5-436d-b5d9-f2216eddd0bd admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:38.967003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb381a58-5bae-42b9-994e-ec7f73161973 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:38.981354 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb381a58-5bae-42b9-994e-ec7f73161973 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:38.987498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85230f-c2b9-46c5-a68e-5d4a617f2917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:38.988549 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85230f-c2b9-46c5-a68e-5d4a617f2917 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:38.988905 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85230f-c2b9-46c5-a68e-5d4a617f2917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:38.989273 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85230f-c2b9-46c5-a68e-5d4a617f2917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:38.990077 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85230f-c2b9-46c5-a68e-5d4a617f2917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:38.991753 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85230f-c2b9-46c5-a68e-5d4a617f2917 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:38.998420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:39.005630 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1227/2461] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:39.009554 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85230f-c2b9-46c5-a68e-5d4a617f2917 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:39.022037 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85230f-c2b9-46c5-a68e-5d4a617f2917 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:39.030339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341d535-d7ce-4ff4-843e-aa6581954192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:39.030963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341d535-d7ce-4ff4-843e-aa6581954192 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:39.031369 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341d535-d7ce-4ff4-843e-aa6581954192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:39.031751 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341d535-d7ce-4ff4-843e-aa6581954192 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:39.032585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341d535-d7ce-4ff4-843e-aa6581954192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:39.034356 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341d535-d7ce-4ff4-843e-aa6581954192 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:39.040720 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3bc2426b-a4a5-436d-b5d9-f2216eddd0bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21551f859117440cb405117ad806455c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:39.041954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3bc2426b-a4a5-436d-b5d9-f2216eddd0bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21551f859117440cb405117ad806455c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:39.050769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1228/2462] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:39.051765 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341d535-d7ce-4ff4-843e-aa6581954192 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:39.053690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c341d535-d7ce-4ff4-843e-aa6581954192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:39.058164 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3bc2426b-a4a5-436d-b5d9-f2216eddd0bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21551f859117440cb405117ad806455c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:39.075028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341d535-d7ce-4ff4-843e-aa6581954192 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:39.075972 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3bc2426b-a4a5-436d-b5d9-f2216eddd0bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21551f859117440cb405117ad806455c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:39.077817 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3bc2426b-a4a5-436d-b5d9-f2216eddd0bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21551f859117440cb405117ad806455c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:39.081677 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e8771-1486-4065-9987-61c513fd56ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:39.082845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e8771-1486-4065-9987-61c513fd56ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:39.083255 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e8771-1486-4065-9987-61c513fd56ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:39.083638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e8771-1486-4065-9987-61c513fd56ee admin admin] PATH_INFO: `/v3/projects/74cad66d558c4ecc8a769cc8e9ce7659/users/d4702e2017cb43dba13cdaefa2b19b5e/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:39.099732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1235/2463] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:38 2022] DELETE /identity/v3/users/21551f859117440cb405117ad806455c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:39.101233 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fbc32-dbc5-47a8-bffd-ecd818ec928c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:39.103834 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fbc32-dbc5-47a8-bffd-ecd818ec928c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:39.104116 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fbc32-dbc5-47a8-bffd-ecd818ec928c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:39.109100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e8771-1486-4065-9987-61c513fd56ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=74cad66d558c4ecc8a769cc8e9ce7659, user_id=d4702e2017cb43dba13cdaefa2b19b5e, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:39.111916 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e8771-1486-4065-9987-61c513fd56ee admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:39.124184 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-265fbc32-dbc5-47a8-bffd-ecd818ec928c None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:39.125679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-265fbc32-dbc5-47a8-bffd-ecd818ec928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:39.127103 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1229/2464] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:39 2022] PUT /identity/v3/projects/74cad66d558c4ecc8a769cc8e9ce7659/users/d4702e2017cb43dba13cdaefa2b19b5e/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:39.133389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4415ae4-356a-4bb6-bafb-5ffe67e17b95 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:39.133676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4415ae4-356a-4bb6-bafb-5ffe67e17b95 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:39.133950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4415ae4-356a-4bb6-bafb-5ffe67e17b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:39.155483 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a4415ae4-356a-4bb6-bafb-5ffe67e17b95 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:39.156685 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a4415ae4-356a-4bb6-bafb-5ffe67e17b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:39.189403 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1236/2465] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:29:39.198963 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fbc32-dbc5-47a8-bffd-ecd818ec928c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:39.201276 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-265fbc32-dbc5-47a8-bffd-ecd818ec928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:39.217567 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1230/2466] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:39.226620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4415ae4-356a-4bb6-bafb-5ffe67e17b95 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:39.227967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a4415ae4-356a-4bb6-bafb-5ffe67e17b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:39.255797 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:39.260742 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fbc32-dbc5-47a8-bffd-ecd818ec928c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:39.266964 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175683ef-0524-4b47-9d51-84d5cdc95dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:39.267629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175683ef-0524-4b47-9d51-84d5cdc95dec service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:39.268131 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175683ef-0524-4b47-9d51-84d5cdc95dec service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:39.268717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175683ef-0524-4b47-9d51-84d5cdc95dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:39.278233 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175683ef-0524-4b47-9d51-84d5cdc95dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:39.279653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175683ef-0524-4b47-9d51-84d5cdc95dec service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:39.288771 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4415ae4-356a-4bb6-bafb-5ffe67e17b95 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:39.289380 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1237/2467] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:39.292623 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7f161-4927-41f0-9012-3b414ba82904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:39.293295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7f161-4927-41f0-9012-3b414ba82904 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:39.293591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7f161-4927-41f0-9012-3b414ba82904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:39.293900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7f161-4927-41f0-9012-3b414ba82904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:39.303268 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7f161-4927-41f0-9012-3b414ba82904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:39.304747 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7f161-4927-41f0-9012-3b414ba82904 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:39.314869 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1231/2468] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:29:39.720589 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175683ef-0524-4b47-9d51-84d5cdc95dec service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:39.722181 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-175683ef-0524-4b47-9d51-84d5cdc95dec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:39.746189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175683ef-0524-4b47-9d51-84d5cdc95dec service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:39.751724 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab47a24-f417-4b4a-aab4-e3ade01ba2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:39.752639 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab47a24-f417-4b4a-aab4-e3ade01ba2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:39.752927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab47a24-f417-4b4a-aab4-e3ade01ba2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:39.763498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab47a24-f417-4b4a-aab4-e3ade01ba2da admin admin] PATH_INFO: `/v3/projects/e809a7b4269248e3ba63ca17a3a7fe3e` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:39.764915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab47a24-f417-4b4a-aab4-e3ade01ba2da admin admin] RBAC: Authorizing `identity:delete_project(project_id=e809a7b4269248e3ba63ca17a3a7fe3e)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:39.766999 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab47a24-f417-4b4a-aab4-e3ade01ba2da admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:39.837336 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9ab47a24-f417-4b4a-aab4-e3ade01ba2da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e809a7b4269248e3ba63ca17a3a7fe3e', 'request_id': 'req-9ab47a24-f417-4b4a-aab4-e3ade01ba2da'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:39.860859 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9ab47a24-f417-4b4a-aab4-e3ade01ba2da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e809a7b4269248e3ba63ca17a3a7fe3e', 'request_id': 'req-9ab47a24-f417-4b4a-aab4-e3ade01ba2da'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:39.868739 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9ab47a24-f417-4b4a-aab4-e3ade01ba2da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e809a7b4269248e3ba63ca17a3a7fe3e', 'request_id': 'req-9ab47a24-f417-4b4a-aab4-e3ade01ba2da'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:39.885439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9ab47a24-f417-4b4a-aab4-e3ade01ba2da admin admin] The token cache is being invalidate because project e809a7b4269248e3ba63ca17a3a7fe3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:39.885759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9ab47a24-f417-4b4a-aab4-e3ade01ba2da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:39.886441 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9ab47a24-f417-4b4a-aab4-e3ade01ba2da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:39.893938 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1238/2469] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:39 2022] DELETE /identity/v3/projects/e809a7b4269248e3ba63ca17a3a7fe3e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:44.602377 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ff883-cb9c-490b-a9d5-9d313925423c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:44.602871 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ff883-cb9c-490b-a9d5-9d313925423c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:44.602967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ff883-cb9c-490b-a9d5-9d313925423c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:44.632415 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-dd2ff883-cb9c-490b-a9d5-9d313925423c None None] MFA Rules not processed for user `d4702e2017cb43dba13cdaefa2b19b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:44.633722 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-dd2ff883-cb9c-490b-a9d5-9d313925423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:44.690231 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:44.702862 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1232/2470] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:44.707354 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab47a24-f417-4b4a-aab4-e3ade01ba2da admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:44.708806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9ab47a24-f417-4b4a-aab4-e3ade01ba2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:44.776266 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab47a24-f417-4b4a-aab4-e3ade01ba2da admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:44.781164 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d57dd-1c6f-4f2a-8297-426e7e3970f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:44.781856 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d57dd-1c6f-4f2a-8297-426e7e3970f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:44.782138 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d57dd-1c6f-4f2a-8297-426e7e3970f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:44.782415 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d57dd-1c6f-4f2a-8297-426e7e3970f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:44.783117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d57dd-1c6f-4f2a-8297-426e7e3970f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:44.785017 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d57dd-1c6f-4f2a-8297-426e7e3970f4 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:44.816462 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1239/2471] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:29:44 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:44.820395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ff883-cb9c-490b-a9d5-9d313925423c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:44.834921 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ff883-cb9c-490b-a9d5-9d313925423c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:44.916130 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b620cb0-a891-490f-98de-900318b3994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:44.916835 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b620cb0-a891-490f-98de-900318b3994b admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:44.917120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b620cb0-a891-490f-98de-900318b3994b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:44.917431 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b620cb0-a891-490f-98de-900318b3994b admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:44.918144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b620cb0-a891-490f-98de-900318b3994b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:44.920689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b620cb0-a891-490f-98de-900318b3994b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:44.945290 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1233/2472] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:29:44 2022] POST /identity/v3/users => generated 298 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:29:44.949306 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d57dd-1c6f-4f2a-8297-426e7e3970f4 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:44.964764 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d57dd-1c6f-4f2a-8297-426e7e3970f4 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:44.969562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649fcce-53b5-4d64-bd74-276b8eb4107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:44.970292 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649fcce-53b5-4d64-bd74-276b8eb4107e admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:44.970577 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649fcce-53b5-4d64-bd74-276b8eb4107e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:44.970855 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649fcce-53b5-4d64-bd74-276b8eb4107e admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:44.971590 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649fcce-53b5-4d64-bd74-276b8eb4107e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:44.973382 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649fcce-53b5-4d64-bd74-276b8eb4107e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:44.992993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1240/2473] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:44.993292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b620cb0-a891-490f-98de-900318b3994b admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:45.010800 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b620cb0-a891-490f-98de-900318b3994b admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:45.015856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d4735-ff78-41db-a4ba-976ec50f2c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:45.016760 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4735-ff78-41db-a4ba-976ec50f2c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:45.017039 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4735-ff78-41db-a4ba-976ec50f2c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:45.017362 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4735-ff78-41db-a4ba-976ec50f2c07 admin admin] PATH_INFO: `/v3/projects/d14d1ebbfc8e49859609914286ef04fc/users/5992c752e2034d408dc2e553d78afb80/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:45.035726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d4735-ff78-41db-a4ba-976ec50f2c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14d1ebbfc8e49859609914286ef04fc, user_id=5992c752e2034d408dc2e553d78afb80, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:45.038488 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d4735-ff78-41db-a4ba-976ec50f2c07 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:45.061289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1234/2474] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:44 2022] PUT /identity/v3/projects/d14d1ebbfc8e49859609914286ef04fc/users/5992c752e2034d408dc2e553d78afb80/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:45.064198 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649fcce-53b5-4d64-bd74-276b8eb4107e admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:45.086467 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649fcce-53b5-4d64-bd74-276b8eb4107e admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:45.196733 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:45.218041 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2c22a-1fc3-439b-965e-cb41dfa511e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:45.218707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2c22a-1fc3-439b-965e-cb41dfa511e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:45.218993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2c22a-1fc3-439b-965e-cb41dfa511e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:45.219272 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2c22a-1fc3-439b-965e-cb41dfa511e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:45.220230 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2c22a-1fc3-439b-965e-cb41dfa511e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:45.221834 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2c22a-1fc3-439b-965e-cb41dfa511e3 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:45.237326 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1241/2475] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:29:45.238631 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d4735-ff78-41db-a4ba-976ec50f2c07 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:45.255091 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d4735-ff78-41db-a4ba-976ec50f2c07 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:45.266349 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef1760-4621-4c25-8355-2e0c59fdeac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:45.267347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef1760-4621-4c25-8355-2e0c59fdeac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:45.267705 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef1760-4621-4c25-8355-2e0c59fdeac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:45.268062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef1760-4621-4c25-8355-2e0c59fdeac9 admin admin] PATH_INFO: `/v3/projects/d14d1ebbfc8e49859609914286ef04fc/users/5992c752e2034d408dc2e553d78afb80/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:45.270314 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef1760-4621-4c25-8355-2e0c59fdeac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14d1ebbfc8e49859609914286ef04fc, user_id=5992c752e2034d408dc2e553d78afb80, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:45.277841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef1760-4621-4c25-8355-2e0c59fdeac9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:45.312378 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1235/2476] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:29:45 2022] PUT /identity/v3/projects/d14d1ebbfc8e49859609914286ef04fc/users/5992c752e2034d408dc2e553d78afb80/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:51.911161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376572b8-606b-409c-8cc4-1bb544227497 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:51.912976 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376572b8-606b-409c-8cc4-1bb544227497 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:51.913530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376572b8-606b-409c-8cc4-1bb544227497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:51.951955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-376572b8-606b-409c-8cc4-1bb544227497 None None] MFA Rules not processed for user `5992c752e2034d408dc2e553d78afb80`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:51.953328 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-376572b8-606b-409c-8cc4-1bb544227497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:52.048836 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1242/2477] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:29:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:52.059824 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef1760-4621-4c25-8355-2e0c59fdeac9 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:52.063700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a1ef1760-4621-4c25-8355-2e0c59fdeac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:52.285779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef1760-4621-4c25-8355-2e0c59fdeac9 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:52.289987 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21c484-fd2b-4fa7-8e60-5545365f241b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5602d0a51329412ab6e908e7787531a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:52.290639 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21c484-fd2b-4fa7-8e60-5545365f241b service glance] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:52.290915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21c484-fd2b-4fa7-8e60-5545365f241b service glance] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:52.291212 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21c484-fd2b-4fa7-8e60-5545365f241b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:52.352840 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21c484-fd2b-4fa7-8e60-5545365f241b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:52.354518 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21c484-fd2b-4fa7-8e60-5545365f241b service glance] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:52.360208 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:52.367942 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1236/2478] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:52.522217 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b951d50-189c-47d1-8f6c-380cb17aee18 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:52.522503 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b951d50-189c-47d1-8f6c-380cb17aee18 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:52.522782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b951d50-189c-47d1-8f6c-380cb17aee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:52.541799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6b951d50-189c-47d1-8f6c-380cb17aee18 None None] MFA Rules not processed for user `54189575a60a4d9dbaabb78d44e9c31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:52.543009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6b951d50-189c-47d1-8f6c-380cb17aee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:52.612606 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1243/2479] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Jul 12 18:29:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:52.661068 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21c484-fd2b-4fa7-8e60-5545365f241b service glance] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:52.662589 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1a21c484-fd2b-4fa7-8e60-5545365f241b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:52.742940 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21c484-fd2b-4fa7-8e60-5545365f241b service glance] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:52.749192 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c24ec-0739-484f-9444-13fe979014f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ade969d7aa3d49c08782a68ec5997382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:52.750000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c24ec-0739-484f-9444-13fe979014f2 service swift] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:52.750356 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c24ec-0739-484f-9444-13fe979014f2 service swift] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:52.750700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c24ec-0739-484f-9444-13fe979014f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:52.759578 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c24ec-0739-484f-9444-13fe979014f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:52.761161 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c24ec-0739-484f-9444-13fe979014f2 service swift] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:52.770936 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1237/2480] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Jul 12 18:29:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:29:58.052137 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc26ba-bace-41d1-a134-d3a132a9b454 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:58.052693 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc26ba-bace-41d1-a134-d3a132a9b454 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:58.052693 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc26ba-bace-41d1-a134-d3a132a9b454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:58.077740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-10fc26ba-bace-41d1-a134-d3a132a9b454 None None] MFA Rules not processed for user `54189575a60a4d9dbaabb78d44e9c31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:58.078891 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-10fc26ba-bace-41d1-a134-d3a132a9b454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:58.097113 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1244/2481] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Jul 12 18:29:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:58.121092 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c24ec-0739-484f-9444-13fe979014f2 service swift] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:58.140023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c24ec-0739-484f-9444-13fe979014f2 service swift] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:58.148661 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f6238-811b-44f4-a101-e4b4adddf6d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ade969d7aa3d49c08782a68ec5997382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:58.152187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f6238-811b-44f4-a101-e4b4adddf6d3 service swift] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:58.152482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f6238-811b-44f4-a101-e4b4adddf6d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:58.153357 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f6238-811b-44f4-a101-e4b4adddf6d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:58.163893 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f6238-811b-44f4-a101-e4b4adddf6d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:58.165523 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f6238-811b-44f4-a101-e4b4adddf6d3 service swift] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:58.175728 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1238/2482] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Jul 12 18:29:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:30:03.265246 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438e3cf-bb26-468c-8f6c-2e6471822e3a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:03.265836 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438e3cf-bb26-468c-8f6c-2e6471822e3a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:03.265975 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438e3cf-bb26-468c-8f6c-2e6471822e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:03.288396 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-5438e3cf-bb26-468c-8f6c-2e6471822e3a None None] MFA Rules not processed for user `d4702e2017cb43dba13cdaefa2b19b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:30:03.290356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5438e3cf-bb26-468c-8f6c-2e6471822e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:03.299185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1245/2483] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:30:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:30:05.539970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7cede-47b7-4d9a-b67d-c90addaa4bb2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:05.540573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7cede-47b7-4d9a-b67d-c90addaa4bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:05.540794 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7cede-47b7-4d9a-b67d-c90addaa4bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:05.561186 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-83a7cede-47b7-4d9a-b67d-c90addaa4bb2 None None] MFA Rules not processed for user `54189575a60a4d9dbaabb78d44e9c31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:30:05.562611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-83a7cede-47b7-4d9a-b67d-c90addaa4bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:05.572924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1239/2484] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Jul 12 18:30:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:30:05.591080 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438e3cf-bb26-468c-8f6c-2e6471822e3a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:05.611322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438e3cf-bb26-468c-8f6c-2e6471822e3a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:05.620114 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0157878-1d20-4689-9cda-77c4eb379351 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ade969d7aa3d49c08782a68ec5997382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:05.622146 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0157878-1d20-4689-9cda-77c4eb379351 service swift] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:05.622596 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0157878-1d20-4689-9cda-77c4eb379351 service swift] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:05.623047 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0157878-1d20-4689-9cda-77c4eb379351 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:05.634174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0157878-1d20-4689-9cda-77c4eb379351 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:05.636096 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0157878-1d20-4689-9cda-77c4eb379351 service swift] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:05.646895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1246/2485] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Jul 12 18:30:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:30:15.236074 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb2b88-34eb-426d-a385-a202a04609e6 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:15.237075 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb2b88-34eb-426d-a385-a202a04609e6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:15.237575 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb2b88-34eb-426d-a385-a202a04609e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:15.262671 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e5cb2b88-34eb-426d-a385-a202a04609e6 None None] MFA Rules not processed for user `54189575a60a4d9dbaabb78d44e9c31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:30:15.264064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e5cb2b88-34eb-426d-a385-a202a04609e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:15.272608 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1240/2486] 10.222.0.57 () {58 vars in 967 bytes} [Tue Jul 12 18:30:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:30:15.289124 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0157878-1d20-4689-9cda-77c4eb379351 service swift] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:15.294926 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=79 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:15.302552 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0157878-1d20-4689-9cda-77c4eb379351 service swift] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:15.309728 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7cc8a-60df-47e7-8de1-e3be43272d2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ade969d7aa3d49c08782a68ec5997382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:15.310585 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7cc8a-60df-47e7-8de1-e3be43272d2e service swift] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:15.310869 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7cc8a-60df-47e7-8de1-e3be43272d2e service swift] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:15.311121 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7cc8a-60df-47e7-8de1-e3be43272d2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:15.320905 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7cc8a-60df-47e7-8de1-e3be43272d2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:15.322719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7cc8a-60df-47e7-8de1-e3be43272d2e service swift] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:15.332193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1247/2487] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Jul 12 18:30:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:30:17.410370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb2b88-34eb-426d-a385-a202a04609e6 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:17.411839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e5cb2b88-34eb-426d-a385-a202a04609e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:17.476901 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb2b88-34eb-426d-a385-a202a04609e6 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:17.481530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedfbfa-9976-4b31-8887-c1ab2980219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:17.482399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedfbfa-9976-4b31-8887-c1ab2980219f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:17.482681 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedfbfa-9976-4b31-8887-c1ab2980219f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:17.482957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedfbfa-9976-4b31-8887-c1ab2980219f admin admin] PATH_INFO: `/v3/users/b331ba96a2b94bd5bd3bffd43c18a427` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:17.484153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedfbfa-9976-4b31-8887-c1ab2980219f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b331ba96a2b94bd5bd3bffd43c18a427)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:17.486102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedfbfa-9976-4b31-8887-c1ab2980219f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:17.531124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-cbedfbfa-9976-4b31-8887-c1ab2980219f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b331ba96a2b94bd5bd3bffd43c18a427'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:17.531778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-cbedfbfa-9976-4b31-8887-c1ab2980219f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b331ba96a2b94bd5bd3bffd43c18a427'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:17.538898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-cbedfbfa-9976-4b31-8887-c1ab2980219f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b331ba96a2b94bd5bd3bffd43c18a427'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:17.539514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-cbedfbfa-9976-4b31-8887-c1ab2980219f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b331ba96a2b94bd5bd3bffd43c18a427'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:17.546773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-cbedfbfa-9976-4b31-8887-c1ab2980219f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b331ba96a2b94bd5bd3bffd43c18a427'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:17.550283 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:17.568266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1241/2488] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:30:17 2022] DELETE /identity/v3/users/b331ba96a2b94bd5bd3bffd43c18a427 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:30:17.742233 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7cc8a-60df-47e7-8de1-e3be43272d2e service swift] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:17.754581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7cc8a-60df-47e7-8de1-e3be43272d2e service swift] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:17.810735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b784081-34ff-4eee-868a-9f395e2d7486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:17.811592 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b784081-34ff-4eee-868a-9f395e2d7486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:17.811871 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b784081-34ff-4eee-868a-9f395e2d7486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:17.812145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b784081-34ff-4eee-868a-9f395e2d7486 admin admin] PATH_INFO: `/v3/projects/d3ce2df2a9bd48ba97e70fc9ac52e5d8` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:17.813357 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b784081-34ff-4eee-868a-9f395e2d7486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ce2df2a9bd48ba97e70fc9ac52e5d8)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:17.815275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b784081-34ff-4eee-868a-9f395e2d7486 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:17.860765 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8b784081-34ff-4eee-868a-9f395e2d7486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ce2df2a9bd48ba97e70fc9ac52e5d8', 'request_id': 'req-8b784081-34ff-4eee-868a-9f395e2d7486'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:17.867905 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8b784081-34ff-4eee-868a-9f395e2d7486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ce2df2a9bd48ba97e70fc9ac52e5d8', 'request_id': 'req-8b784081-34ff-4eee-868a-9f395e2d7486'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:17.874110 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8b784081-34ff-4eee-868a-9f395e2d7486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ce2df2a9bd48ba97e70fc9ac52e5d8', 'request_id': 'req-8b784081-34ff-4eee-868a-9f395e2d7486'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:17.884678 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8b784081-34ff-4eee-868a-9f395e2d7486 admin admin] The token cache is being invalidate because project d3ce2df2a9bd48ba97e70fc9ac52e5d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:30:17.884967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8b784081-34ff-4eee-868a-9f395e2d7486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:17.885612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8b784081-34ff-4eee-868a-9f395e2d7486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:17.887157 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1248/2489] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:30:17 2022] DELETE /identity/v3/projects/d3ce2df2a9bd48ba97e70fc9ac52e5d8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:30:17.892014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7fef2-c9f5-4ad9-9e6f-769db4a66f80 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:17.892302 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7fef2-c9f5-4ad9-9e6f-769db4a66f80 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:17.892575 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7fef2-c9f5-4ad9-9e6f-769db4a66f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:17.910423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d6e7fef2-c9f5-4ad9-9e6f-769db4a66f80 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:30:17.911636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d6e7fef2-c9f5-4ad9-9e6f-769db4a66f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:17.969501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1242/2490] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:30:17.977345 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8baa5-fcff-4415-9c07-e30787942f96 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:17.977640 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8baa5-fcff-4415-9c07-e30787942f96 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:17.977918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8baa5-fcff-4415-9c07-e30787942f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:17.996275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d6b8baa5-fcff-4415-9c07-e30787942f96 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:30:17.997515 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d6b8baa5-fcff-4415-9c07-e30787942f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:18.005375 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1249/2491] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:30:18.009452 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7fef2-c9f5-4ad9-9e6f-769db4a66f80 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:18.019041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7fef2-c9f5-4ad9-9e6f-769db4a66f80 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:18.023639 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74e1fc-048d-4c17-9400-c2aaf98e8ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:18.024309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74e1fc-048d-4c17-9400-c2aaf98e8ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:18.024588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74e1fc-048d-4c17-9400-c2aaf98e8ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:18.024861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74e1fc-048d-4c17-9400-c2aaf98e8ee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:18.025642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74e1fc-048d-4c17-9400-c2aaf98e8ee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:30:18.025945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74e1fc-048d-4c17-9400-c2aaf98e8ee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:18.028030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74e1fc-048d-4c17-9400-c2aaf98e8ee3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:18.039492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1243/2492] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:30:18.044268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8baa5-fcff-4415-9c07-e30787942f96 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:18.053418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8baa5-fcff-4415-9c07-e30787942f96 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:18.058140 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ec721-7d61-450a-9974-e0ba03ee6835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:18.058777 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec721-7d61-450a-9974-e0ba03ee6835 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:18.059056 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec721-7d61-450a-9974-e0ba03ee6835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:18.059327 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec721-7d61-450a-9974-e0ba03ee6835 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:18.060013 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ec721-7d61-450a-9974-e0ba03ee6835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:18.061974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ec721-7d61-450a-9974-e0ba03ee6835 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:18.087277 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1250/2493] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:30:18 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:30:18.091733 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74e1fc-048d-4c17-9400-c2aaf98e8ee3 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:18.101662 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74e1fc-048d-4c17-9400-c2aaf98e8ee3 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:18.158007 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c6262-3c5c-4fba-bee8-a43b8a330f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:18.158666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c6262-3c5c-4fba-bee8-a43b8a330f59 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:18.158948 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c6262-3c5c-4fba-bee8-a43b8a330f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:18.159220 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c6262-3c5c-4fba-bee8-a43b8a330f59 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:18.159889 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c6262-3c5c-4fba-bee8-a43b8a330f59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:18.161825 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c6262-3c5c-4fba-bee8-a43b8a330f59 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:18.182025 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1244/2494] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:30:18 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:30:18.186128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ec721-7d61-450a-9974-e0ba03ee6835 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:18.196649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ec721-7d61-450a-9974-e0ba03ee6835 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:18.201658 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b907b6-1200-4527-92e5-1133f378d247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:18.202313 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b907b6-1200-4527-92e5-1133f378d247 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:18.202627 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b907b6-1200-4527-92e5-1133f378d247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:18.202906 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b907b6-1200-4527-92e5-1133f378d247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:18.203632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b907b6-1200-4527-92e5-1133f378d247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:18.205241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b907b6-1200-4527-92e5-1133f378d247 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:18.215552 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1251/2495] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:30:18.219738 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c6262-3c5c-4fba-bee8-a43b8a330f59 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:18.229639 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c6262-3c5c-4fba-bee8-a43b8a330f59 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:18.234205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8cec1-da2e-4bb4-8dee-a574b6ab62bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:18.234844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8cec1-da2e-4bb4-8dee-a574b6ab62bf admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:18.235127 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8cec1-da2e-4bb4-8dee-a574b6ab62bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:18.235399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8cec1-da2e-4bb4-8dee-a574b6ab62bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:18.236109 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8cec1-da2e-4bb4-8dee-a574b6ab62bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:18.237722 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8cec1-da2e-4bb4-8dee-a574b6ab62bf admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:18.247939 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1245/2496] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:30:18.251703 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b907b6-1200-4527-92e5-1133f378d247 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:18.261760 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b907b6-1200-4527-92e5-1133f378d247 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:18.266372 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec846f42-ab11-46af-bbc4-424504a1baf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:18.267237 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec846f42-ab11-46af-bbc4-424504a1baf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:18.267521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec846f42-ab11-46af-bbc4-424504a1baf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:18.267799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec846f42-ab11-46af-bbc4-424504a1baf2 admin admin] PATH_INFO: `/v3/projects/86a4008b409d4233ba4b201c3015b430/users/ce54dd4d202e4dcda10d99481ba981a5/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:18.282171 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec846f42-ab11-46af-bbc4-424504a1baf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86a4008b409d4233ba4b201c3015b430, user_id=ce54dd4d202e4dcda10d99481ba981a5, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:18.284830 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec846f42-ab11-46af-bbc4-424504a1baf2 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:18.297801 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1252/2497] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:30:18 2022] PUT /identity/v3/projects/86a4008b409d4233ba4b201c3015b430/users/ce54dd4d202e4dcda10d99481ba981a5/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:30:18.308063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06b5a5-577d-44f6-8779-70459b1253b6 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:18.308914 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06b5a5-577d-44f6-8779-70459b1253b6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:18.309190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06b5a5-577d-44f6-8779-70459b1253b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:18.334682 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5c06b5a5-577d-44f6-8779-70459b1253b6 None None] MFA Rules not processed for user `ce54dd4d202e4dcda10d99481ba981a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:30:18.335881 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5c06b5a5-577d-44f6-8779-70459b1253b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:18.373671 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:18.403191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1246/2498] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:30:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:30:18.414613 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec846f42-ab11-46af-bbc4-424504a1baf2 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:18.416347 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ec846f42-ab11-46af-bbc4-424504a1baf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:18.438104 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:18.482626 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec846f42-ab11-46af-bbc4-424504a1baf2 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:18.486439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad83f61-dfdb-4e51-a96c-19f144e7b25e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:18.487101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad83f61-dfdb-4e51-a96c-19f144e7b25e service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:18.487385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad83f61-dfdb-4e51-a96c-19f144e7b25e service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:18.487663 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad83f61-dfdb-4e51-a96c-19f144e7b25e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:18.506009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad83f61-dfdb-4e51-a96c-19f144e7b25e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:18.506892 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad83f61-dfdb-4e51-a96c-19f144e7b25e service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:18.517008 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1253/2499] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:30:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:30:28.399662 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=10 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:28.513045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=19 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:29.435068 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06b5a5-577d-44f6-8779-70459b1253b6 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:29.436634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5c06b5a5-577d-44f6-8779-70459b1253b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:29.492954 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06b5a5-577d-44f6-8779-70459b1253b6 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:29.496473 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac7a68-c356-4684-afb1-89a73a69f7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:29.497111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac7a68-c356-4684-afb1-89a73a69f7af service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:29.497440 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac7a68-c356-4684-afb1-89a73a69f7af service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:29.497720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac7a68-c356-4684-afb1-89a73a69f7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:29.499976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-35ac7a68-c356-4684-afb1-89a73a69f7af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:29.562772 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac7a68-c356-4684-afb1-89a73a69f7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:29.564205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac7a68-c356-4684-afb1-89a73a69f7af service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:29.574644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1247/2500] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:30:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:30:39.569679 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=50 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:49.235086 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b82bda-18ab-4caa-a703-6a7c928496fc None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:49.235629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b82bda-18ab-4caa-a703-6a7c928496fc None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:49.235629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b82bda-18ab-4caa-a703-6a7c928496fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:49.253081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-29b82bda-18ab-4caa-a703-6a7c928496fc None None] MFA Rules not processed for user `1fc73723cc744362941270f74946b3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:30:49.254315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-29b82bda-18ab-4caa-a703-6a7c928496fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:49.309077 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1254/2501] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:30:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:30:49.510391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac7a68-c356-4684-afb1-89a73a69f7af service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:49.586612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac7a68-c356-4684-afb1-89a73a69f7af service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:49.591185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595f1ff-ba27-4101-af97-b3bf51536258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:49.592056 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595f1ff-ba27-4101-af97-b3bf51536258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:49.592336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595f1ff-ba27-4101-af97-b3bf51536258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:49.592632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595f1ff-ba27-4101-af97-b3bf51536258 admin admin] PATH_INFO: `/v3/users/ce54dd4d202e4dcda10d99481ba981a5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:49.593981 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595f1ff-ba27-4101-af97-b3bf51536258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce54dd4d202e4dcda10d99481ba981a5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:49.595905 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595f1ff-ba27-4101-af97-b3bf51536258 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:49.645263 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1595f1ff-ba27-4101-af97-b3bf51536258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce54dd4d202e4dcda10d99481ba981a5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:49.646023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1595f1ff-ba27-4101-af97-b3bf51536258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce54dd4d202e4dcda10d99481ba981a5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:49.654327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1595f1ff-ba27-4101-af97-b3bf51536258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce54dd4d202e4dcda10d99481ba981a5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:49.655496 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1595f1ff-ba27-4101-af97-b3bf51536258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce54dd4d202e4dcda10d99481ba981a5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:49.663672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1595f1ff-ba27-4101-af97-b3bf51536258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce54dd4d202e4dcda10d99481ba981a5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:49.681276 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1248/2502] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:30:49 2022] DELETE /identity/v3/users/ce54dd4d202e4dcda10d99481ba981a5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:30:49.686354 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba95db7-5b99-46f0-9649-0afce61b1eca None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:49.686670 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba95db7-5b99-46f0-9649-0afce61b1eca None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:49.686955 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba95db7-5b99-46f0-9649-0afce61b1eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:49.709904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-4ba95db7-5b99-46f0-9649-0afce61b1eca None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:30:49.711246 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4ba95db7-5b99-46f0-9649-0afce61b1eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:49.774961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1255/2503] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:30:49.784583 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595f1ff-ba27-4101-af97-b3bf51536258 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:49.786089 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1595f1ff-ba27-4101-af97-b3bf51536258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:49.847774 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595f1ff-ba27-4101-af97-b3bf51536258 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:49.851533 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafeb50-f39b-424d-9eb1-46e9cd561d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:49.852179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafeb50-f39b-424d-9eb1-46e9cd561d2a service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:49.852465 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafeb50-f39b-424d-9eb1-46e9cd561d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:49.852747 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafeb50-f39b-424d-9eb1-46e9cd561d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:49.862343 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafeb50-f39b-424d-9eb1-46e9cd561d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:49.863765 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafeb50-f39b-424d-9eb1-46e9cd561d2a service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:49.873479 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1249/2504] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:30:50.214055 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba95db7-5b99-46f0-9649-0afce61b1eca None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:50.215554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4ba95db7-5b99-46f0-9649-0afce61b1eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:50.229986 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba95db7-5b99-46f0-9649-0afce61b1eca None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:50.234740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578161b-cefa-45a5-96c1-4f37811014bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:50.236024 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578161b-cefa-45a5-96c1-4f37811014bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:50.236024 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578161b-cefa-45a5-96c1-4f37811014bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:50.236677 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578161b-cefa-45a5-96c1-4f37811014bd admin admin] PATH_INFO: `/v3/projects/86a4008b409d4233ba4b201c3015b430` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:50.238398 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578161b-cefa-45a5-96c1-4f37811014bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=86a4008b409d4233ba4b201c3015b430)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:50.242105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578161b-cefa-45a5-96c1-4f37811014bd admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:50.300889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f578161b-cefa-45a5-96c1-4f37811014bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86a4008b409d4233ba4b201c3015b430', 'request_id': 'req-f578161b-cefa-45a5-96c1-4f37811014bd'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:50.310064 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f578161b-cefa-45a5-96c1-4f37811014bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86a4008b409d4233ba4b201c3015b430', 'request_id': 'req-f578161b-cefa-45a5-96c1-4f37811014bd'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:50.320316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f578161b-cefa-45a5-96c1-4f37811014bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86a4008b409d4233ba4b201c3015b430', 'request_id': 'req-f578161b-cefa-45a5-96c1-4f37811014bd'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:50.334008 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f578161b-cefa-45a5-96c1-4f37811014bd admin admin] The token cache is being invalidate because project 86a4008b409d4233ba4b201c3015b430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:30:50.334368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f578161b-cefa-45a5-96c1-4f37811014bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:50.335081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f578161b-cefa-45a5-96c1-4f37811014bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:50.336683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1256/2505] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:30:50 2022] DELETE /identity/v3/projects/86a4008b409d4233ba4b201c3015b430 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:30:59.869081 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:31:00.330432 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:31:08.613006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a26d3a-ed96-4020-897c-2eb0280f7515 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:31:08.613577 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a26d3a-ed96-4020-897c-2eb0280f7515 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:31:08.613577 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a26d3a-ed96-4020-897c-2eb0280f7515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:31:08.631922 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-07a26d3a-ed96-4020-897c-2eb0280f7515 None None] MFA Rules not processed for user `b42aeef31b0449af97c3da52e27307fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:31:08.633183 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-07a26d3a-ed96-4020-897c-2eb0280f7515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:31:08.692273 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1250/2506] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:31:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:31:18.685472 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=25 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:31:45.933362 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578161b-cefa-45a5-96c1-4f37811014bd admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:31:45.934900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f578161b-cefa-45a5-96c1-4f37811014bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:31:46.019609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578161b-cefa-45a5-96c1-4f37811014bd admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:31:46.024876 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f17f4-407a-45f5-8a26-7486c7ccb2c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206242c775be40c7b96af6de635e2065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:31:46.025640 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f17f4-407a-45f5-8a26-7486c7ccb2c4 service placement] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:31:46.025992 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f17f4-407a-45f5-8a26-7486c7ccb2c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:31:46.026337 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f17f4-407a-45f5-8a26-7486c7ccb2c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:31:46.028136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3f1f17f4-407a-45f5-8a26-7486c7ccb2c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:31:46.040236 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f17f4-407a-45f5-8a26-7486c7ccb2c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:31:46.041890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f17f4-407a-45f5-8a26-7486c7ccb2c4 service placement] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:31:46.052065 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1257/2507] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:31:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:31:50.136964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b7589-0988-4fe1-9332-acfe9400408e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:31:50.138690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b7589-0988-4fe1-9332-acfe9400408e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:31:50.138690 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b7589-0988-4fe1-9332-acfe9400408e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:31:50.156138 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b10b7589-0988-4fe1-9332-acfe9400408e None None] MFA Rules not processed for user `1fc73723cc744362941270f74946b3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:31:50.157385 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b10b7589-0988-4fe1-9332-acfe9400408e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:31:50.212846 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1251/2508] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:31:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:31:56.047578 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=32 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:00.205598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=25 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:12.387394 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f17f4-407a-45f5-8a26-7486c7ccb2c4 service placement] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:12.389029 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3f1f17f4-407a-45f5-8a26-7486c7ccb2c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:12.463810 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f17f4-407a-45f5-8a26-7486c7ccb2c4 service placement] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:12.468497 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591094a-82eb-41ce-afa8-dba268358542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:12.469429 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591094a-82eb-41ce-afa8-dba268358542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:12.469719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591094a-82eb-41ce-afa8-dba268358542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:12.469999 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591094a-82eb-41ce-afa8-dba268358542 admin admin] PATH_INFO: `/v3/users/b42aeef31b0449af97c3da52e27307fa` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:12.471219 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591094a-82eb-41ce-afa8-dba268358542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42aeef31b0449af97c3da52e27307fa)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:12.473362 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591094a-82eb-41ce-afa8-dba268358542 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:12.527640 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2591094a-82eb-41ce-afa8-dba268358542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42aeef31b0449af97c3da52e27307fa'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:12.528245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2591094a-82eb-41ce-afa8-dba268358542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42aeef31b0449af97c3da52e27307fa'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:12.541914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2591094a-82eb-41ce-afa8-dba268358542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42aeef31b0449af97c3da52e27307fa'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:12.548629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2591094a-82eb-41ce-afa8-dba268358542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42aeef31b0449af97c3da52e27307fa'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:12.550211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2591094a-82eb-41ce-afa8-dba268358542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42aeef31b0449af97c3da52e27307fa'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:12.564212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1258/2509] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:32:12 2022] DELETE /identity/v3/users/b42aeef31b0449af97c3da52e27307fa => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:12.759118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b7589-0988-4fe1-9332-acfe9400408e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:12.782050 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b7589-0988-4fe1-9332-acfe9400408e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:12.890853 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c026613-27a7-4a61-91d8-55dcf7cb3dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:12.892030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c026613-27a7-4a61-91d8-55dcf7cb3dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:12.892673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c026613-27a7-4a61-91d8-55dcf7cb3dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:12.892673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c026613-27a7-4a61-91d8-55dcf7cb3dbc admin admin] PATH_INFO: `/v3/projects/5d1a5e9995dc427cb44b3ed259263932` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:12.894180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c026613-27a7-4a61-91d8-55dcf7cb3dbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d1a5e9995dc427cb44b3ed259263932)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:12.896162 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c026613-27a7-4a61-91d8-55dcf7cb3dbc admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:12.981938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0c026613-27a7-4a61-91d8-55dcf7cb3dbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d1a5e9995dc427cb44b3ed259263932', 'request_id': 'req-0c026613-27a7-4a61-91d8-55dcf7cb3dbc'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:12.996659 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0c026613-27a7-4a61-91d8-55dcf7cb3dbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d1a5e9995dc427cb44b3ed259263932', 'request_id': 'req-0c026613-27a7-4a61-91d8-55dcf7cb3dbc'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:13.014038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0c026613-27a7-4a61-91d8-55dcf7cb3dbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d1a5e9995dc427cb44b3ed259263932', 'request_id': 'req-0c026613-27a7-4a61-91d8-55dcf7cb3dbc'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:13.032710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0c026613-27a7-4a61-91d8-55dcf7cb3dbc admin admin] The token cache is being invalidate because project 5d1a5e9995dc427cb44b3ed259263932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:32:13.033148 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0c026613-27a7-4a61-91d8-55dcf7cb3dbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:13.033922 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0c026613-27a7-4a61-91d8-55dcf7cb3dbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:13.036090 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1252/2510] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:32:12 2022] DELETE /identity/v3/projects/5d1a5e9995dc427cb44b3ed259263932 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:13.041089 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db9d0c-6078-4868-ab02-ff972cd5a31b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:13.041410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db9d0c-6078-4868-ab02-ff972cd5a31b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:13.041698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db9d0c-6078-4868-ab02-ff972cd5a31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:13.062643 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-02db9d0c-6078-4868-ab02-ff972cd5a31b None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:13.063902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-02db9d0c-6078-4868-ab02-ff972cd5a31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:13.131133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1259/2511] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:13.138995 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d53083-2a2e-4e39-aa67-7094aff95aa1 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:13.139286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d53083-2a2e-4e39-aa67-7094aff95aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:13.139561 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d53083-2a2e-4e39-aa67-7094aff95aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:13.157518 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d0d53083-2a2e-4e39-aa67-7094aff95aa1 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:13.158773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d0d53083-2a2e-4e39-aa67-7094aff95aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:13.167537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1253/2512] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:13.171866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db9d0c-6078-4868-ab02-ff972cd5a31b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:13.182825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db9d0c-6078-4868-ab02-ff972cd5a31b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:13.187431 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d5539-6f15-480e-806b-c3fe3190bf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:13.188089 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d5539-6f15-480e-806b-c3fe3190bf2b admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:13.188395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d5539-6f15-480e-806b-c3fe3190bf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:13.188672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d5539-6f15-480e-806b-c3fe3190bf2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:13.189439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d5539-6f15-480e-806b-c3fe3190bf2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:32:13.189750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d5539-6f15-480e-806b-c3fe3190bf2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:13.191407 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d5539-6f15-480e-806b-c3fe3190bf2b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:13.203526 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1260/2513] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:32:13.207682 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d53083-2a2e-4e39-aa67-7094aff95aa1 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:13.216983 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d53083-2a2e-4e39-aa67-7094aff95aa1 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:13.221704 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431c72b-bc94-41bc-958f-beb29eaa68be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:13.222353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431c72b-bc94-41bc-958f-beb29eaa68be admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:13.222644 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431c72b-bc94-41bc-958f-beb29eaa68be admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:13.222921 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431c72b-bc94-41bc-958f-beb29eaa68be admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:13.223607 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431c72b-bc94-41bc-958f-beb29eaa68be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:13.226187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431c72b-bc94-41bc-958f-beb29eaa68be admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:13.255609 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1254/2514] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:32:13 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:32:13.257048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d5539-6f15-480e-806b-c3fe3190bf2b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:13.267389 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d5539-6f15-480e-806b-c3fe3190bf2b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:13.271224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:13.328117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665b852-d920-48f0-aff4-944f884482b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:13.328793 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665b852-d920-48f0-aff4-944f884482b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:13.329074 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665b852-d920-48f0-aff4-944f884482b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:13.329387 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665b852-d920-48f0-aff4-944f884482b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:13.330084 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665b852-d920-48f0-aff4-944f884482b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:13.332030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665b852-d920-48f0-aff4-944f884482b7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:13.352705 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1261/2515] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:32:13 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:32:13.356868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431c72b-bc94-41bc-958f-beb29eaa68be admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:13.368051 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431c72b-bc94-41bc-958f-beb29eaa68be admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:13.373705 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15660d9a-a554-4bf7-a1bd-693a511a71ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:13.374503 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15660d9a-a554-4bf7-a1bd-693a511a71ce admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:13.374851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15660d9a-a554-4bf7-a1bd-693a511a71ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:13.385316 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15660d9a-a554-4bf7-a1bd-693a511a71ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:13.386150 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15660d9a-a554-4bf7-a1bd-693a511a71ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:13.388170 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15660d9a-a554-4bf7-a1bd-693a511a71ce admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:13.414802 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1255/2516] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:32:13.418924 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665b852-d920-48f0-aff4-944f884482b7 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:13.436440 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665b852-d920-48f0-aff4-944f884482b7 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:13.443073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01cfd3-164e-4b22-a538-7404888439e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:13.444301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01cfd3-164e-4b22-a538-7404888439e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:13.444803 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01cfd3-164e-4b22-a538-7404888439e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:13.445304 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01cfd3-164e-4b22-a538-7404888439e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:13.446404 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01cfd3-164e-4b22-a538-7404888439e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:13.449443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01cfd3-164e-4b22-a538-7404888439e7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:13.467490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1262/2517] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:13.468877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15660d9a-a554-4bf7-a1bd-693a511a71ce admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:13.483131 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15660d9a-a554-4bf7-a1bd-693a511a71ce admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:13.487820 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c56019-3fad-4b48-91ed-db6d09bbfd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:13.488853 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c56019-3fad-4b48-91ed-db6d09bbfd0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:13.489137 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c56019-3fad-4b48-91ed-db6d09bbfd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:13.489443 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c56019-3fad-4b48-91ed-db6d09bbfd0f admin admin] PATH_INFO: `/v3/projects/0673034e36554471825a5a135a60991d/users/f95e7e055704446ab4f592b6da2adb70/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:13.509928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c56019-3fad-4b48-91ed-db6d09bbfd0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0673034e36554471825a5a135a60991d, user_id=f95e7e055704446ab4f592b6da2adb70, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:13.513599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c56019-3fad-4b48-91ed-db6d09bbfd0f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:13.530023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1256/2518] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:32:13 2022] PUT /identity/v3/projects/0673034e36554471825a5a135a60991d/users/f95e7e055704446ab4f592b6da2adb70/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:32:13.535188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374b78b-39ff-402f-bdfb-163d6604f5e1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:13.536313 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374b78b-39ff-402f-bdfb-163d6604f5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:13.536612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374b78b-39ff-402f-bdfb-163d6604f5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:13.557880 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8374b78b-39ff-402f-bdfb-163d6604f5e1 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:13.559184 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8374b78b-39ff-402f-bdfb-163d6604f5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:13.644172 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1263/2519] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:13.656863 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c56019-3fad-4b48-91ed-db6d09bbfd0f admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:13.658923 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-83c56019-3fad-4b48-91ed-db6d09bbfd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:13.698878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:13.730481 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c56019-3fad-4b48-91ed-db6d09bbfd0f admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:13.734386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db837c-65f6-4b9e-9d2f-0d904a0fb2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:13.735031 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db837c-65f6-4b9e-9d2f-0d904a0fb2da service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:13.735317 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db837c-65f6-4b9e-9d2f-0d904a0fb2da service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:13.735593 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db837c-65f6-4b9e-9d2f-0d904a0fb2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:13.746706 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db837c-65f6-4b9e-9d2f-0d904a0fb2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:13.748166 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db837c-65f6-4b9e-9d2f-0d904a0fb2da service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:13.758803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1257/2520] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:32:17.994469 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f639d-7d6e-4185-8409-a90fa41973d8 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:17.994931 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f639d-7d6e-4185-8409-a90fa41973d8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:17.995039 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f639d-7d6e-4185-8409-a90fa41973d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:18.024723 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-eb2f639d-7d6e-4185-8409-a90fa41973d8 None None] MFA Rules not processed for user `f95e7e055704446ab4f592b6da2adb70`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:18.025989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-eb2f639d-7d6e-4185-8409-a90fa41973d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:18.118944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1264/2521] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:32:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:18.133345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db837c-65f6-4b9e-9d2f-0d904a0fb2da service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:18.134928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-59db837c-65f6-4b9e-9d2f-0d904a0fb2da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:18.255945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db837c-65f6-4b9e-9d2f-0d904a0fb2da service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:18.261661 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332a32e-d2bd-4bf1-aa54-e6a7e80c1bb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:18.262868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332a32e-d2bd-4bf1-aa54-e6a7e80c1bb4 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:18.262868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332a32e-d2bd-4bf1-aa54-e6a7e80c1bb4 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:18.262868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332a32e-d2bd-4bf1-aa54-e6a7e80c1bb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:18.271710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332a32e-d2bd-4bf1-aa54-e6a7e80c1bb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:18.274314 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332a32e-d2bd-4bf1-aa54-e6a7e80c1bb4 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:18.285331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1258/2522] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:32:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:32:19.256105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f1d97-685f-4ee3-98b6-d875243d44e0 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:19.256581 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f1d97-685f-4ee3-98b6-d875243d44e0 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:19.256967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f1d97-685f-4ee3-98b6-d875243d44e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:19.274872 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-fb2f1d97-685f-4ee3-98b6-d875243d44e0 None None] MFA Rules not processed for user `54189575a60a4d9dbaabb78d44e9c31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:19.276080 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-fb2f1d97-685f-4ee3-98b6-d875243d44e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:19.286619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:19.338580 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1265/2523] 10.222.0.57 () {58 vars in 967 bytes} [Tue Jul 12 18:32:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:19.390416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332a32e-d2bd-4bf1-aa54-e6a7e80c1bb4 service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:19.392776 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c332a32e-d2bd-4bf1-aa54-e6a7e80c1bb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:19.497384 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332a32e-d2bd-4bf1-aa54-e6a7e80c1bb4 service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:19.503023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541132a-21a6-4de5-8d14-15b600e300bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ade969d7aa3d49c08782a68ec5997382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:19.503992 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541132a-21a6-4de5-8d14-15b600e300bc service swift] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:19.504491 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541132a-21a6-4de5-8d14-15b600e300bc service swift] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:19.504990 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541132a-21a6-4de5-8d14-15b600e300bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:19.514660 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541132a-21a6-4de5-8d14-15b600e300bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:19.516598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541132a-21a6-4de5-8d14-15b600e300bc service swift] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:19.528134 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1259/2524] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Jul 12 18:32:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:32:19.922973 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69ec2f-1961-45ff-b34c-defe74177c64 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:19.923254 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69ec2f-1961-45ff-b34c-defe74177c64 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:19.923731 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69ec2f-1961-45ff-b34c-defe74177c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:19.943203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-3f69ec2f-1961-45ff-b34c-defe74177c64 None None] MFA Rules not processed for user `f95e7e055704446ab4f592b6da2adb70`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:19.944760 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3f69ec2f-1961-45ff-b34c-defe74177c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:19.952324 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1266/2525] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:32:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:27.912339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541132a-21a6-4de5-8d14-15b600e300bc service swift] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:27.914129 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9541132a-21a6-4de5-8d14-15b600e300bc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:27.927773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541132a-21a6-4de5-8d14-15b600e300bc service swift] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:27.932427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519a7a7-8559-4b6e-8d51-9efc56c57eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:27.933315 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519a7a7-8559-4b6e-8d51-9efc56c57eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:27.933599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519a7a7-8559-4b6e-8d51-9efc56c57eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:27.933868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519a7a7-8559-4b6e-8d51-9efc56c57eac admin admin] PATH_INFO: `/v3/users/d4702e2017cb43dba13cdaefa2b19b5e` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:27.935273 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519a7a7-8559-4b6e-8d51-9efc56c57eac admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4702e2017cb43dba13cdaefa2b19b5e)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:27.937406 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519a7a7-8559-4b6e-8d51-9efc56c57eac admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:27.982119 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:27.988761 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1519a7a7-8559-4b6e-8d51-9efc56c57eac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4702e2017cb43dba13cdaefa2b19b5e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:27.989679 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1519a7a7-8559-4b6e-8d51-9efc56c57eac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4702e2017cb43dba13cdaefa2b19b5e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:27.998198 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1519a7a7-8559-4b6e-8d51-9efc56c57eac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4702e2017cb43dba13cdaefa2b19b5e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:27.998902 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1519a7a7-8559-4b6e-8d51-9efc56c57eac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4702e2017cb43dba13cdaefa2b19b5e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:28.007468 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1519a7a7-8559-4b6e-8d51-9efc56c57eac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4702e2017cb43dba13cdaefa2b19b5e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:28.025920 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1260/2526] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:32:27 2022] DELETE /identity/v3/users/d4702e2017cb43dba13cdaefa2b19b5e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:28.213757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69ec2f-1961-45ff-b34c-defe74177c64 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:28.225761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69ec2f-1961-45ff-b34c-defe74177c64 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:28.288190 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee51845-31d6-40b4-9c1c-ba156f1da777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:28.289055 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee51845-31d6-40b4-9c1c-ba156f1da777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:28.289373 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee51845-31d6-40b4-9c1c-ba156f1da777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:28.289653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee51845-31d6-40b4-9c1c-ba156f1da777 admin admin] PATH_INFO: `/v3/projects/74cad66d558c4ecc8a769cc8e9ce7659` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:28.290844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee51845-31d6-40b4-9c1c-ba156f1da777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74cad66d558c4ecc8a769cc8e9ce7659)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:28.292781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee51845-31d6-40b4-9c1c-ba156f1da777 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:28.355132 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6ee51845-31d6-40b4-9c1c-ba156f1da777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74cad66d558c4ecc8a769cc8e9ce7659', 'request_id': 'req-6ee51845-31d6-40b4-9c1c-ba156f1da777'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:28.363480 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6ee51845-31d6-40b4-9c1c-ba156f1da777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74cad66d558c4ecc8a769cc8e9ce7659', 'request_id': 'req-6ee51845-31d6-40b4-9c1c-ba156f1da777'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:28.369939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6ee51845-31d6-40b4-9c1c-ba156f1da777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74cad66d558c4ecc8a769cc8e9ce7659', 'request_id': 'req-6ee51845-31d6-40b4-9c1c-ba156f1da777'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:28.382638 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6ee51845-31d6-40b4-9c1c-ba156f1da777 admin admin] The token cache is being invalidate because project 74cad66d558c4ecc8a769cc8e9ce7659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:32:28.382954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6ee51845-31d6-40b4-9c1c-ba156f1da777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:28.383733 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6ee51845-31d6-40b4-9c1c-ba156f1da777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:28.385612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1267/2527] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:32:28 2022] DELETE /identity/v3/projects/74cad66d558c4ecc8a769cc8e9ce7659 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:28.390053 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519a7a7-8559-4b6e-8d51-9efc56c57eac admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:28.392164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1519a7a7-8559-4b6e-8d51-9efc56c57eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:28.406179 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519a7a7-8559-4b6e-8d51-9efc56c57eac admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:28.464689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7b656-1213-4cac-8aba-e5bc29e9d3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:28.465614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7b656-1213-4cac-8aba-e5bc29e9d3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:28.465896 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7b656-1213-4cac-8aba-e5bc29e9d3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:28.466171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7b656-1213-4cac-8aba-e5bc29e9d3ff admin admin] PATH_INFO: `/v3/users/5992c752e2034d408dc2e553d78afb80` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:28.467376 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7b656-1213-4cac-8aba-e5bc29e9d3ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=5992c752e2034d408dc2e553d78afb80)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:28.469339 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7b656-1213-4cac-8aba-e5bc29e9d3ff admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:28.518478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-9ca7b656-1213-4cac-8aba-e5bc29e9d3ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5992c752e2034d408dc2e553d78afb80'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:28.519362 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-9ca7b656-1213-4cac-8aba-e5bc29e9d3ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5992c752e2034d408dc2e553d78afb80'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:28.526264 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-9ca7b656-1213-4cac-8aba-e5bc29e9d3ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5992c752e2034d408dc2e553d78afb80'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:28.526865 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-9ca7b656-1213-4cac-8aba-e5bc29e9d3ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5992c752e2034d408dc2e553d78afb80'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:28.533859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-9ca7b656-1213-4cac-8aba-e5bc29e9d3ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5992c752e2034d408dc2e553d78afb80'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:28.551203 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1261/2528] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:32:28 2022] DELETE /identity/v3/users/5992c752e2034d408dc2e553d78afb80 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:28.720206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee51845-31d6-40b4-9c1c-ba156f1da777 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:28.721683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6ee51845-31d6-40b4-9c1c-ba156f1da777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:28.736948 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee51845-31d6-40b4-9c1c-ba156f1da777 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:28.778926 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:28.795026 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abbebc-f264-4158-a7e8-42a73721212d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:28.795883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abbebc-f264-4158-a7e8-42a73721212d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:28.796166 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abbebc-f264-4158-a7e8-42a73721212d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:28.796443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abbebc-f264-4158-a7e8-42a73721212d admin admin] PATH_INFO: `/v3/projects/d14d1ebbfc8e49859609914286ef04fc` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:28.797647 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abbebc-f264-4158-a7e8-42a73721212d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d14d1ebbfc8e49859609914286ef04fc)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:28.799553 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abbebc-f264-4158-a7e8-42a73721212d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:28.845282 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-91abbebc-f264-4158-a7e8-42a73721212d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd14d1ebbfc8e49859609914286ef04fc', 'request_id': 'req-91abbebc-f264-4158-a7e8-42a73721212d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:28.851770 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-91abbebc-f264-4158-a7e8-42a73721212d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd14d1ebbfc8e49859609914286ef04fc', 'request_id': 'req-91abbebc-f264-4158-a7e8-42a73721212d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:28.858004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-91abbebc-f264-4158-a7e8-42a73721212d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd14d1ebbfc8e49859609914286ef04fc', 'request_id': 'req-91abbebc-f264-4158-a7e8-42a73721212d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:28.869024 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-91abbebc-f264-4158-a7e8-42a73721212d admin admin] The token cache is being invalidate because project d14d1ebbfc8e49859609914286ef04fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:32:28.869347 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-91abbebc-f264-4158-a7e8-42a73721212d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:28.869982 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-91abbebc-f264-4158-a7e8-42a73721212d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:28.871511 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1268/2529] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:32:28 2022] DELETE /identity/v3/projects/d14d1ebbfc8e49859609914286ef04fc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:38.547717 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:DELETE=15,keystone:SELECT=67,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:38.866062 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:47.410566 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7b656-1213-4cac-8aba-e5bc29e9d3ff admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:47.411976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9ca7b656-1213-4cac-8aba-e5bc29e9d3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:47.469026 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7b656-1213-4cac-8aba-e5bc29e9d3ff admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:47.516885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d74e5-773a-40a4-b7c1-0047243d034e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:47.517556 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d74e5-773a-40a4-b7c1-0047243d034e service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:47.517842 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d74e5-773a-40a4-b7c1-0047243d034e service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:47.518119 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d74e5-773a-40a4-b7c1-0047243d034e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:47.519906 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e13d74e5-773a-40a4-b7c1-0047243d034e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:47.596840 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d74e5-773a-40a4-b7c1-0047243d034e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:47.599060 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d74e5-773a-40a4-b7c1-0047243d034e service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:47.611293 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1262/2530] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:32:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:32:50.453145 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abbebc-f264-4158-a7e8-42a73721212d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:50.454591 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-91abbebc-f264-4158-a7e8-42a73721212d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:50.467135 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abbebc-f264-4158-a7e8-42a73721212d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:50.470748 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abc83b-1c0f-4eab-a908-f75541732eca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:50.471380 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abc83b-1c0f-4eab-a908-f75541732eca service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:50.471666 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abc83b-1c0f-4eab-a908-f75541732eca service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:50.471944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abc83b-1c0f-4eab-a908-f75541732eca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:50.473694 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d5abc83b-1c0f-4eab-a908-f75541732eca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:50.487278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abc83b-1c0f-4eab-a908-f75541732eca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:50.488701 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abc83b-1c0f-4eab-a908-f75541732eca service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:50.499466 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1269/2531] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:32:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:32:53.054291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d74e5-773a-40a4-b7c1-0047243d034e service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:53.055693 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e13d74e5-773a-40a4-b7c1-0047243d034e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:53.069731 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d74e5-773a-40a4-b7c1-0047243d034e service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:53.075699 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb36fa1-92f8-4576-8f19-97b55eb4b524 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:53.076329 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb36fa1-92f8-4576-8f19-97b55eb4b524 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:53.076606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb36fa1-92f8-4576-8f19-97b55eb4b524 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:53.076904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb36fa1-92f8-4576-8f19-97b55eb4b524 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:53.078646 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7cb36fa1-92f8-4576-8f19-97b55eb4b524 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:53.133307 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:53.136229 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb36fa1-92f8-4576-8f19-97b55eb4b524 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:53.138019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb36fa1-92f8-4576-8f19-97b55eb4b524 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:53.147976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1263/2532] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:32:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:32:59.762004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abc83b-1c0f-4eab-a908-f75541732eca service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:59.763460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d5abc83b-1c0f-4eab-a908-f75541732eca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:59.819272 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abc83b-1c0f-4eab-a908-f75541732eca service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:59.822891 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3f4f0-ef2f-4f84-b4a9-b33b9b5c5477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:59.823530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3f4f0-ef2f-4f84-b4a9-b33b9b5c5477 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:59.824081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3f4f0-ef2f-4f84-b4a9-b33b9b5c5477 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:59.824360 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3f4f0-ef2f-4f84-b4a9-b33b9b5c5477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:59.826151 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9ab3f4f0-ef2f-4f84-b4a9-b33b9b5c5477 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:59.888883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3f4f0-ef2f-4f84-b4a9-b33b9b5c5477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:59.890351 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3f4f0-ef2f-4f84-b4a9-b33b9b5c5477 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:59.900653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1270/2533] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:32:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:33:03.021487 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb36fa1-92f8-4576-8f19-97b55eb4b524 service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:03.023387 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7cb36fa1-92f8-4576-8f19-97b55eb4b524 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:03.037017 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb36fa1-92f8-4576-8f19-97b55eb4b524 service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:03.042477 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986b3d2-2a31-4c29-bda0-0c8ba8ef6c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:03.043352 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986b3d2-2a31-4c29-bda0-0c8ba8ef6c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:03.043634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986b3d2-2a31-4c29-bda0-0c8ba8ef6c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:03.043908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986b3d2-2a31-4c29-bda0-0c8ba8ef6c7b admin admin] PATH_INFO: `/v3/users/1fc73723cc744362941270f74946b3eb` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:03.045098 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986b3d2-2a31-4c29-bda0-0c8ba8ef6c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc73723cc744362941270f74946b3eb)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:03.047068 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986b3d2-2a31-4c29-bda0-0c8ba8ef6c7b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:03.093986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2986b3d2-2a31-4c29-bda0-0c8ba8ef6c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc73723cc744362941270f74946b3eb'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:03.094686 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2986b3d2-2a31-4c29-bda0-0c8ba8ef6c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc73723cc744362941270f74946b3eb'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:03.103905 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2986b3d2-2a31-4c29-bda0-0c8ba8ef6c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc73723cc744362941270f74946b3eb'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:03.108767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2986b3d2-2a31-4c29-bda0-0c8ba8ef6c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc73723cc744362941270f74946b3eb'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:03.113743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2986b3d2-2a31-4c29-bda0-0c8ba8ef6c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc73723cc744362941270f74946b3eb'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:03.131395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1264/2534] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:33:03 2022] DELETE /identity/v3/users/1fc73723cc744362941270f74946b3eb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:03.349367 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3f4f0-ef2f-4f84-b4a9-b33b9b5c5477 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:03.360400 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3f4f0-ef2f-4f84-b4a9-b33b9b5c5477 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:03.422894 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb788ae2-8680-4809-8bf2-10c5d3939554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:03.423850 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb788ae2-8680-4809-8bf2-10c5d3939554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:03.424134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb788ae2-8680-4809-8bf2-10c5d3939554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:03.424410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb788ae2-8680-4809-8bf2-10c5d3939554 admin admin] PATH_INFO: `/v3/projects/5ece2104d99740fbaf75710d531106e8` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:03.425669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb788ae2-8680-4809-8bf2-10c5d3939554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ece2104d99740fbaf75710d531106e8)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:03.427768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb788ae2-8680-4809-8bf2-10c5d3939554 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:03.472689 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:03.481448 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-cb788ae2-8680-4809-8bf2-10c5d3939554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ece2104d99740fbaf75710d531106e8', 'request_id': 'req-cb788ae2-8680-4809-8bf2-10c5d3939554'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:03.489272 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-cb788ae2-8680-4809-8bf2-10c5d3939554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ece2104d99740fbaf75710d531106e8', 'request_id': 'req-cb788ae2-8680-4809-8bf2-10c5d3939554'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:03.496168 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-cb788ae2-8680-4809-8bf2-10c5d3939554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ece2104d99740fbaf75710d531106e8', 'request_id': 'req-cb788ae2-8680-4809-8bf2-10c5d3939554'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:03.507945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-cb788ae2-8680-4809-8bf2-10c5d3939554 admin admin] The token cache is being invalidate because project 5ece2104d99740fbaf75710d531106e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:33:03.508433 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-cb788ae2-8680-4809-8bf2-10c5d3939554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:03.509283 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-cb788ae2-8680-4809-8bf2-10c5d3939554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:03.511580 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1271/2535] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:33:03 2022] DELETE /identity/v3/projects/5ece2104d99740fbaf75710d531106e8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:03.516458 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845108a-51d6-4736-a0c7-d03e8c466ab2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:03.516840 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845108a-51d6-4736-a0c7-d03e8c466ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:03.517225 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845108a-51d6-4736-a0c7-d03e8c466ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:03.538756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a845108a-51d6-4736-a0c7-d03e8c466ab2 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:03.540082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a845108a-51d6-4736-a0c7-d03e8c466ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:03.602841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1265/2536] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:03.610893 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde4f53-de1f-4fd9-8317-cba1aa0a78d6 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:03.611182 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde4f53-de1f-4fd9-8317-cba1aa0a78d6 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:03.611461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde4f53-de1f-4fd9-8317-cba1aa0a78d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:03.630529 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-3fde4f53-de1f-4fd9-8317-cba1aa0a78d6 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:03.631737 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3fde4f53-de1f-4fd9-8317-cba1aa0a78d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:03.639682 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1272/2537] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:03.643971 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845108a-51d6-4736-a0c7-d03e8c466ab2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:03.653489 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845108a-51d6-4736-a0c7-d03e8c466ab2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:03.658287 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20579bd-fa88-4242-973b-28a79642f2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:03.658925 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20579bd-fa88-4242-973b-28a79642f2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:03.659201 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20579bd-fa88-4242-973b-28a79642f2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:03.659470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20579bd-fa88-4242-973b-28a79642f2a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:03.660203 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20579bd-fa88-4242-973b-28a79642f2a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:33:03.660502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20579bd-fa88-4242-973b-28a79642f2a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:03.662115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20579bd-fa88-4242-973b-28a79642f2a0 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:03.673962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1266/2538] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:33:03.678206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde4f53-de1f-4fd9-8317-cba1aa0a78d6 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:03.688046 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde4f53-de1f-4fd9-8317-cba1aa0a78d6 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:03.692734 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4bf36-b000-44d6-b717-77381cec4350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:03.693415 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4bf36-b000-44d6-b717-77381cec4350 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:03.693703 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4bf36-b000-44d6-b717-77381cec4350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:03.693979 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4bf36-b000-44d6-b717-77381cec4350 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:03.694672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4bf36-b000-44d6-b717-77381cec4350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:03.696572 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4bf36-b000-44d6-b717-77381cec4350 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:03.722240 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1273/2539] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:33:03 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:33:03.726241 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20579bd-fa88-4242-973b-28a79642f2a0 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:03.736460 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20579bd-fa88-4242-973b-28a79642f2a0 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:03.784154 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:03.792066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeb9ca-6879-4115-8796-8cfc2ba5f219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:03.792872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeb9ca-6879-4115-8796-8cfc2ba5f219 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:03.793346 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeb9ca-6879-4115-8796-8cfc2ba5f219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:03.793788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeb9ca-6879-4115-8796-8cfc2ba5f219 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:03.794462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeeb9ca-6879-4115-8796-8cfc2ba5f219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:03.796370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeeb9ca-6879-4115-8796-8cfc2ba5f219 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:03.815851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1267/2540] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:33:03 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:33:03.820089 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4bf36-b000-44d6-b717-77381cec4350 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:03.831379 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4bf36-b000-44d6-b717-77381cec4350 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:03.836083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b5dec-d52c-486e-aaae-c5fb36f1c581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:03.836738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b5dec-d52c-486e-aaae-c5fb36f1c581 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:03.837025 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b5dec-d52c-486e-aaae-c5fb36f1c581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:03.837368 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b5dec-d52c-486e-aaae-c5fb36f1c581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:03.838209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b5dec-d52c-486e-aaae-c5fb36f1c581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:03.839813 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b5dec-d52c-486e-aaae-c5fb36f1c581 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:03.850249 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1274/2541] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:33:03.854219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeb9ca-6879-4115-8796-8cfc2ba5f219 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:03.864178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeb9ca-6879-4115-8796-8cfc2ba5f219 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:03.870351 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bddc5-24d1-4072-ad65-ced4e347f664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:03.871030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bddc5-24d1-4072-ad65-ced4e347f664 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:03.871315 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bddc5-24d1-4072-ad65-ced4e347f664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:03.871591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bddc5-24d1-4072-ad65-ced4e347f664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:03.872330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bddc5-24d1-4072-ad65-ced4e347f664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:03.873983 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bddc5-24d1-4072-ad65-ced4e347f664 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:03.884014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1268/2542] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:33:03.889304 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b5dec-d52c-486e-aaae-c5fb36f1c581 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:03.900105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b5dec-d52c-486e-aaae-c5fb36f1c581 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:03.904750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85fb80-f2d2-4efb-bf82-879ecc8d8f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:03.905665 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85fb80-f2d2-4efb-bf82-879ecc8d8f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:03.905946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85fb80-f2d2-4efb-bf82-879ecc8d8f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:03.906215 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85fb80-f2d2-4efb-bf82-879ecc8d8f00 admin admin] PATH_INFO: `/v3/projects/2ba6daf4341a4092916496bcb3a11a64/users/e31898ef6b264fb7b704869b882a86f5/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:03.920513 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85fb80-f2d2-4efb-bf82-879ecc8d8f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ba6daf4341a4092916496bcb3a11a64, user_id=e31898ef6b264fb7b704869b882a86f5, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:03.923181 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85fb80-f2d2-4efb-bf82-879ecc8d8f00 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:03.935949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1275/2543] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:33:03 2022] PUT /identity/v3/projects/2ba6daf4341a4092916496bcb3a11a64/users/e31898ef6b264fb7b704869b882a86f5/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:03.947640 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365fbf2-e1c3-4642-9fb0-e37d7829ff86 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:03.947928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365fbf2-e1c3-4642-9fb0-e37d7829ff86 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:03.948205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365fbf2-e1c3-4642-9fb0-e37d7829ff86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:03.974014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5365fbf2-e1c3-4642-9fb0-e37d7829ff86 None None] MFA Rules not processed for user `e31898ef6b264fb7b704869b882a86f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:03.975204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5365fbf2-e1c3-4642-9fb0-e37d7829ff86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:04.038687 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1269/2544] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:04.043167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85fb80-f2d2-4efb-bf82-879ecc8d8f00 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:04.104307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85fb80-f2d2-4efb-bf82-879ecc8d8f00 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:04.108975 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d817d-6b54-42ae-9839-73498c8fd0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:04.109656 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d817d-6b54-42ae-9839-73498c8fd0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:04.109943 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d817d-6b54-42ae-9839-73498c8fd0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:04.110221 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d817d-6b54-42ae-9839-73498c8fd0e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:04.110910 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d817d-6b54-42ae-9839-73498c8fd0e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:04.112824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d817d-6b54-42ae-9839-73498c8fd0e0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:04.137912 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1276/2545] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:33:04 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:33:04.141879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365fbf2-e1c3-4642-9fb0-e37d7829ff86 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:04.152402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365fbf2-e1c3-4642-9fb0-e37d7829ff86 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:04.206647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c9bf4-3f74-4876-8438-07fd2e42434e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:04.207298 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c9bf4-3f74-4876-8438-07fd2e42434e admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:04.207578 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c9bf4-3f74-4876-8438-07fd2e42434e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:04.207852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c9bf4-3f74-4876-8438-07fd2e42434e admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:04.208523 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c9bf4-3f74-4876-8438-07fd2e42434e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:04.210459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c9bf4-3f74-4876-8438-07fd2e42434e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:04.230000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1270/2546] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:33:04 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:33:04.233976 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d817d-6b54-42ae-9839-73498c8fd0e0 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:04.246313 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d817d-6b54-42ae-9839-73498c8fd0e0 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:04.251606 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac264964-da25-45c0-9c8e-3326bf022339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:04.252270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac264964-da25-45c0-9c8e-3326bf022339 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:04.252558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac264964-da25-45c0-9c8e-3326bf022339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:04.252863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac264964-da25-45c0-9c8e-3326bf022339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:04.253635 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac264964-da25-45c0-9c8e-3326bf022339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:04.255301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac264964-da25-45c0-9c8e-3326bf022339 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:04.269038 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1277/2547] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:33:04.274716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c9bf4-3f74-4876-8438-07fd2e42434e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:04.288877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c9bf4-3f74-4876-8438-07fd2e42434e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:04.293473 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b39328-ef33-4d38-a162-53e71ee86dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:04.294352 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b39328-ef33-4d38-a162-53e71ee86dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:04.294658 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b39328-ef33-4d38-a162-53e71ee86dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:04.294934 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b39328-ef33-4d38-a162-53e71ee86dbe admin admin] PATH_INFO: `/v3/projects/b3b745525cc14f479c1f086ea274716f/users/dbeffac73c4b43d7a43006da2de52278/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:04.310335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b39328-ef33-4d38-a162-53e71ee86dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b745525cc14f479c1f086ea274716f, user_id=dbeffac73c4b43d7a43006da2de52278, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:04.312990 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b39328-ef33-4d38-a162-53e71ee86dbe admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:04.326383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1271/2548] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:33:04 2022] PUT /identity/v3/projects/b3b745525cc14f479c1f086ea274716f/users/dbeffac73c4b43d7a43006da2de52278/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:33:04.330321 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac264964-da25-45c0-9c8e-3326bf022339 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:04.340818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac264964-da25-45c0-9c8e-3326bf022339 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:04.373838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:04.402566 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ea813-53db-43d7-b86d-87668ea6c726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:04.403239 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ea813-53db-43d7-b86d-87668ea6c726 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:04.403523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ea813-53db-43d7-b86d-87668ea6c726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:04.403799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ea813-53db-43d7-b86d-87668ea6c726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:04.404518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ea813-53db-43d7-b86d-87668ea6c726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:04.406208 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ea813-53db-43d7-b86d-87668ea6c726 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:04.416389 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1278/2549] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:33:04.420561 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b39328-ef33-4d38-a162-53e71ee86dbe admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:04.431257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b39328-ef33-4d38-a162-53e71ee86dbe admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:04.435811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76e66e-b816-4053-8ac6-b8344c073347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:04.436702 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76e66e-b816-4053-8ac6-b8344c073347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:04.436979 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76e66e-b816-4053-8ac6-b8344c073347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:04.437245 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76e66e-b816-4053-8ac6-b8344c073347 admin admin] PATH_INFO: `/v3/projects/b3b745525cc14f479c1f086ea274716f/users/dbeffac73c4b43d7a43006da2de52278/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:04.439232 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76e66e-b816-4053-8ac6-b8344c073347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b745525cc14f479c1f086ea274716f, user_id=dbeffac73c4b43d7a43006da2de52278, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:04.441897 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76e66e-b816-4053-8ac6-b8344c073347 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:04.452370 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1272/2550] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:33:04 2022] PUT /identity/v3/projects/b3b745525cc14f479c1f086ea274716f/users/dbeffac73c4b43d7a43006da2de52278/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:04.462662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91716abc-223c-4bbd-8266-d311d6586617 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:04.462957 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91716abc-223c-4bbd-8266-d311d6586617 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:04.463240 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91716abc-223c-4bbd-8266-d311d6586617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:04.489818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-91716abc-223c-4bbd-8266-d311d6586617 None None] MFA Rules not processed for user `dbeffac73c4b43d7a43006da2de52278`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:04.491031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-91716abc-223c-4bbd-8266-d311d6586617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:04.557686 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1279/2551] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:04.571797 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76e66e-b816-4053-8ac6-b8344c073347 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:04.573642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8d76e66e-b816-4053-8ac6-b8344c073347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:04.592935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:04.632060 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76e66e-b816-4053-8ac6-b8344c073347 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:04.635648 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdee6f-ad87-40ab-945e-3a8af7988846 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:04.636284 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdee6f-ad87-40ab-945e-3a8af7988846 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:04.636612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdee6f-ad87-40ab-945e-3a8af7988846 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:04.636888 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdee6f-ad87-40ab-945e-3a8af7988846 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:04.645679 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdee6f-ad87-40ab-945e-3a8af7988846 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:04.647609 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdee6f-ad87-40ab-945e-3a8af7988846 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:04.656865 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1273/2552] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:33:04.725926 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91716abc-223c-4bbd-8266-d311d6586617 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:04.736856 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91716abc-223c-4bbd-8266-d311d6586617 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:04.740487 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f50a6-4096-42ce-8a7b-af35f896377e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:04.741112 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f50a6-4096-42ce-8a7b-af35f896377e service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:04.741422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f50a6-4096-42ce-8a7b-af35f896377e service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:04.741738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f50a6-4096-42ce-8a7b-af35f896377e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:04.798612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f50a6-4096-42ce-8a7b-af35f896377e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:04.800059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f50a6-4096-42ce-8a7b-af35f896377e service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:04.809150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1280/2553] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:33:14.652682 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=19 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:14.805049 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=74 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:30.727291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdf7e0-0252-44cc-a2f8-e0f7379d6164 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:30.727778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdf7e0-0252-44cc-a2f8-e0f7379d6164 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:30.727894 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdf7e0-0252-44cc-a2f8-e0f7379d6164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:30.747913 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-26fdf7e0-0252-44cc-a2f8-e0f7379d6164 None None] MFA Rules not processed for user `54189575a60a4d9dbaabb78d44e9c31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:30.749122 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-26fdf7e0-0252-44cc-a2f8-e0f7379d6164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:30.812149 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1274/2554] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Jul 12 18:33:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:30.864569 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f50a6-4096-42ce-8a7b-af35f896377e service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:30.866679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8a3f50a6-4096-42ce-8a7b-af35f896377e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:30.941288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f50a6-4096-42ce-8a7b-af35f896377e service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:30.947464 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8ecc3-576e-411b-9be9-b6998625c306 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ade969d7aa3d49c08782a68ec5997382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:30.948228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8ecc3-576e-411b-9be9-b6998625c306 service swift] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:30.948782 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8ecc3-576e-411b-9be9-b6998625c306 service swift] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:30.949063 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8ecc3-576e-411b-9be9-b6998625c306 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:30.957631 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8ecc3-576e-411b-9be9-b6998625c306 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:30.959252 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8ecc3-576e-411b-9be9-b6998625c306 service swift] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:30.967462 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1281/2555] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Jul 12 18:33:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:33:32.259336 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdf7e0-0252-44cc-a2f8-e0f7379d6164 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:32.261391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-26fdf7e0-0252-44cc-a2f8-e0f7379d6164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:32.378224 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdf7e0-0252-44cc-a2f8-e0f7379d6164 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:32.384450 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55e02a-59f1-477f-b918-d5f0ab49ef36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:32.385111 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55e02a-59f1-477f-b918-d5f0ab49ef36 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:32.385418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55e02a-59f1-477f-b918-d5f0ab49ef36 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:32.385791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55e02a-59f1-477f-b918-d5f0ab49ef36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:32.387666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-dc55e02a-59f1-477f-b918-d5f0ab49ef36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:32.401837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55e02a-59f1-477f-b918-d5f0ab49ef36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:32.403477 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55e02a-59f1-477f-b918-d5f0ab49ef36 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:32.415839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1275/2556] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:33:33.749286 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8ecc3-576e-411b-9be9-b6998625c306 service swift] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:33.827971 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8ecc3-576e-411b-9be9-b6998625c306 service swift] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:33.833056 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a8289-3c46-4419-a444-36e1e7737ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:33.834253 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8289-3c46-4419-a444-36e1e7737ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:33.834606 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8289-3c46-4419-a444-36e1e7737ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:33.835136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8289-3c46-4419-a444-36e1e7737ba4 admin admin] PATH_INFO: `/v3/users/e31898ef6b264fb7b704869b882a86f5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:33.836465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a8289-3c46-4419-a444-36e1e7737ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e31898ef6b264fb7b704869b882a86f5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:33.838576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a8289-3c46-4419-a444-36e1e7737ba4 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:33.905110 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2c3a8289-3c46-4419-a444-36e1e7737ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e31898ef6b264fb7b704869b882a86f5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:33.905958 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2c3a8289-3c46-4419-a444-36e1e7737ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e31898ef6b264fb7b704869b882a86f5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:33.919881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2c3a8289-3c46-4419-a444-36e1e7737ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e31898ef6b264fb7b704869b882a86f5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:33.928421 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2c3a8289-3c46-4419-a444-36e1e7737ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e31898ef6b264fb7b704869b882a86f5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:33.929160 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2c3a8289-3c46-4419-a444-36e1e7737ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e31898ef6b264fb7b704869b882a86f5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:33.944562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1282/2557] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:33:33 2022] DELETE /identity/v3/users/e31898ef6b264fb7b704869b882a86f5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:33.949390 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d57bf4-611e-4fa3-bd43-95e705588343 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:33.949862 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d57bf4-611e-4fa3-bd43-95e705588343 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:33.950144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d57bf4-611e-4fa3-bd43-95e705588343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:33.968438 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-81d57bf4-611e-4fa3-bd43-95e705588343 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:33.969730 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-81d57bf4-611e-4fa3-bd43-95e705588343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:34.040105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1276/2558] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:34.050258 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a8289-3c46-4419-a444-36e1e7737ba4 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:34.051754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2c3a8289-3c46-4419-a444-36e1e7737ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:34.064126 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:34.118959 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a8289-3c46-4419-a444-36e1e7737ba4 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:34.123957 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1ba3a-7986-4cf9-af3a-c5c2d54f9b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:34.124635 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1ba3a-7986-4cf9-af3a-c5c2d54f9b20 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:34.124918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1ba3a-7986-4cf9-af3a-c5c2d54f9b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:34.125192 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1ba3a-7986-4cf9-af3a-c5c2d54f9b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:34.135283 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1ba3a-7986-4cf9-af3a-c5c2d54f9b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:34.137345 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1ba3a-7986-4cf9-af3a-c5c2d54f9b20 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:34.147960 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1283/2559] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:33:34.471233 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d57bf4-611e-4fa3-bd43-95e705588343 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:34.473207 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-81d57bf4-611e-4fa3-bd43-95e705588343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:34.506177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d57bf4-611e-4fa3-bd43-95e705588343 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:34.511712 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0e6a3-98bb-4ea4-96bb-b176e44f7ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:34.512614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0e6a3-98bb-4ea4-96bb-b176e44f7ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:34.512858 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0e6a3-98bb-4ea4-96bb-b176e44f7ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:34.513131 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0e6a3-98bb-4ea4-96bb-b176e44f7ba1 admin admin] PATH_INFO: `/v3/projects/2ba6daf4341a4092916496bcb3a11a64` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:34.514376 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0e6a3-98bb-4ea4-96bb-b176e44f7ba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ba6daf4341a4092916496bcb3a11a64)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:34.516287 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0e6a3-98bb-4ea4-96bb-b176e44f7ba1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:34.550878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:34.570444 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d6d0e6a3-98bb-4ea4-96bb-b176e44f7ba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ba6daf4341a4092916496bcb3a11a64', 'request_id': 'req-d6d0e6a3-98bb-4ea4-96bb-b176e44f7ba1'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:34.577341 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d6d0e6a3-98bb-4ea4-96bb-b176e44f7ba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ba6daf4341a4092916496bcb3a11a64', 'request_id': 'req-d6d0e6a3-98bb-4ea4-96bb-b176e44f7ba1'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:34.583944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d6d0e6a3-98bb-4ea4-96bb-b176e44f7ba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ba6daf4341a4092916496bcb3a11a64', 'request_id': 'req-d6d0e6a3-98bb-4ea4-96bb-b176e44f7ba1'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:34.600010 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d6d0e6a3-98bb-4ea4-96bb-b176e44f7ba1 admin admin] The token cache is being invalidate because project 2ba6daf4341a4092916496bcb3a11a64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:33:34.600523 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d6d0e6a3-98bb-4ea4-96bb-b176e44f7ba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:34.601178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d6d0e6a3-98bb-4ea4-96bb-b176e44f7ba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:34.603152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1277/2560] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:33:34 2022] DELETE /identity/v3/projects/2ba6daf4341a4092916496bcb3a11a64 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:34.606884 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1ba3a-7986-4cf9-af3a-c5c2d54f9b20 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:34.618546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1ba3a-7986-4cf9-af3a-c5c2d54f9b20 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:34.687055 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd9d53-397d-421d-a8c4-04547e2e3acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:34.688206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd9d53-397d-421d-a8c4-04547e2e3acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:34.688556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd9d53-397d-421d-a8c4-04547e2e3acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:34.688841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd9d53-397d-421d-a8c4-04547e2e3acc admin admin] PATH_INFO: `/v3/users/dbeffac73c4b43d7a43006da2de52278` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:34.690105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd9d53-397d-421d-a8c4-04547e2e3acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbeffac73c4b43d7a43006da2de52278)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:34.692152 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd9d53-397d-421d-a8c4-04547e2e3acc admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:34.747481 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0abd9d53-397d-421d-a8c4-04547e2e3acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbeffac73c4b43d7a43006da2de52278'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:34.748156 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0abd9d53-397d-421d-a8c4-04547e2e3acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbeffac73c4b43d7a43006da2de52278'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:34.762714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0abd9d53-397d-421d-a8c4-04547e2e3acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbeffac73c4b43d7a43006da2de52278'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:34.772829 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0abd9d53-397d-421d-a8c4-04547e2e3acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbeffac73c4b43d7a43006da2de52278'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:34.773574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0abd9d53-397d-421d-a8c4-04547e2e3acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbeffac73c4b43d7a43006da2de52278'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:34.791446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1284/2561] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:33:34 2022] DELETE /identity/v3/users/dbeffac73c4b43d7a43006da2de52278 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:35.145198 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0e6a3-98bb-4ea4-96bb-b176e44f7ba1 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:35.147577 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d6d0e6a3-98bb-4ea4-96bb-b176e44f7ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:35.169925 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0e6a3-98bb-4ea4-96bb-b176e44f7ba1 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:35.251591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92b905-3604-4de2-87b2-c13e1eb05e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:35.252377 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92b905-3604-4de2-87b2-c13e1eb05e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:35.252685 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92b905-3604-4de2-87b2-c13e1eb05e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:35.252964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92b905-3604-4de2-87b2-c13e1eb05e31 admin admin] PATH_INFO: `/v3/projects/b3b745525cc14f479c1f086ea274716f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:35.254199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92b905-3604-4de2-87b2-c13e1eb05e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b745525cc14f479c1f086ea274716f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:35.256759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92b905-3604-4de2-87b2-c13e1eb05e31 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:35.309142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7c92b905-3604-4de2-87b2-c13e1eb05e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b745525cc14f479c1f086ea274716f', 'request_id': 'req-7c92b905-3604-4de2-87b2-c13e1eb05e31'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:35.314996 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7c92b905-3604-4de2-87b2-c13e1eb05e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b745525cc14f479c1f086ea274716f', 'request_id': 'req-7c92b905-3604-4de2-87b2-c13e1eb05e31'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:35.324466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7c92b905-3604-4de2-87b2-c13e1eb05e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b745525cc14f479c1f086ea274716f', 'request_id': 'req-7c92b905-3604-4de2-87b2-c13e1eb05e31'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:35.345624 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7c92b905-3604-4de2-87b2-c13e1eb05e31 admin admin] The token cache is being invalidate because project b3b745525cc14f479c1f086ea274716f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:33:35.346260 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7c92b905-3604-4de2-87b2-c13e1eb05e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:35.347378 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7c92b905-3604-4de2-87b2-c13e1eb05e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:35.350402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1278/2562] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:33:35 2022] DELETE /identity/v3/projects/b3b745525cc14f479c1f086ea274716f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:35.355293 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d6af6-5270-4e68-91b8-a18164eb430f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:35.355904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d6af6-5270-4e68-91b8-a18164eb430f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:35.356188 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d6af6-5270-4e68-91b8-a18164eb430f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:35.378630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-983d6af6-5270-4e68-91b8-a18164eb430f None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:35.379853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-983d6af6-5270-4e68-91b8-a18164eb430f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:35.415612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:35.469409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1285/2563] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:35.475085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb7a8c-3dc6-4ca9-805b-424025f53f97 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:35.475504 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb7a8c-3dc6-4ca9-805b-424025f53f97 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:35.475782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb7a8c-3dc6-4ca9-805b-424025f53f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:35.495084 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-18eb7a8c-3dc6-4ca9-805b-424025f53f97 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:35.496342 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-18eb7a8c-3dc6-4ca9-805b-424025f53f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:35.508171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1279/2564] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:35.509369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d6af6-5270-4e68-91b8-a18164eb430f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:35.519745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d6af6-5270-4e68-91b8-a18164eb430f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:35.525353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d07595-9eb0-4834-a5af-322d22d200f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:35.526014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d07595-9eb0-4834-a5af-322d22d200f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:35.526311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d07595-9eb0-4834-a5af-322d22d200f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:35.526594 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d07595-9eb0-4834-a5af-322d22d200f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:35.527330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d07595-9eb0-4834-a5af-322d22d200f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:33:35.527707 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d07595-9eb0-4834-a5af-322d22d200f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:35.529277 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d07595-9eb0-4834-a5af-322d22d200f5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:35.541750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1286/2565] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:33:35.545934 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb7a8c-3dc6-4ca9-805b-424025f53f97 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:35.556914 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb7a8c-3dc6-4ca9-805b-424025f53f97 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:35.562500 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221dc3e-e03e-4e52-8e54-e8d2fb440233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:35.563191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221dc3e-e03e-4e52-8e54-e8d2fb440233 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:35.563465 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221dc3e-e03e-4e52-8e54-e8d2fb440233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:35.563739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221dc3e-e03e-4e52-8e54-e8d2fb440233 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:35.564476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221dc3e-e03e-4e52-8e54-e8d2fb440233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:35.566687 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221dc3e-e03e-4e52-8e54-e8d2fb440233 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:35.606493 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1280/2566] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:33:35 2022] POST /identity/v3/projects => generated 391 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:33:35.610184 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d07595-9eb0-4834-a5af-322d22d200f5 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:35.622852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d07595-9eb0-4834-a5af-322d22d200f5 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:35.690430 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f224a-d36f-46c8-bbd0-feea60c30a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:35.691215 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f224a-d36f-46c8-bbd0-feea60c30a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:35.691557 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f224a-d36f-46c8-bbd0-feea60c30a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:35.692028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f224a-d36f-46c8-bbd0-feea60c30a0a admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:35.692804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f224a-d36f-46c8-bbd0-feea60c30a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:35.694759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f224a-d36f-46c8-bbd0-feea60c30a0a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:35.719915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1287/2567] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:33:35 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:33:35.724209 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221dc3e-e03e-4e52-8e54-e8d2fb440233 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:35.735544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221dc3e-e03e-4e52-8e54-e8d2fb440233 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:35.740345 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1676e17-2047-442b-ab12-cae38e0aa58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:35.741008 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1676e17-2047-442b-ab12-cae38e0aa58d admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:35.741326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1676e17-2047-442b-ab12-cae38e0aa58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:35.741841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1676e17-2047-442b-ab12-cae38e0aa58d admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:35.742310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1676e17-2047-442b-ab12-cae38e0aa58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:35.743920 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1676e17-2047-442b-ab12-cae38e0aa58d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:35.756625 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1281/2568] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:33:35.762214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f224a-d36f-46c8-bbd0-feea60c30a0a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:35.775221 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f224a-d36f-46c8-bbd0-feea60c30a0a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:35.780298 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb8374-0ee1-4bee-b8d8-c35174ee1994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:35.780965 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb8374-0ee1-4bee-b8d8-c35174ee1994 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:35.781247 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb8374-0ee1-4bee-b8d8-c35174ee1994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:35.781559 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb8374-0ee1-4bee-b8d8-c35174ee1994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:35.782308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb8374-0ee1-4bee-b8d8-c35174ee1994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:35.783936 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb8374-0ee1-4bee-b8d8-c35174ee1994 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:35.797120 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1288/2569] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:33:35.801235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1676e17-2047-442b-ab12-cae38e0aa58d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:35.807999 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:35.814574 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1676e17-2047-442b-ab12-cae38e0aa58d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:35.822265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9c6e2-b77d-4177-9269-862a38f658ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:35.823222 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c6e2-b77d-4177-9269-862a38f658ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:35.823815 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c6e2-b77d-4177-9269-862a38f658ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:35.824156 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c6e2-b77d-4177-9269-862a38f658ca admin admin] PATH_INFO: `/v3/projects/dc33e654ad8d43ddb0555ca6875fb60a/users/eddf5094e854488b8b9ca93ce8b5beb9/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:35.840487 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9c6e2-b77d-4177-9269-862a38f658ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc33e654ad8d43ddb0555ca6875fb60a, user_id=eddf5094e854488b8b9ca93ce8b5beb9, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:35.843265 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9c6e2-b77d-4177-9269-862a38f658ca admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:35.860281 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1282/2570] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:33:35 2022] PUT /identity/v3/projects/dc33e654ad8d43ddb0555ca6875fb60a/users/eddf5094e854488b8b9ca93ce8b5beb9/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:35.870433 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3d694-3f02-4083-ace1-396ff087ba33 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:35.870728 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3d694-3f02-4083-ace1-396ff087ba33 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:35.871007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3d694-3f02-4083-ace1-396ff087ba33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:35.900787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c7b3d694-3f02-4083-ace1-396ff087ba33 None None] MFA Rules not processed for user `eddf5094e854488b8b9ca93ce8b5beb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:35.902055 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c7b3d694-3f02-4083-ace1-396ff087ba33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:35.983361 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9c6e2-b77d-4177-9269-862a38f658ca admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:35.984053 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1289/2571] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:36.058376 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9c6e2-b77d-4177-9269-862a38f658ca admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:36.063646 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac62bc-3ba9-4a80-a7fb-917f0a468de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:36.064537 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac62bc-3ba9-4a80-a7fb-917f0a468de1 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:36.065006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac62bc-3ba9-4a80-a7fb-917f0a468de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:36.065460 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac62bc-3ba9-4a80-a7fb-917f0a468de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:36.066324 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac62bc-3ba9-4a80-a7fb-917f0a468de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:36.068830 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac62bc-3ba9-4a80-a7fb-917f0a468de1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:36.106512 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1283/2572] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:33:35 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:33:36.107994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3d694-3f02-4083-ace1-396ff087ba33 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:36.120839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3d694-3f02-4083-ace1-396ff087ba33 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:36.157665 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:36.218055 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad614368-5dc5-416d-ac2c-e04571989de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:36.218750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad614368-5dc5-416d-ac2c-e04571989de1 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:36.219037 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad614368-5dc5-416d-ac2c-e04571989de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:36.219316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad614368-5dc5-416d-ac2c-e04571989de1 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:36.220018 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad614368-5dc5-416d-ac2c-e04571989de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:36.222005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad614368-5dc5-416d-ac2c-e04571989de1 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:36.269592 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1290/2573] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:33:36 2022] POST /identity/v3/users => generated 303 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:33:36.271148 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac62bc-3ba9-4a80-a7fb-917f0a468de1 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:36.284462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac62bc-3ba9-4a80-a7fb-917f0a468de1 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:36.294536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9afc7d-2db0-4a37-a2db-2572c00c90cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:36.295534 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9afc7d-2db0-4a37-a2db-2572c00c90cb admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:36.296032 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9afc7d-2db0-4a37-a2db-2572c00c90cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:36.296484 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9afc7d-2db0-4a37-a2db-2572c00c90cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:36.297422 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9afc7d-2db0-4a37-a2db-2572c00c90cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:36.299386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9afc7d-2db0-4a37-a2db-2572c00c90cb admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:36.317482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1284/2574] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:33:36.319097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad614368-5dc5-416d-ac2c-e04571989de1 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:36.329746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad614368-5dc5-416d-ac2c-e04571989de1 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:36.334442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac19602-340c-4dc2-a5ca-d939f0e8aa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:36.335315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac19602-340c-4dc2-a5ca-d939f0e8aa22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:36.335606 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac19602-340c-4dc2-a5ca-d939f0e8aa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:36.335867 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac19602-340c-4dc2-a5ca-d939f0e8aa22 admin admin] PATH_INFO: `/v3/projects/2f264d3bfdeb4bf99a1d0a059945fa06/users/2b06b209585a4aff9347f1a7b73e03b6/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:36.353249 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac19602-340c-4dc2-a5ca-d939f0e8aa22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f264d3bfdeb4bf99a1d0a059945fa06, user_id=2b06b209585a4aff9347f1a7b73e03b6, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:36.355961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac19602-340c-4dc2-a5ca-d939f0e8aa22 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:36.371889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1291/2575] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:33:36 2022] PUT /identity/v3/projects/2f264d3bfdeb4bf99a1d0a059945fa06/users/2b06b209585a4aff9347f1a7b73e03b6/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:33:36.375879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9afc7d-2db0-4a37-a2db-2572c00c90cb admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:36.386868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9afc7d-2db0-4a37-a2db-2572c00c90cb admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:36.449861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee7bcf-9ca1-4302-9992-38427ef6adef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:36.450719 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee7bcf-9ca1-4302-9992-38427ef6adef admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:36.450999 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee7bcf-9ca1-4302-9992-38427ef6adef admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:36.451273 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee7bcf-9ca1-4302-9992-38427ef6adef admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:36.452012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee7bcf-9ca1-4302-9992-38427ef6adef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:36.453697 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee7bcf-9ca1-4302-9992-38427ef6adef admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:36.465048 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1285/2576] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:33:36.469385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac19602-340c-4dc2-a5ca-d939f0e8aa22 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:36.480267 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac19602-340c-4dc2-a5ca-d939f0e8aa22 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:36.485202 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a08771-af75-46e6-a0b3-5bb108911f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:36.486151 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a08771-af75-46e6-a0b3-5bb108911f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:36.486422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a08771-af75-46e6-a0b3-5bb108911f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:36.486706 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a08771-af75-46e6-a0b3-5bb108911f87 admin admin] PATH_INFO: `/v3/projects/2f264d3bfdeb4bf99a1d0a059945fa06/users/2b06b209585a4aff9347f1a7b73e03b6/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:36.488849 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a08771-af75-46e6-a0b3-5bb108911f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f264d3bfdeb4bf99a1d0a059945fa06, user_id=2b06b209585a4aff9347f1a7b73e03b6, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:36.492135 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a08771-af75-46e6-a0b3-5bb108911f87 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:36.508218 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1292/2577] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:33:36 2022] PUT /identity/v3/projects/2f264d3bfdeb4bf99a1d0a059945fa06/users/2b06b209585a4aff9347f1a7b73e03b6/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:36.518908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7d87e-b5e4-410f-839e-80d085daf39e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:36.519201 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7d87e-b5e4-410f-839e-80d085daf39e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:36.519483 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7d87e-b5e4-410f-839e-80d085daf39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:36.550191 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c6e7d87e-b5e4-410f-839e-80d085daf39e None None] MFA Rules not processed for user `2b06b209585a4aff9347f1a7b73e03b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:36.551429 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c6e7d87e-b5e4-410f-839e-80d085daf39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:36.600673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:36.634703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1286/2578] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:36.645551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a08771-af75-46e6-a0b3-5bb108911f87 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:36.647396 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-91a08771-af75-46e6-a0b3-5bb108911f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:36.717193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a08771-af75-46e6-a0b3-5bb108911f87 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:36.729330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d120e-c935-47f1-b131-5369798561bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:36.730031 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d120e-c935-47f1-b131-5369798561bf service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:36.730303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d120e-c935-47f1-b131-5369798561bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:36.730579 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d120e-c935-47f1-b131-5369798561bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:36.742208 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d120e-c935-47f1-b131-5369798561bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:36.743691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d120e-c935-47f1-b131-5369798561bf service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:36.756276 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1293/2579] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:33:36.807979 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7d87e-b5e4-410f-839e-80d085daf39e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:36.809481 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c6e7d87e-b5e4-410f-839e-80d085daf39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:36.821961 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7d87e-b5e4-410f-839e-80d085daf39e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:36.826196 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f87ca7-06d1-4479-aad8-8b170d976d77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:36.826831 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f87ca7-06d1-4479-aad8-8b170d976d77 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:36.827117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f87ca7-06d1-4479-aad8-8b170d976d77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:36.827400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f87ca7-06d1-4479-aad8-8b170d976d77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:36.897069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f87ca7-06d1-4479-aad8-8b170d976d77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:36.898569 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f87ca7-06d1-4479-aad8-8b170d976d77 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:36.908328 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1287/2580] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:33:40.334291 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d120e-c935-47f1-b131-5369798561bf service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:40.397513 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d120e-c935-47f1-b131-5369798561bf service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:40.402438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f779cf-7ad2-4807-aa51-9628812d00b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:40.403302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f779cf-7ad2-4807-aa51-9628812d00b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:40.403583 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f779cf-7ad2-4807-aa51-9628812d00b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:40.403885 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f779cf-7ad2-4807-aa51-9628812d00b0 admin admin] PATH_INFO: `/v3/users/eddf5094e854488b8b9ca93ce8b5beb9` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:40.405087 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f779cf-7ad2-4807-aa51-9628812d00b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eddf5094e854488b8b9ca93ce8b5beb9)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:40.407076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f779cf-7ad2-4807-aa51-9628812d00b0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:40.429524 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:40.454496 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-42f779cf-7ad2-4807-aa51-9628812d00b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eddf5094e854488b8b9ca93ce8b5beb9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:40.455162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-42f779cf-7ad2-4807-aa51-9628812d00b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eddf5094e854488b8b9ca93ce8b5beb9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:40.466918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-42f779cf-7ad2-4807-aa51-9628812d00b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eddf5094e854488b8b9ca93ce8b5beb9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:40.473683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-42f779cf-7ad2-4807-aa51-9628812d00b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eddf5094e854488b8b9ca93ce8b5beb9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:40.474323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-42f779cf-7ad2-4807-aa51-9628812d00b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eddf5094e854488b8b9ca93ce8b5beb9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:40.487109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1294/2581] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:33:40 2022] DELETE /identity/v3/users/eddf5094e854488b8b9ca93ce8b5beb9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:40.492200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1d686-9f5b-408c-afba-b9674ae3ed56 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:40.492645 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1d686-9f5b-408c-afba-b9674ae3ed56 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:40.492760 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1d686-9f5b-408c-afba-b9674ae3ed56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:40.510898 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d9a1d686-9f5b-408c-afba-b9674ae3ed56 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:40.512109 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d9a1d686-9f5b-408c-afba-b9674ae3ed56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:40.570651 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1288/2582] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:40.582623 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f779cf-7ad2-4807-aa51-9628812d00b0 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:40.584623 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-42f779cf-7ad2-4807-aa51-9628812d00b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:40.642048 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f779cf-7ad2-4807-aa51-9628812d00b0 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:40.646423 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5172f97-a6d7-48b5-941f-40ab717ac37d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:40.647097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5172f97-a6d7-48b5-941f-40ab717ac37d service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:40.647552 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5172f97-a6d7-48b5-941f-40ab717ac37d service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:40.647832 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5172f97-a6d7-48b5-941f-40ab717ac37d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:40.656967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5172f97-a6d7-48b5-941f-40ab717ac37d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:40.658421 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5172f97-a6d7-48b5-941f-40ab717ac37d service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:40.667768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1295/2583] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:33:40.795851 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1d686-9f5b-408c-afba-b9674ae3ed56 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:40.805389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1d686-9f5b-408c-afba-b9674ae3ed56 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:40.809353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eca9c8-5f8f-40b7-bf34-33ae6392e46a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:40.809997 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eca9c8-5f8f-40b7-bf34-33ae6392e46a service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:40.810316 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eca9c8-5f8f-40b7-bf34-33ae6392e46a service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:40.810531 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eca9c8-5f8f-40b7-bf34-33ae6392e46a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:40.813825 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-80eca9c8-5f8f-40b7-bf34-33ae6392e46a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:40.825243 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eca9c8-5f8f-40b7-bf34-33ae6392e46a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:40.826713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eca9c8-5f8f-40b7-bf34-33ae6392e46a service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:40.839122 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1289/2584] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:33:41.119428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5172f97-a6d7-48b5-941f-40ab717ac37d service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:41.120864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d5172f97-a6d7-48b5-941f-40ab717ac37d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:41.134567 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5172f97-a6d7-48b5-941f-40ab717ac37d service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:41.140339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948a3e5-ec13-4945-b747-6613e108525a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:41.141234 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948a3e5-ec13-4945-b747-6613e108525a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:41.141542 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948a3e5-ec13-4945-b747-6613e108525a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:41.141822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948a3e5-ec13-4945-b747-6613e108525a admin admin] PATH_INFO: `/v3/projects/dc33e654ad8d43ddb0555ca6875fb60a` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:41.143011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7948a3e5-ec13-4945-b747-6613e108525a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc33e654ad8d43ddb0555ca6875fb60a)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:41.144933 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7948a3e5-ec13-4945-b747-6613e108525a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:41.200417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7948a3e5-ec13-4945-b747-6613e108525a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc33e654ad8d43ddb0555ca6875fb60a', 'request_id': 'req-7948a3e5-ec13-4945-b747-6613e108525a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:41.208674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7948a3e5-ec13-4945-b747-6613e108525a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc33e654ad8d43ddb0555ca6875fb60a', 'request_id': 'req-7948a3e5-ec13-4945-b747-6613e108525a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:41.215355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7948a3e5-ec13-4945-b747-6613e108525a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc33e654ad8d43ddb0555ca6875fb60a', 'request_id': 'req-7948a3e5-ec13-4945-b747-6613e108525a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:41.227403 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7948a3e5-ec13-4945-b747-6613e108525a admin admin] The token cache is being invalidate because project dc33e654ad8d43ddb0555ca6875fb60a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:33:41.227696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7948a3e5-ec13-4945-b747-6613e108525a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:41.228356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7948a3e5-ec13-4945-b747-6613e108525a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:41.230140 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1296/2585] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:33:41 2022] DELETE /identity/v3/projects/dc33e654ad8d43ddb0555ca6875fb60a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:41.233833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eca9c8-5f8f-40b7-bf34-33ae6392e46a service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:41.245768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eca9c8-5f8f-40b7-bf34-33ae6392e46a service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:41.305798 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385047f-5ed7-4842-bdb5-9df9087dae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:41.306697 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385047f-5ed7-4842-bdb5-9df9087dae50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:41.306975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385047f-5ed7-4842-bdb5-9df9087dae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:41.307249 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385047f-5ed7-4842-bdb5-9df9087dae50 admin admin] PATH_INFO: `/v3/users/2b06b209585a4aff9347f1a7b73e03b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:41.308455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385047f-5ed7-4842-bdb5-9df9087dae50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b06b209585a4aff9347f1a7b73e03b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:41.310446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385047f-5ed7-4842-bdb5-9df9087dae50 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:41.312772 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:41.360106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0385047f-5ed7-4842-bdb5-9df9087dae50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b06b209585a4aff9347f1a7b73e03b6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:41.360697 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0385047f-5ed7-4842-bdb5-9df9087dae50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b06b209585a4aff9347f1a7b73e03b6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:41.369314 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0385047f-5ed7-4842-bdb5-9df9087dae50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b06b209585a4aff9347f1a7b73e03b6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:41.369997 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0385047f-5ed7-4842-bdb5-9df9087dae50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b06b209585a4aff9347f1a7b73e03b6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:41.376843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0385047f-5ed7-4842-bdb5-9df9087dae50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b06b209585a4aff9347f1a7b73e03b6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:41.397049 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1290/2586] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:33:41 2022] DELETE /identity/v3/users/2b06b209585a4aff9347f1a7b73e03b6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:41.666530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948a3e5-ec13-4945-b747-6613e108525a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:41.668028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7948a3e5-ec13-4945-b747-6613e108525a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:41.681150 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948a3e5-ec13-4945-b747-6613e108525a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:41.705526 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:41.739680 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b99a4c-6615-4bc9-bfa8-fa6e85b9ee6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:41.740539 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b99a4c-6615-4bc9-bfa8-fa6e85b9ee6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:41.740822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b99a4c-6615-4bc9-bfa8-fa6e85b9ee6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:41.741100 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b99a4c-6615-4bc9-bfa8-fa6e85b9ee6a admin admin] PATH_INFO: `/v3/projects/2f264d3bfdeb4bf99a1d0a059945fa06` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:41.742314 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b99a4c-6615-4bc9-bfa8-fa6e85b9ee6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f264d3bfdeb4bf99a1d0a059945fa06)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:41.744227 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b99a4c-6615-4bc9-bfa8-fa6e85b9ee6a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:41.789944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b9b99a4c-6615-4bc9-bfa8-fa6e85b9ee6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f264d3bfdeb4bf99a1d0a059945fa06', 'request_id': 'req-b9b99a4c-6615-4bc9-bfa8-fa6e85b9ee6a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:41.796653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b9b99a4c-6615-4bc9-bfa8-fa6e85b9ee6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f264d3bfdeb4bf99a1d0a059945fa06', 'request_id': 'req-b9b99a4c-6615-4bc9-bfa8-fa6e85b9ee6a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:41.802103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b9b99a4c-6615-4bc9-bfa8-fa6e85b9ee6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f264d3bfdeb4bf99a1d0a059945fa06', 'request_id': 'req-b9b99a4c-6615-4bc9-bfa8-fa6e85b9ee6a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:41.813345 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b9b99a4c-6615-4bc9-bfa8-fa6e85b9ee6a admin admin] The token cache is being invalidate because project 2f264d3bfdeb4bf99a1d0a059945fa06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:33:41.813633 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b9b99a4c-6615-4bc9-bfa8-fa6e85b9ee6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:41.814268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b9b99a4c-6615-4bc9-bfa8-fa6e85b9ee6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:41.815802 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1297/2587] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:33:41 2022] DELETE /identity/v3/projects/2f264d3bfdeb4bf99a1d0a059945fa06 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:41.822213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59275e-6bef-4a52-b2a9-750245a020db None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:41.822716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59275e-6bef-4a52-b2a9-750245a020db None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:41.822814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59275e-6bef-4a52-b2a9-750245a020db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:41.841798 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5d59275e-6bef-4a52-b2a9-750245a020db None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:41.843005 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5d59275e-6bef-4a52-b2a9-750245a020db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:41.903056 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1291/2588] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:33:41.911878 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521d1ea-6b8a-49d9-9ca0-219e51f93427 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:41.912168 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521d1ea-6b8a-49d9-9ca0-219e51f93427 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:41.912443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521d1ea-6b8a-49d9-9ca0-219e51f93427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:41.931079 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c521d1ea-6b8a-49d9-9ca0-219e51f93427 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:41.932306 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c521d1ea-6b8a-49d9-9ca0-219e51f93427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:41.940340 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1298/2589] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:41.945132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59275e-6bef-4a52-b2a9-750245a020db None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:41.954998 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59275e-6bef-4a52-b2a9-750245a020db None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:41.959483 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a427a-0ebd-44b1-a2f0-3c58b1cc7229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:41.960124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a427a-0ebd-44b1-a2f0-3c58b1cc7229 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:41.960402 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a427a-0ebd-44b1-a2f0-3c58b1cc7229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:41.960673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a427a-0ebd-44b1-a2f0-3c58b1cc7229 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:41.961420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a427a-0ebd-44b1-a2f0-3c58b1cc7229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:33:41.961726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a427a-0ebd-44b1-a2f0-3c58b1cc7229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:41.963309 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a427a-0ebd-44b1-a2f0-3c58b1cc7229 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:41.974580 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1292/2590] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:33:41.978618 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521d1ea-6b8a-49d9-9ca0-219e51f93427 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:41.987682 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521d1ea-6b8a-49d9-9ca0-219e51f93427 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:41.992803 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a5a90-78fe-489a-9a1e-4bd8acad95a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:41.993476 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a5a90-78fe-489a-9a1e-4bd8acad95a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:41.993763 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a5a90-78fe-489a-9a1e-4bd8acad95a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:41.994040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a5a90-78fe-489a-9a1e-4bd8acad95a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:41.994721 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a5a90-78fe-489a-9a1e-4bd8acad95a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:41.996610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a5a90-78fe-489a-9a1e-4bd8acad95a5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:42.024797 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1299/2591] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:33:41 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:33:42.025839 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a427a-0ebd-44b1-a2f0-3c58b1cc7229 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:42.035530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a427a-0ebd-44b1-a2f0-3c58b1cc7229 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:42.092090 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98466e-266c-4561-9a35-d0a7d010237c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:42.092708 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98466e-266c-4561-9a35-d0a7d010237c admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:42.093002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98466e-266c-4561-9a35-d0a7d010237c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:42.093285 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98466e-266c-4561-9a35-d0a7d010237c admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:42.093972 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98466e-266c-4561-9a35-d0a7d010237c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:42.095871 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98466e-266c-4561-9a35-d0a7d010237c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:42.110403 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:42.118037 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1293/2592] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:33:42 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:33:42.122025 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a5a90-78fe-489a-9a1e-4bd8acad95a5 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:42.132898 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a5a90-78fe-489a-9a1e-4bd8acad95a5 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:42.137595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed1471-1e01-4514-ab85-abed6508520f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:42.138244 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed1471-1e01-4514-ab85-abed6508520f admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:42.138527 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed1471-1e01-4514-ab85-abed6508520f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:42.138798 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed1471-1e01-4514-ab85-abed6508520f admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:42.139519 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed1471-1e01-4514-ab85-abed6508520f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:42.141136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed1471-1e01-4514-ab85-abed6508520f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:42.151925 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1300/2593] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:33:42.155612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98466e-266c-4561-9a35-d0a7d010237c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:42.165180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98466e-266c-4561-9a35-d0a7d010237c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:42.169777 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1360734-23a5-493e-b280-103dc26f8c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:42.170418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1360734-23a5-493e-b280-103dc26f8c9a admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:42.170698 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1360734-23a5-493e-b280-103dc26f8c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:42.170970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1360734-23a5-493e-b280-103dc26f8c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:42.171689 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1360734-23a5-493e-b280-103dc26f8c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:42.173273 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1360734-23a5-493e-b280-103dc26f8c9a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:42.182988 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1294/2594] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:33:42.186834 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed1471-1e01-4514-ab85-abed6508520f admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:42.197561 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed1471-1e01-4514-ab85-abed6508520f admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:42.202462 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c51117-1283-4e02-9826-0e5673a5d8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:42.203325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c51117-1283-4e02-9826-0e5673a5d8be admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:42.203605 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c51117-1283-4e02-9826-0e5673a5d8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:42.203877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c51117-1283-4e02-9826-0e5673a5d8be admin admin] PATH_INFO: `/v3/projects/0331ad563ca1439fadb5c0948ab0d042/users/97ec4f8f7bc249ba83ff70371cbf0790/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:42.218901 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c51117-1283-4e02-9826-0e5673a5d8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=0331ad563ca1439fadb5c0948ab0d042, user_id=97ec4f8f7bc249ba83ff70371cbf0790, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:42.221566 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c51117-1283-4e02-9826-0e5673a5d8be admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:42.235380 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1301/2595] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:33:42 2022] PUT /identity/v3/projects/0331ad563ca1439fadb5c0948ab0d042/users/97ec4f8f7bc249ba83ff70371cbf0790/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:42.245736 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f5ee4-d22b-43cb-8cf1-d2da1cf16905 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:42.246136 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f5ee4-d22b-43cb-8cf1-d2da1cf16905 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:42.246528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f5ee4-d22b-43cb-8cf1-d2da1cf16905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:42.273766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-019f5ee4-d22b-43cb-8cf1-d2da1cf16905 None None] MFA Rules not processed for user `97ec4f8f7bc249ba83ff70371cbf0790`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:42.274982 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-019f5ee4-d22b-43cb-8cf1-d2da1cf16905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:42.341669 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1295/2596] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:42.346206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c51117-1283-4e02-9826-0e5673a5d8be admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:42.400421 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:42.412249 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c51117-1283-4e02-9826-0e5673a5d8be admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:42.417083 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af099e-0a62-49fd-bc00-cd2ccd312bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:42.417777 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af099e-0a62-49fd-bc00-cd2ccd312bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:42.418090 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af099e-0a62-49fd-bc00-cd2ccd312bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:42.418371 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af099e-0a62-49fd-bc00-cd2ccd312bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:42.419057 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af099e-0a62-49fd-bc00-cd2ccd312bc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:42.420971 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af099e-0a62-49fd-bc00-cd2ccd312bc2 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:42.445920 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1302/2597] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:33:42 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:33:42.450432 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f5ee4-d22b-43cb-8cf1-d2da1cf16905 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:42.461197 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f5ee4-d22b-43cb-8cf1-d2da1cf16905 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:42.516606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03768b10-2a95-4ac2-8139-c8b588aa8f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:42.517292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03768b10-2a95-4ac2-8139-c8b588aa8f2a admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:42.517587 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03768b10-2a95-4ac2-8139-c8b588aa8f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:42.517864 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03768b10-2a95-4ac2-8139-c8b588aa8f2a admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:42.518548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03768b10-2a95-4ac2-8139-c8b588aa8f2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:42.520457 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03768b10-2a95-4ac2-8139-c8b588aa8f2a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:42.540503 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1296/2598] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:33:42 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:33:42.544549 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af099e-0a62-49fd-bc00-cd2ccd312bc2 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:42.555443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af099e-0a62-49fd-bc00-cd2ccd312bc2 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:42.560054 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80f525-2296-40f0-aca9-71180615fdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:42.560703 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80f525-2296-40f0-aca9-71180615fdfb admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:42.560984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80f525-2296-40f0-aca9-71180615fdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:42.561276 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80f525-2296-40f0-aca9-71180615fdfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:42.561995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80f525-2296-40f0-aca9-71180615fdfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:42.563595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80f525-2296-40f0-aca9-71180615fdfb admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:42.575490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1303/2599] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:33:42.579682 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03768b10-2a95-4ac2-8139-c8b588aa8f2a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:42.590078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03768b10-2a95-4ac2-8139-c8b588aa8f2a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:42.594826 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755586a-c682-43ef-b19e-237e0216b9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:42.595701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755586a-c682-43ef-b19e-237e0216b9bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:42.595984 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755586a-c682-43ef-b19e-237e0216b9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:42.596258 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755586a-c682-43ef-b19e-237e0216b9bc admin admin] PATH_INFO: `/v3/projects/c937c10955a2413c96ea5e7da656d092/users/36eef41cd7a745d9a81bc04ac7966f98/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:42.610806 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755586a-c682-43ef-b19e-237e0216b9bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c937c10955a2413c96ea5e7da656d092, user_id=36eef41cd7a745d9a81bc04ac7966f98, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:42.613505 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755586a-c682-43ef-b19e-237e0216b9bc admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:42.626093 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1297/2600] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:33:42 2022] PUT /identity/v3/projects/c937c10955a2413c96ea5e7da656d092/users/36eef41cd7a745d9a81bc04ac7966f98/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:42.629990 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80f525-2296-40f0-aca9-71180615fdfb admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:42.640518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80f525-2296-40f0-aca9-71180615fdfb admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:42.696017 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61106b26-22dd-46ee-a916-ad1313b3f6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:42.696627 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61106b26-22dd-46ee-a916-ad1313b3f6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:42.696892 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61106b26-22dd-46ee-a916-ad1313b3f6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:42.697173 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61106b26-22dd-46ee-a916-ad1313b3f6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:42.697944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61106b26-22dd-46ee-a916-ad1313b3f6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:42.699815 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61106b26-22dd-46ee-a916-ad1313b3f6a8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:42.709438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1304/2601] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:33:42.713546 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755586a-c682-43ef-b19e-237e0216b9bc admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:42.723632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755586a-c682-43ef-b19e-237e0216b9bc admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:42.728409 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00520616-bc03-45a1-b631-72027bf46d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:42.729327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00520616-bc03-45a1-b631-72027bf46d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:42.729615 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00520616-bc03-45a1-b631-72027bf46d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:42.729892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00520616-bc03-45a1-b631-72027bf46d00 admin admin] PATH_INFO: `/v3/projects/c937c10955a2413c96ea5e7da656d092/users/36eef41cd7a745d9a81bc04ac7966f98/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:42.731938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00520616-bc03-45a1-b631-72027bf46d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c937c10955a2413c96ea5e7da656d092, user_id=36eef41cd7a745d9a81bc04ac7966f98, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:42.734628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00520616-bc03-45a1-b631-72027bf46d00 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:42.745303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1298/2602] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:33:42 2022] PUT /identity/v3/projects/c937c10955a2413c96ea5e7da656d092/users/36eef41cd7a745d9a81bc04ac7966f98/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:42.756531 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef97fe-faff-4829-bd04-7ea5149586f0 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:42.756824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef97fe-faff-4829-bd04-7ea5149586f0 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:42.757103 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef97fe-faff-4829-bd04-7ea5149586f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:42.782722 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-24ef97fe-faff-4829-bd04-7ea5149586f0 None None] MFA Rules not processed for user `36eef41cd7a745d9a81bc04ac7966f98`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:42.783924 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-24ef97fe-faff-4829-bd04-7ea5149586f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:42.850967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1305/2603] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:42.861772 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00520616-bc03-45a1-b631-72027bf46d00 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:42.863502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-00520616-bc03-45a1-b631-72027bf46d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:42.894811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:42.920829 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00520616-bc03-45a1-b631-72027bf46d00 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:42.924482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0893d-a033-48c5-87ea-e85c57f1068f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:42.925115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0893d-a033-48c5-87ea-e85c57f1068f service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:42.925434 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0893d-a033-48c5-87ea-e85c57f1068f service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:42.925792 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0893d-a033-48c5-87ea-e85c57f1068f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:42.935181 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0893d-a033-48c5-87ea-e85c57f1068f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:42.936602 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0893d-a033-48c5-87ea-e85c57f1068f service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:42.945985 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1299/2604] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:33:43.072480 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef97fe-faff-4829-bd04-7ea5149586f0 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:43.119980 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:43.134069 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef97fe-faff-4829-bd04-7ea5149586f0 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:43.138595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651afe94-2359-47de-b36d-6ac892bc6027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:43.139464 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651afe94-2359-47de-b36d-6ac892bc6027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:43.139744 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651afe94-2359-47de-b36d-6ac892bc6027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:43.140018 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651afe94-2359-47de-b36d-6ac892bc6027 admin admin] PATH_INFO: `/v3/users/97ec4f8f7bc249ba83ff70371cbf0790` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:43.141201 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651afe94-2359-47de-b36d-6ac892bc6027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ec4f8f7bc249ba83ff70371cbf0790)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:43.143140 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651afe94-2359-47de-b36d-6ac892bc6027 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:43.188231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-651afe94-2359-47de-b36d-6ac892bc6027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ec4f8f7bc249ba83ff70371cbf0790'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:43.188868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-651afe94-2359-47de-b36d-6ac892bc6027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ec4f8f7bc249ba83ff70371cbf0790'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:43.201533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-651afe94-2359-47de-b36d-6ac892bc6027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ec4f8f7bc249ba83ff70371cbf0790'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:43.208821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-651afe94-2359-47de-b36d-6ac892bc6027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ec4f8f7bc249ba83ff70371cbf0790'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:43.209429 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-651afe94-2359-47de-b36d-6ac892bc6027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ec4f8f7bc249ba83ff70371cbf0790'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:43.221477 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1306/2605] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:33:43 2022] DELETE /identity/v3/users/97ec4f8f7bc249ba83ff70371cbf0790 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:43.226762 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11128f86-b2f0-4825-aa93-5950d7fc23ed None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:43.227054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11128f86-b2f0-4825-aa93-5950d7fc23ed None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:43.227365 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11128f86-b2f0-4825-aa93-5950d7fc23ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:43.244124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-11128f86-b2f0-4825-aa93-5950d7fc23ed None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:43.245347 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-11128f86-b2f0-4825-aa93-5950d7fc23ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:43.302577 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1300/2606] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:43.312100 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651afe94-2359-47de-b36d-6ac892bc6027 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:43.313507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-651afe94-2359-47de-b36d-6ac892bc6027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:43.377273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651afe94-2359-47de-b36d-6ac892bc6027 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:43.380970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e351d5-ee91-4cb4-bdb3-9719854dc790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:43.381649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e351d5-ee91-4cb4-bdb3-9719854dc790 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:43.381928 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e351d5-ee91-4cb4-bdb3-9719854dc790 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:43.382199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e351d5-ee91-4cb4-bdb3-9719854dc790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:43.391308 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e351d5-ee91-4cb4-bdb3-9719854dc790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:43.392792 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e351d5-ee91-4cb4-bdb3-9719854dc790 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:43.404426 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1307/2607] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:33:43.781143 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11128f86-b2f0-4825-aa93-5950d7fc23ed None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:43.782608 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-11128f86-b2f0-4825-aa93-5950d7fc23ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:43.795522 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11128f86-b2f0-4825-aa93-5950d7fc23ed None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:43.800417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b44237-97da-4e4b-afb1-9166ec0c253a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:43.801481 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b44237-97da-4e4b-afb1-9166ec0c253a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:43.801767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b44237-97da-4e4b-afb1-9166ec0c253a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:43.802124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b44237-97da-4e4b-afb1-9166ec0c253a admin admin] PATH_INFO: `/v3/projects/0331ad563ca1439fadb5c0948ab0d042` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:43.803333 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b44237-97da-4e4b-afb1-9166ec0c253a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0331ad563ca1439fadb5c0948ab0d042)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:43.805407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b44237-97da-4e4b-afb1-9166ec0c253a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:43.867303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-44b44237-97da-4e4b-afb1-9166ec0c253a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0331ad563ca1439fadb5c0948ab0d042', 'request_id': 'req-44b44237-97da-4e4b-afb1-9166ec0c253a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:43.872923 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-44b44237-97da-4e4b-afb1-9166ec0c253a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0331ad563ca1439fadb5c0948ab0d042', 'request_id': 'req-44b44237-97da-4e4b-afb1-9166ec0c253a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:43.879682 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-44b44237-97da-4e4b-afb1-9166ec0c253a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0331ad563ca1439fadb5c0948ab0d042', 'request_id': 'req-44b44237-97da-4e4b-afb1-9166ec0c253a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:43.892270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-44b44237-97da-4e4b-afb1-9166ec0c253a admin admin] The token cache is being invalidate because project 0331ad563ca1439fadb5c0948ab0d042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:33:43.892563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-44b44237-97da-4e4b-afb1-9166ec0c253a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:43.893206 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-44b44237-97da-4e4b-afb1-9166ec0c253a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:43.894754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1301/2608] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:33:43 2022] DELETE /identity/v3/projects/0331ad563ca1439fadb5c0948ab0d042 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:33:43.899371 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e351d5-ee91-4cb4-bdb3-9719854dc790 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:43.909549 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e351d5-ee91-4cb4-bdb3-9719854dc790 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:43.968615 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547c79d-1379-4e2a-adb6-788d69fc87c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:43.969521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547c79d-1379-4e2a-adb6-788d69fc87c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:43.969801 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547c79d-1379-4e2a-adb6-788d69fc87c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:43.970076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547c79d-1379-4e2a-adb6-788d69fc87c2 admin admin] PATH_INFO: `/v3/users/36eef41cd7a745d9a81bc04ac7966f98` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:43.971271 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547c79d-1379-4e2a-adb6-788d69fc87c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36eef41cd7a745d9a81bc04ac7966f98)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:43.973241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547c79d-1379-4e2a-adb6-788d69fc87c2 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:43.985287 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:44.020236 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a547c79d-1379-4e2a-adb6-788d69fc87c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36eef41cd7a745d9a81bc04ac7966f98'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:44.020889 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a547c79d-1379-4e2a-adb6-788d69fc87c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36eef41cd7a745d9a81bc04ac7966f98'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:44.032876 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a547c79d-1379-4e2a-adb6-788d69fc87c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36eef41cd7a745d9a81bc04ac7966f98'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:44.039524 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a547c79d-1379-4e2a-adb6-788d69fc87c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36eef41cd7a745d9a81bc04ac7966f98'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:44.040153 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a547c79d-1379-4e2a-adb6-788d69fc87c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36eef41cd7a745d9a81bc04ac7966f98'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:44.052960 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1308/2609] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:33:43 2022] DELETE /identity/v3/users/36eef41cd7a745d9a81bc04ac7966f98 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:44.349455 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b44237-97da-4e4b-afb1-9166ec0c253a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:44.350892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-44b44237-97da-4e4b-afb1-9166ec0c253a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:44.364139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b44237-97da-4e4b-afb1-9166ec0c253a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:44.416208 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:44.424329 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f474e82-ca93-415f-bfc9-132f01efc3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:44.425438 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f474e82-ca93-415f-bfc9-132f01efc3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:44.425875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f474e82-ca93-415f-bfc9-132f01efc3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:44.426211 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f474e82-ca93-415f-bfc9-132f01efc3aa admin admin] PATH_INFO: `/v3/projects/c937c10955a2413c96ea5e7da656d092` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:44.427609 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f474e82-ca93-415f-bfc9-132f01efc3aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c937c10955a2413c96ea5e7da656d092)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:44.429566 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f474e82-ca93-415f-bfc9-132f01efc3aa admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:44.475665 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8f474e82-ca93-415f-bfc9-132f01efc3aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c937c10955a2413c96ea5e7da656d092', 'request_id': 'req-8f474e82-ca93-415f-bfc9-132f01efc3aa'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:44.481141 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8f474e82-ca93-415f-bfc9-132f01efc3aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c937c10955a2413c96ea5e7da656d092', 'request_id': 'req-8f474e82-ca93-415f-bfc9-132f01efc3aa'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:44.487930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8f474e82-ca93-415f-bfc9-132f01efc3aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c937c10955a2413c96ea5e7da656d092', 'request_id': 'req-8f474e82-ca93-415f-bfc9-132f01efc3aa'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:44.499899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8f474e82-ca93-415f-bfc9-132f01efc3aa admin admin] The token cache is being invalidate because project c937c10955a2413c96ea5e7da656d092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:33:44.500189 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8f474e82-ca93-415f-bfc9-132f01efc3aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:44.500827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8f474e82-ca93-415f-bfc9-132f01efc3aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:44.502389 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1302/2610] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:33:44 2022] DELETE /identity/v3/projects/c937c10955a2413c96ea5e7da656d092 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:44.507814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006aba3-5219-4bb0-bebe-4a43f46d523b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:44.508139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006aba3-5219-4bb0-bebe-4a43f46d523b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:44.508424 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006aba3-5219-4bb0-bebe-4a43f46d523b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:44.527202 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a006aba3-5219-4bb0-bebe-4a43f46d523b None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:44.528384 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a006aba3-5219-4bb0-bebe-4a43f46d523b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:44.586405 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1309/2611] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:44.594514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d940cc-6bb4-4b20-849d-a63fa29af544 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:44.594803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d940cc-6bb4-4b20-849d-a63fa29af544 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:44.595081 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d940cc-6bb4-4b20-849d-a63fa29af544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:44.613830 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c3d940cc-6bb4-4b20-849d-a63fa29af544 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:44.615032 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c3d940cc-6bb4-4b20-849d-a63fa29af544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:44.622817 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1303/2612] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:44.627003 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006aba3-5219-4bb0-bebe-4a43f46d523b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:44.637273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006aba3-5219-4bb0-bebe-4a43f46d523b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:44.641941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846524f-facf-42a5-827b-f98617dfb88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:44.642589 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846524f-facf-42a5-827b-f98617dfb88c admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:44.642875 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846524f-facf-42a5-827b-f98617dfb88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:44.643154 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846524f-facf-42a5-827b-f98617dfb88c admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:44.643881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846524f-facf-42a5-827b-f98617dfb88c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:33:44.644190 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846524f-facf-42a5-827b-f98617dfb88c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:44.646516 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846524f-facf-42a5-827b-f98617dfb88c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:44.658330 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1310/2613] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:33:44.662413 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d940cc-6bb4-4b20-849d-a63fa29af544 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:44.671648 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d940cc-6bb4-4b20-849d-a63fa29af544 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:44.676286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc89a9-ad3a-49bc-8eb2-1855b82833df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:44.677481 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc89a9-ad3a-49bc-8eb2-1855b82833df admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:44.677764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc89a9-ad3a-49bc-8eb2-1855b82833df admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:44.678035 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc89a9-ad3a-49bc-8eb2-1855b82833df admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:44.678719 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc89a9-ad3a-49bc-8eb2-1855b82833df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:44.680608 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc89a9-ad3a-49bc-8eb2-1855b82833df admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:44.707670 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1304/2614] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:33:44 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:33:44.711905 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846524f-facf-42a5-827b-f98617dfb88c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:44.722001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846524f-facf-42a5-827b-f98617dfb88c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:44.779624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeff863-9ce1-4862-b337-6dcc7bda33b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:44.780302 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeff863-9ce1-4862-b337-6dcc7bda33b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:44.780588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeff863-9ce1-4862-b337-6dcc7bda33b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:44.780865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeff863-9ce1-4862-b337-6dcc7bda33b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:44.781597 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeff863-9ce1-4862-b337-6dcc7bda33b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:44.783580 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeff863-9ce1-4862-b337-6dcc7bda33b0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:44.805320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1311/2615] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:33:44 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:33:44.809612 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc89a9-ad3a-49bc-8eb2-1855b82833df admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:44.820315 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc89a9-ad3a-49bc-8eb2-1855b82833df admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:44.825171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7e9ad-3b12-4be7-8010-8dd1829d75e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:44.825848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7e9ad-3b12-4be7-8010-8dd1829d75e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:44.826128 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7e9ad-3b12-4be7-8010-8dd1829d75e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:44.826400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7e9ad-3b12-4be7-8010-8dd1829d75e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:44.827116 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7e9ad-3b12-4be7-8010-8dd1829d75e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:44.828683 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7e9ad-3b12-4be7-8010-8dd1829d75e3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:44.839259 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1305/2616] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:33:44.843041 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeff863-9ce1-4862-b337-6dcc7bda33b0 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:44.853401 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeff863-9ce1-4862-b337-6dcc7bda33b0 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:44.858037 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1906e-4165-4e77-b603-434312b6694d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:44.858728 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1906e-4165-4e77-b603-434312b6694d admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:44.858971 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1906e-4165-4e77-b603-434312b6694d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:44.859297 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1906e-4165-4e77-b603-434312b6694d admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:44.860022 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1906e-4165-4e77-b603-434312b6694d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:44.861653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1906e-4165-4e77-b603-434312b6694d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:44.863334 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:44.875057 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1312/2617] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:33:44.879458 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7e9ad-3b12-4be7-8010-8dd1829d75e3 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:44.890327 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7e9ad-3b12-4be7-8010-8dd1829d75e3 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:44.895458 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c3544-b257-4f0d-950d-31d1c980fbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:44.896701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c3544-b257-4f0d-950d-31d1c980fbc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:44.896915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c3544-b257-4f0d-950d-31d1c980fbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:44.897193 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c3544-b257-4f0d-950d-31d1c980fbc2 admin admin] PATH_INFO: `/v3/projects/84a8c2c11b6042c9a0084e37718128f8/users/d12fde0e820c4817b0d3151f503d3959/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:44.912503 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c3544-b257-4f0d-950d-31d1c980fbc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a8c2c11b6042c9a0084e37718128f8, user_id=d12fde0e820c4817b0d3151f503d3959, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:44.915254 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c3544-b257-4f0d-950d-31d1c980fbc2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:44.929163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1306/2618] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:33:44 2022] PUT /identity/v3/projects/84a8c2c11b6042c9a0084e37718128f8/users/d12fde0e820c4817b0d3151f503d3959/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:44.940080 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb45f6-2557-4426-8328-efcc77d01829 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:44.940477 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb45f6-2557-4426-8328-efcc77d01829 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:44.940672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb45f6-2557-4426-8328-efcc77d01829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:44.969412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-cdfb45f6-2557-4426-8328-efcc77d01829 None None] MFA Rules not processed for user `d12fde0e820c4817b0d3151f503d3959`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:44.970656 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-cdfb45f6-2557-4426-8328-efcc77d01829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:45.043479 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1313/2619] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:45.056994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c3544-b257-4f0d-950d-31d1c980fbc2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:45.058856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ff2c3544-b257-4f0d-950d-31d1c980fbc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:45.121207 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c3544-b257-4f0d-950d-31d1c980fbc2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:45.124925 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cad73c-a912-4507-8387-b661a296e986 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:45.125610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cad73c-a912-4507-8387-b661a296e986 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:45.125895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cad73c-a912-4507-8387-b661a296e986 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:45.126172 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cad73c-a912-4507-8387-b661a296e986 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:45.134951 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cad73c-a912-4507-8387-b661a296e986 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:45.136914 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cad73c-a912-4507-8387-b661a296e986 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:45.146828 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1307/2620] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:33:45.293725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb45f6-2557-4426-8328-efcc77d01829 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:45.295270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-cdfb45f6-2557-4426-8328-efcc77d01829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:45.357913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb45f6-2557-4426-8328-efcc77d01829 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:45.362225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d7d48-3648-49ba-8cfd-86de81698b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:45.362856 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d7d48-3648-49ba-8cfd-86de81698b39 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:45.363144 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d7d48-3648-49ba-8cfd-86de81698b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:45.363428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d7d48-3648-49ba-8cfd-86de81698b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:45.366245 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7a2d7d48-3648-49ba-8cfd-86de81698b39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:45.377897 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d7d48-3648-49ba-8cfd-86de81698b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:45.379393 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d7d48-3648-49ba-8cfd-86de81698b39 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:45.388890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1314/2621] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:33:45.544736 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c6cc8-cc0e-48f0-9ac4-352d1a32c0b3 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:45.545025 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c6cc8-cc0e-48f0-9ac4-352d1a32c0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:45.545360 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c6cc8-cc0e-48f0-9ac4-352d1a32c0b3 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:45.546810 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1308/2622] 10.222.0.57 () {54 vars in 921 bytes} [Tue Jul 12 18:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:33:45.554624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23358c-f991-47ab-be67-b6ef2de9373a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:45.555014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23358c-f991-47ab-be67-b6ef2de9373a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:45.555177 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23358c-f991-47ab-be67-b6ef2de9373a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:45.586536 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2a23358c-f991-47ab-be67-b6ef2de9373a None None] MFA Rules not processed for user `a7c1bb51c2b642ffa4708122d826fc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:45.587679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2a23358c-f991-47ab-be67-b6ef2de9373a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:45.671294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1315/2623] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Jul 12 18:33:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:45.681281 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c6cc8-cc0e-48f0-9ac4-352d1a32c0b3 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:45.682220 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a51c6cc8-cc0e-48f0-9ac4-352d1a32c0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:45.713085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:45.746415 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c6cc8-cc0e-48f0-9ac4-352d1a32c0b3 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:45.749960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c963189-7549-4d75-956c-cca80fd316cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5602d0a51329412ab6e908e7787531a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:45.750598 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c963189-7549-4d75-956c-cca80fd316cc service glance] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:45.750883 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c963189-7549-4d75-956c-cca80fd316cc service glance] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:45.751446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c963189-7549-4d75-956c-cca80fd316cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:45.763155 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c963189-7549-4d75-956c-cca80fd316cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:45.764597 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c963189-7549-4d75-956c-cca80fd316cc service glance] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:45.775883 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1309/2624] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:33:45.843767 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618373c-4a5d-4bd0-bb85-4a745286c50b None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:45.844005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618373c-4a5d-4bd0-bb85-4a745286c50b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:45.844283 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618373c-4a5d-4bd0-bb85-4a745286c50b None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:45.845754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1316/2625] 10.222.0.57 () {54 vars in 921 bytes} [Tue Jul 12 18:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:33:45.850883 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d23ef-c2f9-4c7a-aee7-e72cdd02b750 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:45.851163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d23ef-c2f9-4c7a-aee7-e72cdd02b750 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:45.851441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d23ef-c2f9-4c7a-aee7-e72cdd02b750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:45.870843 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-f68d23ef-c2f9-4c7a-aee7-e72cdd02b750 None None] MFA Rules not processed for user `b6dc63ae259842209831040cbf45d316`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:45.872118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f68d23ef-c2f9-4c7a-aee7-e72cdd02b750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:45.882565 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1310/2626] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Jul 12 18:33:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:45.897483 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618373c-4a5d-4bd0-bb85-4a745286c50b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:45.899190 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5618373c-4a5d-4bd0-bb85-4a745286c50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:45.912856 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618373c-4a5d-4bd0-bb85-4a745286c50b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:45.916482 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a179459-f2cb-4881-89f1-6c8cb8d40a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:45.917118 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a179459-f2cb-4881-89f1-6c8cb8d40a75 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:45.917438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a179459-f2cb-4881-89f1-6c8cb8d40a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:45.917719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a179459-f2cb-4881-89f1-6c8cb8d40a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:45.924864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a179459-f2cb-4881-89f1-6c8cb8d40a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:45.926335 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a179459-f2cb-4881-89f1-6c8cb8d40a75 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:45.934297 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1317/2627] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:33:46.015777 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9bd38-81be-486a-a969-2064239112e4 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:46.016064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9bd38-81be-486a-a969-2064239112e4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:46.016421 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9bd38-81be-486a-a969-2064239112e4 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:46.017845 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1311/2628] 10.222.0.57 () {54 vars in 921 bytes} [Tue Jul 12 18:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:33:46.023818 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56df9f-679e-4229-ad53-89ec0e8bec12 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:46.024259 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56df9f-679e-4229-ad53-89ec0e8bec12 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:46.024457 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56df9f-679e-4229-ad53-89ec0e8bec12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:46.036829 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=100 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:46.042866 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8f56df9f-679e-4229-ad53-89ec0e8bec12 None None] MFA Rules not processed for user `a7c1bb51c2b642ffa4708122d826fc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:46.044049 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8f56df9f-679e-4229-ad53-89ec0e8bec12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:46.053144 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1318/2629] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Jul 12 18:33:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:46.063289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9bd38-81be-486a-a969-2064239112e4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:46.075193 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9bd38-81be-486a-a969-2064239112e4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:46.078772 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6a561-dce0-4672-aa27-548ca21e40c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:46.079434 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6a561-dce0-4672-aa27-548ca21e40c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:46.079714 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6a561-dce0-4672-aa27-548ca21e40c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:46.079988 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6a561-dce0-4672-aa27-548ca21e40c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:46.090844 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6a561-dce0-4672-aa27-548ca21e40c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:46.092262 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6a561-dce0-4672-aa27-548ca21e40c3 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:46.102863 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1312/2630] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:33:46.161743 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56df9f-679e-4229-ad53-89ec0e8bec12 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:46.163139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8f56df9f-679e-4229-ad53-89ec0e8bec12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:46.233071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56df9f-679e-4229-ad53-89ec0e8bec12 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:46.238260 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de247a7-610c-45bd-b0a5-8778eb38fe30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206242c775be40c7b96af6de635e2065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:46.238909 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de247a7-610c-45bd-b0a5-8778eb38fe30 service placement] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:46.239684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de247a7-610c-45bd-b0a5-8778eb38fe30 service placement] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:46.239969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de247a7-610c-45bd-b0a5-8778eb38fe30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:46.241825 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3de247a7-610c-45bd-b0a5-8778eb38fe30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:46.253380 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de247a7-610c-45bd-b0a5-8778eb38fe30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:46.255620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de247a7-610c-45bd-b0a5-8778eb38fe30 service placement] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:46.265570 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1319/2631] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:33:48.162783 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6a561-dce0-4672-aa27-548ca21e40c3 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:48.227943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6a561-dce0-4672-aa27-548ca21e40c3 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:48.232453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5c61d-8f8b-4a9c-a819-e5cc0f5d357d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:48.233380 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5c61d-8f8b-4a9c-a819-e5cc0f5d357d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:48.233695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5c61d-8f8b-4a9c-a819-e5cc0f5d357d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:48.233974 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5c61d-8f8b-4a9c-a819-e5cc0f5d357d admin admin] PATH_INFO: `/v3/users/d12fde0e820c4817b0d3151f503d3959` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:48.235174 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5c61d-8f8b-4a9c-a819-e5cc0f5d357d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d12fde0e820c4817b0d3151f503d3959)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:48.237100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5c61d-8f8b-4a9c-a819-e5cc0f5d357d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:48.285756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d8f5c61d-8f8b-4a9c-a819-e5cc0f5d357d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd12fde0e820c4817b0d3151f503d3959'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:48.287118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d8f5c61d-8f8b-4a9c-a819-e5cc0f5d357d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd12fde0e820c4817b0d3151f503d3959'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:48.294837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d8f5c61d-8f8b-4a9c-a819-e5cc0f5d357d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd12fde0e820c4817b0d3151f503d3959'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:48.295409 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d8f5c61d-8f8b-4a9c-a819-e5cc0f5d357d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd12fde0e820c4817b0d3151f503d3959'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:48.303000 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d8f5c61d-8f8b-4a9c-a819-e5cc0f5d357d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd12fde0e820c4817b0d3151f503d3959'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:48.320278 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1313/2632] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:33:48 2022] DELETE /identity/v3/users/d12fde0e820c4817b0d3151f503d3959 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:48.325190 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b33aae-8690-4e9e-95d0-3f4f2f610520 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:48.325776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b33aae-8690-4e9e-95d0-3f4f2f610520 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:48.325776 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b33aae-8690-4e9e-95d0-3f4f2f610520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:48.342374 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-35b33aae-8690-4e9e-95d0-3f4f2f610520 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:48.343566 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-35b33aae-8690-4e9e-95d0-3f4f2f610520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:48.403274 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1320/2633] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:48.413464 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5c61d-8f8b-4a9c-a819-e5cc0f5d357d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:48.414933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d8f5c61d-8f8b-4a9c-a819-e5cc0f5d357d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:48.445299 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:48.475221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5c61d-8f8b-4a9c-a819-e5cc0f5d357d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:48.478860 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d813a19-d60b-4932-874f-63478523ad5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:48.479509 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d813a19-d60b-4932-874f-63478523ad5c service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:48.479788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d813a19-d60b-4932-874f-63478523ad5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:48.480062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d813a19-d60b-4932-874f-63478523ad5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:48.489172 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d813a19-d60b-4932-874f-63478523ad5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:48.490643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d813a19-d60b-4932-874f-63478523ad5c service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:48.500397 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1314/2634] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:33:48.811449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b33aae-8690-4e9e-95d0-3f4f2f610520 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:48.812991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-35b33aae-8690-4e9e-95d0-3f4f2f610520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:48.827397 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b33aae-8690-4e9e-95d0-3f4f2f610520 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:48.832659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707437fc-93ad-4117-86ee-9dd4baf92f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:48.834158 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707437fc-93ad-4117-86ee-9dd4baf92f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:48.834510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707437fc-93ad-4117-86ee-9dd4baf92f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:48.835268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707437fc-93ad-4117-86ee-9dd4baf92f47 admin admin] PATH_INFO: `/v3/projects/84a8c2c11b6042c9a0084e37718128f8` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:48.848657 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707437fc-93ad-4117-86ee-9dd4baf92f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84a8c2c11b6042c9a0084e37718128f8)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:48.850650 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707437fc-93ad-4117-86ee-9dd4baf92f47 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:48.877198 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e386ea6-d291-4336-9910-e38e8ecd14d7 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:48.877636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e386ea6-d291-4336-9910-e38e8ecd14d7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:48.878109 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e386ea6-d291-4336-9910-e38e8ecd14d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:48.901133 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5e386ea6-d291-4336-9910-e38e8ecd14d7 None None] MFA Rules not processed for user `54189575a60a4d9dbaabb78d44e9c31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:48.902477 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5e386ea6-d291-4336-9910-e38e8ecd14d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:48.921174 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-707437fc-93ad-4117-86ee-9dd4baf92f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a8c2c11b6042c9a0084e37718128f8', 'request_id': 'req-707437fc-93ad-4117-86ee-9dd4baf92f47'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:48.932411 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-707437fc-93ad-4117-86ee-9dd4baf92f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a8c2c11b6042c9a0084e37718128f8', 'request_id': 'req-707437fc-93ad-4117-86ee-9dd4baf92f47'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:48.940058 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-707437fc-93ad-4117-86ee-9dd4baf92f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a8c2c11b6042c9a0084e37718128f8', 'request_id': 'req-707437fc-93ad-4117-86ee-9dd4baf92f47'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:48.953800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-707437fc-93ad-4117-86ee-9dd4baf92f47 admin admin] The token cache is being invalidate because project 84a8c2c11b6042c9a0084e37718128f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:33:48.954168 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-707437fc-93ad-4117-86ee-9dd4baf92f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:48.954943 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-707437fc-93ad-4117-86ee-9dd4baf92f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:48.957050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1321/2635] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:33:48 2022] DELETE /identity/v3/projects/84a8c2c11b6042c9a0084e37718128f8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:48.960460 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1315/2636] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Jul 12 18:33:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:33:48.962311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ba9db-a396-470f-ba9a-c8b19327088e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:48.962602 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ba9db-a396-470f-ba9a-c8b19327088e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:48.963009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ba9db-a396-470f-ba9a-c8b19327088e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:48.974812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e386ea6-d291-4336-9910-e38e8ecd14d7 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:48.976533 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5e386ea6-d291-4336-9910-e38e8ecd14d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:48.982902 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ed4ba9db-a396-470f-ba9a-c8b19327088e None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:48.984134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ed4ba9db-a396-470f-ba9a-c8b19327088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:48.993928 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:49.051361 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e386ea6-d291-4336-9910-e38e8ecd14d7 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:49.056345 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1322/2637] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:49.064961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353ea0-c7c7-4f32-9d94-b95d6914e199 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:49.065290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353ea0-c7c7-4f32-9d94-b95d6914e199 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:49.065812 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353ea0-c7c7-4f32-9d94-b95d6914e199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:49.094562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8e353ea0-c7c7-4f32-9d94-b95d6914e199 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:49.096163 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8e353ea0-c7c7-4f32-9d94-b95d6914e199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:49.107849 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1323/2638] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:33:49.112028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e353ea0-c7c7-4f32-9d94-b95d6914e199 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:49.122194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e353ea0-c7c7-4f32-9d94-b95d6914e199 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:49.127375 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b474f-1759-498f-9508-e508a5bd65f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:49.128154 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b474f-1759-498f-9508-e508a5bd65f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:49.128566 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b474f-1759-498f-9508-e508a5bd65f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:49.128936 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b474f-1759-498f-9508-e508a5bd65f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:49.129107 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df381c-76a2-4fb7-ad45-09d539914204 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ade969d7aa3d49c08782a68ec5997382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:49.130444 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df381c-76a2-4fb7-ad45-09d539914204 service swift] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:49.130583 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b474f-1759-498f-9508-e508a5bd65f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:33:49.130870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df381c-76a2-4fb7-ad45-09d539914204 service swift] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:49.131030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b474f-1759-498f-9508-e508a5bd65f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:49.131128 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df381c-76a2-4fb7-ad45-09d539914204 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:49.132800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b474f-1759-498f-9508-e508a5bd65f1 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:49.151786 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1324/2639] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:33:49.152002 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=100 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:49.153726 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b474f-1759-498f-9508-e508a5bd65f1 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:49.165185 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b474f-1759-498f-9508-e508a5bd65f1 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:49.170633 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4d422-ae33-4200-a9a3-816102d7d05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:49.171824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4d422-ae33-4200-a9a3-816102d7d05b admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:49.171824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4d422-ae33-4200-a9a3-816102d7d05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:49.171824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4d422-ae33-4200-a9a3-816102d7d05b admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:49.172480 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4d422-ae33-4200-a9a3-816102d7d05b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:49.174426 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4d422-ae33-4200-a9a3-816102d7d05b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:49.202017 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df381c-76a2-4fb7-ad45-09d539914204 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:49.203675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df381c-76a2-4fb7-ad45-09d539914204 service swift] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:49.208442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1325/2640] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:33:49 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:33:49.209509 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4d422-ae33-4200-a9a3-816102d7d05b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:49.214086 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1316/2641] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Jul 12 18:33:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:33:49.282704 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4d422-ae33-4200-a9a3-816102d7d05b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:49.287976 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46dc0a-66c0-40f3-93fc-63c9905bcb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:49.289024 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46dc0a-66c0-40f3-93fc-63c9905bcb5f admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:49.289442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46dc0a-66c0-40f3-93fc-63c9905bcb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:49.289814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46dc0a-66c0-40f3-93fc-63c9905bcb5f admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:49.291429 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46dc0a-66c0-40f3-93fc-63c9905bcb5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:49.293085 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46dc0a-66c0-40f3-93fc-63c9905bcb5f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:49.321883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1326/2642] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:33:49 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:33:49.327965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df381c-76a2-4fb7-ad45-09d539914204 service swift] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:49.344152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df381c-76a2-4fb7-ad45-09d539914204 service swift] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:49.350623 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e6932-77ff-4511-bad0-ad36a471dae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:49.351631 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e6932-77ff-4511-bad0-ad36a471dae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:49.352231 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e6932-77ff-4511-bad0-ad36a471dae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:49.352600 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e6932-77ff-4511-bad0-ad36a471dae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:49.354746 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e6932-77ff-4511-bad0-ad36a471dae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:49.356955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e6932-77ff-4511-bad0-ad36a471dae9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:49.372769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1317/2643] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:33:49.377029 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46dc0a-66c0-40f3-93fc-63c9905bcb5f admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:49.394533 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46dc0a-66c0-40f3-93fc-63c9905bcb5f admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:49.402875 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044f5e6-30c8-42e6-a353-35f3c36bbdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:49.403562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044f5e6-30c8-42e6-a353-35f3c36bbdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:49.403847 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044f5e6-30c8-42e6-a353-35f3c36bbdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:49.404134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044f5e6-30c8-42e6-a353-35f3c36bbdc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:49.409119 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044f5e6-30c8-42e6-a353-35f3c36bbdc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:49.410819 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044f5e6-30c8-42e6-a353-35f3c36bbdc7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:49.434239 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1327/2644] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:33:49.440424 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e6932-77ff-4511-bad0-ad36a471dae9 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:49.463037 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e6932-77ff-4511-bad0-ad36a471dae9 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:49.468373 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07c7ba-6df1-42ae-a3d8-4cbda753af3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:49.469454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07c7ba-6df1-42ae-a3d8-4cbda753af3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:49.469865 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07c7ba-6df1-42ae-a3d8-4cbda753af3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:49.470548 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07c7ba-6df1-42ae-a3d8-4cbda753af3c admin admin] PATH_INFO: `/v3/projects/119c14cbc60a4351a587037d9fe0ca7f/users/10070a6e57b6492cbd26f5a0d880fdb6/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:49.488790 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07c7ba-6df1-42ae-a3d8-4cbda753af3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=119c14cbc60a4351a587037d9fe0ca7f, user_id=10070a6e57b6492cbd26f5a0d880fdb6, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:49.492288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07c7ba-6df1-42ae-a3d8-4cbda753af3c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:49.522106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1318/2645] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:33:49 2022] PUT /identity/v3/projects/119c14cbc60a4351a587037d9fe0ca7f/users/10070a6e57b6492cbd26f5a0d880fdb6/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:49.532593 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274cf9b-f338-49a7-bab2-07f1b5cae0c1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:49.532935 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274cf9b-f338-49a7-bab2-07f1b5cae0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:49.533176 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274cf9b-f338-49a7-bab2-07f1b5cae0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:49.583060 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2274cf9b-f338-49a7-bab2-07f1b5cae0c1 None None] MFA Rules not processed for user `10070a6e57b6492cbd26f5a0d880fdb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:49.584396 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2274cf9b-f338-49a7-bab2-07f1b5cae0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:49.658551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:49.701966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1328/2646] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:49.706476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07c7ba-6df1-42ae-a3d8-4cbda753af3c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:49.784034 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07c7ba-6df1-42ae-a3d8-4cbda753af3c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:49.790767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6454c-3e3d-4c6f-9292-4e511079beb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:49.791563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6454c-3e3d-4c6f-9292-4e511079beb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:49.791852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6454c-3e3d-4c6f-9292-4e511079beb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:49.793165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6454c-3e3d-4c6f-9292-4e511079beb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:49.793165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6454c-3e3d-4c6f-9292-4e511079beb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:49.795660 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6454c-3e3d-4c6f-9292-4e511079beb7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:49.827177 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1319/2647] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:33:49 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:33:49.831129 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274cf9b-f338-49a7-bab2-07f1b5cae0c1 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:49.843865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274cf9b-f338-49a7-bab2-07f1b5cae0c1 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:49.911714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bef95-ec04-4d6c-bfff-37c10d7801aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:49.918475 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bef95-ec04-4d6c-bfff-37c10d7801aa admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:49.918762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bef95-ec04-4d6c-bfff-37c10d7801aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:49.919043 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bef95-ec04-4d6c-bfff-37c10d7801aa admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:49.920351 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bef95-ec04-4d6c-bfff-37c10d7801aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:49.922913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bef95-ec04-4d6c-bfff-37c10d7801aa admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:49.957881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1329/2648] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:33:49 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:33:49.961900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6454c-3e3d-4c6f-9292-4e511079beb7 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:49.972604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6454c-3e3d-4c6f-9292-4e511079beb7 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:49.977504 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734d381-5a4b-4af3-912b-6b407d76b9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:49.978174 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734d381-5a4b-4af3-912b-6b407d76b9bf admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:49.978453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734d381-5a4b-4af3-912b-6b407d76b9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:49.978724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734d381-5a4b-4af3-912b-6b407d76b9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:49.979510 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734d381-5a4b-4af3-912b-6b407d76b9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:49.981119 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734d381-5a4b-4af3-912b-6b407d76b9bf admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:49.993820 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1320/2649] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:33:49.998620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bef95-ec04-4d6c-bfff-37c10d7801aa admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:50.018438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bef95-ec04-4d6c-bfff-37c10d7801aa admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:50.023949 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e27332-fa4c-4efc-be1d-17d4e5175704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:50.029409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e27332-fa4c-4efc-be1d-17d4e5175704 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:50.029409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e27332-fa4c-4efc-be1d-17d4e5175704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:50.029409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e27332-fa4c-4efc-be1d-17d4e5175704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:50.029409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e27332-fa4c-4efc-be1d-17d4e5175704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:50.029409 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e27332-fa4c-4efc-be1d-17d4e5175704 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:50.042249 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1330/2650] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:33:50.046553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734d381-5a4b-4af3-912b-6b407d76b9bf admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:50.059139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734d381-5a4b-4af3-912b-6b407d76b9bf admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:50.064358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0c40c-52ab-4cc3-a283-0e0066d9f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:50.065361 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0c40c-52ab-4cc3-a283-0e0066d9f7b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:50.065720 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0c40c-52ab-4cc3-a283-0e0066d9f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:50.066067 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0c40c-52ab-4cc3-a283-0e0066d9f7b0 admin admin] PATH_INFO: `/v3/projects/4fc75fc29cf34a7991da92a60c462d9c/users/e89f98ceef434f138dd6ba07fbd59aad/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:50.084918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0c40c-52ab-4cc3-a283-0e0066d9f7b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc75fc29cf34a7991da92a60c462d9c, user_id=e89f98ceef434f138dd6ba07fbd59aad, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:50.087943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0c40c-52ab-4cc3-a283-0e0066d9f7b0 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:50.102855 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1321/2651] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:33:50 2022] PUT /identity/v3/projects/4fc75fc29cf34a7991da92a60c462d9c/users/e89f98ceef434f138dd6ba07fbd59aad/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:50.113540 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f86453-3df1-4205-9d63-3d035475f3a6 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:50.113832 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f86453-3df1-4205-9d63-3d035475f3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:50.114651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f86453-3df1-4205-9d63-3d035475f3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:50.144426 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c3f86453-3df1-4205-9d63-3d035475f3a6 None None] MFA Rules not processed for user `e89f98ceef434f138dd6ba07fbd59aad`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:50.145754 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c3f86453-3df1-4205-9d63-3d035475f3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:50.217604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1331/2652] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:50.222184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0c40c-52ab-4cc3-a283-0e0066d9f7b0 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:50.267248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:50.298502 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0c40c-52ab-4cc3-a283-0e0066d9f7b0 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:50.306453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5893cc-b3d4-4235-81ab-0e7be58744e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:50.307620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5893cc-b3d4-4235-81ab-0e7be58744e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:50.308169 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5893cc-b3d4-4235-81ab-0e7be58744e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:50.308907 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5893cc-b3d4-4235-81ab-0e7be58744e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:50.310079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5893cc-b3d4-4235-81ab-0e7be58744e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:50.312816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5893cc-b3d4-4235-81ab-0e7be58744e6 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:50.359303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1322/2653] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:33:50 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:33:50.361202 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f86453-3df1-4205-9d63-3d035475f3a6 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:50.374784 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f86453-3df1-4205-9d63-3d035475f3a6 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:50.441027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:50.454922 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30fb6d-e98f-40c6-b701-f6ba9dd83603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:50.455601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30fb6d-e98f-40c6-b701-f6ba9dd83603 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:50.456077 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30fb6d-e98f-40c6-b701-f6ba9dd83603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:50.456576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30fb6d-e98f-40c6-b701-f6ba9dd83603 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:50.457504 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30fb6d-e98f-40c6-b701-f6ba9dd83603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:50.460276 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30fb6d-e98f-40c6-b701-f6ba9dd83603 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:50.487331 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1332/2654] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:33:50 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:33:50.491277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5893cc-b3d4-4235-81ab-0e7be58744e6 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:50.507636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5893cc-b3d4-4235-81ab-0e7be58744e6 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:50.513503 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee64c09-4dfa-472f-8327-478b6e5ea52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:50.514688 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee64c09-4dfa-472f-8327-478b6e5ea52c admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:50.515132 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee64c09-4dfa-472f-8327-478b6e5ea52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:50.515582 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee64c09-4dfa-472f-8327-478b6e5ea52c admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:50.516592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee64c09-4dfa-472f-8327-478b6e5ea52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:50.519032 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee64c09-4dfa-472f-8327-478b6e5ea52c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:50.537380 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1323/2655] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:33:50.541718 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30fb6d-e98f-40c6-b701-f6ba9dd83603 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:50.554332 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30fb6d-e98f-40c6-b701-f6ba9dd83603 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:50.566377 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fcec6-694d-48b8-aeaa-ed527db1584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:50.566997 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fcec6-694d-48b8-aeaa-ed527db1584a admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:50.567822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fcec6-694d-48b8-aeaa-ed527db1584a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:50.568102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fcec6-694d-48b8-aeaa-ed527db1584a admin admin] PATH_INFO: `/v3/projects/fdc88799bdfc4fa3820a851f52f99bf9/users/75fd1150acf04ff5b2288c0c7f8bef53/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:50.595595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87fcec6-694d-48b8-aeaa-ed527db1584a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc88799bdfc4fa3820a851f52f99bf9, user_id=75fd1150acf04ff5b2288c0c7f8bef53, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:50.598554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87fcec6-694d-48b8-aeaa-ed527db1584a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:50.614588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1333/2656] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:33:50 2022] PUT /identity/v3/projects/fdc88799bdfc4fa3820a851f52f99bf9/users/75fd1150acf04ff5b2288c0c7f8bef53/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:33:50.618593 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee64c09-4dfa-472f-8327-478b6e5ea52c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:50.631017 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee64c09-4dfa-472f-8327-478b6e5ea52c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:50.705211 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66f925-7024-48fc-9e62-85cd5e58898c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:50.706181 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66f925-7024-48fc-9e62-85cd5e58898c admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:50.706467 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66f925-7024-48fc-9e62-85cd5e58898c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:50.706745 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66f925-7024-48fc-9e62-85cd5e58898c admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:50.707469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66f925-7024-48fc-9e62-85cd5e58898c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:50.709118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66f925-7024-48fc-9e62-85cd5e58898c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:50.733854 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1324/2657] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:33:50.735356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fcec6-694d-48b8-aeaa-ed527db1584a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:50.747059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fcec6-694d-48b8-aeaa-ed527db1584a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:50.751657 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffdb17-2c8c-4df7-b1ba-dd125bdc2c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:50.752599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffdb17-2c8c-4df7-b1ba-dd125bdc2c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:50.752881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffdb17-2c8c-4df7-b1ba-dd125bdc2c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:50.753156 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffdb17-2c8c-4df7-b1ba-dd125bdc2c3a admin admin] PATH_INFO: `/v3/projects/fdc88799bdfc4fa3820a851f52f99bf9/users/75fd1150acf04ff5b2288c0c7f8bef53/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:50.755812 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffdb17-2c8c-4df7-b1ba-dd125bdc2c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc88799bdfc4fa3820a851f52f99bf9, user_id=75fd1150acf04ff5b2288c0c7f8bef53, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:50.758555 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffdb17-2c8c-4df7-b1ba-dd125bdc2c3a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:50.769510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1334/2658] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:33:50 2022] PUT /identity/v3/projects/fdc88799bdfc4fa3820a851f52f99bf9/users/75fd1150acf04ff5b2288c0c7f8bef53/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:50.837759 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f0b1c-fa13-487b-be6e-1e1fc9f4ca39 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:50.838053 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f0b1c-fa13-487b-be6e-1e1fc9f4ca39 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:50.838338 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f0b1c-fa13-487b-be6e-1e1fc9f4ca39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:50.870126 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-669f0b1c-fa13-487b-be6e-1e1fc9f4ca39 None None] MFA Rules not processed for user `75fd1150acf04ff5b2288c0c7f8bef53`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:50.871372 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-669f0b1c-fa13-487b-be6e-1e1fc9f4ca39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:50.956649 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1325/2659] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:50.968205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffdb17-2c8c-4df7-b1ba-dd125bdc2c3a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:50.969967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2bffdb17-2c8c-4df7-b1ba-dd125bdc2c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:51.034597 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffdb17-2c8c-4df7-b1ba-dd125bdc2c3a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:51.039153 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee21321-2636-4ad1-9483-e67868cd5623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:51.040004 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee21321-2636-4ad1-9483-e67868cd5623 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:51.040392 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee21321-2636-4ad1-9483-e67868cd5623 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:51.040768 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee21321-2636-4ad1-9483-e67868cd5623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:51.107835 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee21321-2636-4ad1-9483-e67868cd5623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:51.109367 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee21321-2636-4ad1-9483-e67868cd5623 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:51.120041 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1335/2660] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:33:52.658980 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f0b1c-fa13-487b-be6e-1e1fc9f4ca39 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:52.661106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-669f0b1c-fa13-487b-be6e-1e1fc9f4ca39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:52.674397 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f0b1c-fa13-487b-be6e-1e1fc9f4ca39 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:52.678205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04ceac-ab1e-43d5-83e1-c04e87f53f83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:52.678847 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04ceac-ab1e-43d5-83e1-c04e87f53f83 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:52.679134 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04ceac-ab1e-43d5-83e1-c04e87f53f83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:52.679413 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04ceac-ab1e-43d5-83e1-c04e87f53f83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:52.708875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:52.743238 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04ceac-ab1e-43d5-83e1-c04e87f53f83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:52.744670 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04ceac-ab1e-43d5-83e1-c04e87f53f83 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:52.754428 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1326/2661] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:33:53.356712 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee21321-2636-4ad1-9483-e67868cd5623 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:53.365856 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee21321-2636-4ad1-9483-e67868cd5623 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:53.369595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c63062-691b-460a-b8b6-b007d4515c19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:53.370238 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c63062-691b-460a-b8b6-b007d4515c19 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:53.370519 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c63062-691b-460a-b8b6-b007d4515c19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:53.370787 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c63062-691b-460a-b8b6-b007d4515c19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:53.381143 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c63062-691b-460a-b8b6-b007d4515c19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:53.382643 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c63062-691b-460a-b8b6-b007d4515c19 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:53.393337 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1336/2662] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:33:57.384064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04ceac-ab1e-43d5-83e1-c04e87f53f83 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:57.452489 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04ceac-ab1e-43d5-83e1-c04e87f53f83 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:57.457122 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519fa31-424b-49a4-bea4-816ace831d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:57.458517 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519fa31-424b-49a4-bea4-816ace831d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:57.458795 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519fa31-424b-49a4-bea4-816ace831d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:57.459067 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519fa31-424b-49a4-bea4-816ace831d89 admin admin] PATH_INFO: `/v3/users/10070a6e57b6492cbd26f5a0d880fdb6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:57.460277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519fa31-424b-49a4-bea4-816ace831d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10070a6e57b6492cbd26f5a0d880fdb6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:57.462248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519fa31-424b-49a4-bea4-816ace831d89 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:57.509330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6519fa31-424b-49a4-bea4-816ace831d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10070a6e57b6492cbd26f5a0d880fdb6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:57.510012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6519fa31-424b-49a4-bea4-816ace831d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10070a6e57b6492cbd26f5a0d880fdb6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:57.517348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6519fa31-424b-49a4-bea4-816ace831d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10070a6e57b6492cbd26f5a0d880fdb6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:57.517970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6519fa31-424b-49a4-bea4-816ace831d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10070a6e57b6492cbd26f5a0d880fdb6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:57.525482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6519fa31-424b-49a4-bea4-816ace831d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10070a6e57b6492cbd26f5a0d880fdb6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:57.544442 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1327/2663] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:33:57 2022] DELETE /identity/v3/users/10070a6e57b6492cbd26f5a0d880fdb6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:57.549953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7384f6e-37d0-42cf-8288-ca920eda30fb None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:57.550485 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7384f6e-37d0-42cf-8288-ca920eda30fb None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:57.550485 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7384f6e-37d0-42cf-8288-ca920eda30fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:57.571193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d7384f6e-37d0-42cf-8288-ca920eda30fb None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:57.572471 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d7384f6e-37d0-42cf-8288-ca920eda30fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:57.614178 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:57.638910 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1337/2664] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:57.649065 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519fa31-424b-49a4-bea4-816ace831d89 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:57.650530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6519fa31-424b-49a4-bea4-816ace831d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:57.708246 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:57.714819 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519fa31-424b-49a4-bea4-816ace831d89 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:57.719535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffcc1e-42b0-432e-85ee-347b13d6015a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:57.720189 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffcc1e-42b0-432e-85ee-347b13d6015a service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:57.720475 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffcc1e-42b0-432e-85ee-347b13d6015a service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:57.720750 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffcc1e-42b0-432e-85ee-347b13d6015a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:57.730525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdffcc1e-42b0-432e-85ee-347b13d6015a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:57.733012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdffcc1e-42b0-432e-85ee-347b13d6015a service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:57.742738 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1328/2665] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:33:58.007178 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7384f6e-37d0-42cf-8288-ca920eda30fb None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:58.008701 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d7384f6e-37d0-42cf-8288-ca920eda30fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:58.021406 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7384f6e-37d0-42cf-8288-ca920eda30fb None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:58.026125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7a9ce-8c27-4d24-afa3-28b365952422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:58.026990 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7a9ce-8c27-4d24-afa3-28b365952422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:58.027280 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7a9ce-8c27-4d24-afa3-28b365952422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:58.027746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7a9ce-8c27-4d24-afa3-28b365952422 admin admin] PATH_INFO: `/v3/projects/119c14cbc60a4351a587037d9fe0ca7f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:58.029558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7a9ce-8c27-4d24-afa3-28b365952422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=119c14cbc60a4351a587037d9fe0ca7f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:58.033246 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7a9ce-8c27-4d24-afa3-28b365952422 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:58.086286 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-23f7a9ce-8c27-4d24-afa3-28b365952422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119c14cbc60a4351a587037d9fe0ca7f', 'request_id': 'req-23f7a9ce-8c27-4d24-afa3-28b365952422'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.094035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-23f7a9ce-8c27-4d24-afa3-28b365952422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119c14cbc60a4351a587037d9fe0ca7f', 'request_id': 'req-23f7a9ce-8c27-4d24-afa3-28b365952422'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.101309 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-23f7a9ce-8c27-4d24-afa3-28b365952422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119c14cbc60a4351a587037d9fe0ca7f', 'request_id': 'req-23f7a9ce-8c27-4d24-afa3-28b365952422'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.112175 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-23f7a9ce-8c27-4d24-afa3-28b365952422 admin admin] The token cache is being invalidate because project 119c14cbc60a4351a587037d9fe0ca7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:33:58.112460 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-23f7a9ce-8c27-4d24-afa3-28b365952422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.113101 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-23f7a9ce-8c27-4d24-afa3-28b365952422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.114672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1338/2666] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:33:58 2022] DELETE /identity/v3/projects/119c14cbc60a4351a587037d9fe0ca7f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:58.118789 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffcc1e-42b0-432e-85ee-347b13d6015a service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:58.128385 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffcc1e-42b0-432e-85ee-347b13d6015a service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:58.185473 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd2c19-845b-4085-8d0c-7f05eda07964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:58.186331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd2c19-845b-4085-8d0c-7f05eda07964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:58.186616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd2c19-845b-4085-8d0c-7f05eda07964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:58.186891 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd2c19-845b-4085-8d0c-7f05eda07964 admin admin] PATH_INFO: `/v3/users/e89f98ceef434f138dd6ba07fbd59aad` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:58.188076 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd2c19-845b-4085-8d0c-7f05eda07964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e89f98ceef434f138dd6ba07fbd59aad)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:58.190037 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd2c19-845b-4085-8d0c-7f05eda07964 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:58.235378 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bebd2c19-845b-4085-8d0c-7f05eda07964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e89f98ceef434f138dd6ba07fbd59aad'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.236030 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bebd2c19-845b-4085-8d0c-7f05eda07964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e89f98ceef434f138dd6ba07fbd59aad'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.244422 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bebd2c19-845b-4085-8d0c-7f05eda07964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e89f98ceef434f138dd6ba07fbd59aad'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.245088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bebd2c19-845b-4085-8d0c-7f05eda07964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e89f98ceef434f138dd6ba07fbd59aad'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.251949 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bebd2c19-845b-4085-8d0c-7f05eda07964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e89f98ceef434f138dd6ba07fbd59aad'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.269159 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1329/2667] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:33:58 2022] DELETE /identity/v3/users/e89f98ceef434f138dd6ba07fbd59aad => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:58.542071 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7a9ce-8c27-4d24-afa3-28b365952422 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:58.543495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-23f7a9ce-8c27-4d24-afa3-28b365952422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:58.562601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7a9ce-8c27-4d24-afa3-28b365952422 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:58.628059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a31432-db05-45ae-bf9c-4694aa85759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:58.628919 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a31432-db05-45ae-bf9c-4694aa85759e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:58.629198 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a31432-db05-45ae-bf9c-4694aa85759e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:58.629502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a31432-db05-45ae-bf9c-4694aa85759e admin admin] PATH_INFO: `/v3/projects/4fc75fc29cf34a7991da92a60c462d9c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:58.630979 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a31432-db05-45ae-bf9c-4694aa85759e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc75fc29cf34a7991da92a60c462d9c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:58.632876 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a31432-db05-45ae-bf9c-4694aa85759e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:58.678211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c5a31432-db05-45ae-bf9c-4694aa85759e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc75fc29cf34a7991da92a60c462d9c', 'request_id': 'req-c5a31432-db05-45ae-bf9c-4694aa85759e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.685121 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c5a31432-db05-45ae-bf9c-4694aa85759e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc75fc29cf34a7991da92a60c462d9c', 'request_id': 'req-c5a31432-db05-45ae-bf9c-4694aa85759e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.690849 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c5a31432-db05-45ae-bf9c-4694aa85759e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc75fc29cf34a7991da92a60c462d9c', 'request_id': 'req-c5a31432-db05-45ae-bf9c-4694aa85759e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.692728 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:58.706119 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c5a31432-db05-45ae-bf9c-4694aa85759e admin admin] The token cache is being invalidate because project 4fc75fc29cf34a7991da92a60c462d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:33:58.706119 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c5a31432-db05-45ae-bf9c-4694aa85759e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.706119 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c5a31432-db05-45ae-bf9c-4694aa85759e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.707643 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1339/2668] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:33:58 2022] DELETE /identity/v3/projects/4fc75fc29cf34a7991da92a60c462d9c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:58.712123 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd2c19-845b-4085-8d0c-7f05eda07964 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:58.713418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bebd2c19-845b-4085-8d0c-7f05eda07964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:58.726888 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd2c19-845b-4085-8d0c-7f05eda07964 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:58.783034 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f32154-e23b-4276-9c01-789383c5832e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:58.783941 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f32154-e23b-4276-9c01-789383c5832e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:58.784225 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f32154-e23b-4276-9c01-789383c5832e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:58.784544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f32154-e23b-4276-9c01-789383c5832e admin admin] PATH_INFO: `/v3/users/75fd1150acf04ff5b2288c0c7f8bef53` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:58.786267 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f32154-e23b-4276-9c01-789383c5832e admin admin] RBAC: Authorizing `identity:delete_user(user_id=75fd1150acf04ff5b2288c0c7f8bef53)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:58.788199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f32154-e23b-4276-9c01-789383c5832e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:58.805079 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:58.838772 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-98f32154-e23b-4276-9c01-789383c5832e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75fd1150acf04ff5b2288c0c7f8bef53'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.839446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-98f32154-e23b-4276-9c01-789383c5832e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75fd1150acf04ff5b2288c0c7f8bef53'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.846657 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-98f32154-e23b-4276-9c01-789383c5832e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75fd1150acf04ff5b2288c0c7f8bef53'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.847550 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-98f32154-e23b-4276-9c01-789383c5832e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75fd1150acf04ff5b2288c0c7f8bef53'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.855803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-98f32154-e23b-4276-9c01-789383c5832e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75fd1150acf04ff5b2288c0c7f8bef53'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:58.876052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1330/2669] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:33:58 2022] DELETE /identity/v3/users/75fd1150acf04ff5b2288c0c7f8bef53 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:59.142335 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a31432-db05-45ae-bf9c-4694aa85759e admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:59.143733 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c5a31432-db05-45ae-bf9c-4694aa85759e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:59.159133 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a31432-db05-45ae-bf9c-4694aa85759e admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:59.218010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd176c-fb79-4c79-acfc-a6df465aa46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:59.218874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd176c-fb79-4c79-acfc-a6df465aa46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:59.219158 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd176c-fb79-4c79-acfc-a6df465aa46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:59.219435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd176c-fb79-4c79-acfc-a6df465aa46b admin admin] PATH_INFO: `/v3/projects/fdc88799bdfc4fa3820a851f52f99bf9` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:59.220604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd176c-fb79-4c79-acfc-a6df465aa46b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc88799bdfc4fa3820a851f52f99bf9)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:59.222546 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd176c-fb79-4c79-acfc-a6df465aa46b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:59.268492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d2bd176c-fb79-4c79-acfc-a6df465aa46b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc88799bdfc4fa3820a851f52f99bf9', 'request_id': 'req-d2bd176c-fb79-4c79-acfc-a6df465aa46b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:59.276678 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d2bd176c-fb79-4c79-acfc-a6df465aa46b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc88799bdfc4fa3820a851f52f99bf9', 'request_id': 'req-d2bd176c-fb79-4c79-acfc-a6df465aa46b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:59.282258 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d2bd176c-fb79-4c79-acfc-a6df465aa46b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc88799bdfc4fa3820a851f52f99bf9', 'request_id': 'req-d2bd176c-fb79-4c79-acfc-a6df465aa46b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:59.294081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d2bd176c-fb79-4c79-acfc-a6df465aa46b admin admin] The token cache is being invalidate because project fdc88799bdfc4fa3820a851f52f99bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:33:59.294371 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d2bd176c-fb79-4c79-acfc-a6df465aa46b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:59.295009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d2bd176c-fb79-4c79-acfc-a6df465aa46b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:33:59.296617 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1340/2670] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:33:59 2022] DELETE /identity/v3/projects/fdc88799bdfc4fa3820a851f52f99bf9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:33:59.302300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfcbb6-6060-4dd9-88c4-81c044a112a4 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:59.302592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfcbb6-6060-4dd9-88c4-81c044a112a4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:59.302868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfcbb6-6060-4dd9-88c4-81c044a112a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:59.321069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a8bfcbb6-6060-4dd9-88c4-81c044a112a4 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:59.322383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a8bfcbb6-6060-4dd9-88c4-81c044a112a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:59.380618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1331/2671] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:59.388301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16060f-c36e-46c4-ba5b-6af8587aeab6 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:59.388599 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16060f-c36e-46c4-ba5b-6af8587aeab6 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:59.388899 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16060f-c36e-46c4-ba5b-6af8587aeab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:59.409631 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-fe16060f-c36e-46c4-ba5b-6af8587aeab6 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:59.411295 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-fe16060f-c36e-46c4-ba5b-6af8587aeab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:59.419200 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1341/2672] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:59.423294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfcbb6-6060-4dd9-88c4-81c044a112a4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:59.433544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfcbb6-6060-4dd9-88c4-81c044a112a4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:59.438127 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702562ad-c091-42f6-bc51-741a5ed9ab96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:59.438812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702562ad-c091-42f6-bc51-741a5ed9ab96 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:59.439094 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702562ad-c091-42f6-bc51-741a5ed9ab96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:59.439368 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702562ad-c091-42f6-bc51-741a5ed9ab96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:59.440094 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702562ad-c091-42f6-bc51-741a5ed9ab96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:33:59.440401 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702562ad-c091-42f6-bc51-741a5ed9ab96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:59.442061 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702562ad-c091-42f6-bc51-741a5ed9ab96 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:59.453830 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1332/2673] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:33:59.458076 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16060f-c36e-46c4-ba5b-6af8587aeab6 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:59.467943 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16060f-c36e-46c4-ba5b-6af8587aeab6 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:59.472826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14529e-e455-4043-a055-5d8861ba9827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:59.474006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14529e-e455-4043-a055-5d8861ba9827 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:59.474288 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14529e-e455-4043-a055-5d8861ba9827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:59.474564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14529e-e455-4043-a055-5d8861ba9827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:59.475941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14529e-e455-4043-a055-5d8861ba9827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:59.478280 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14529e-e455-4043-a055-5d8861ba9827 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:59.504229 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1342/2674] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:33:59 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:33:59.508760 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702562ad-c091-42f6-bc51-741a5ed9ab96 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:59.518908 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702562ad-c091-42f6-bc51-741a5ed9ab96 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:59.577780 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655de7f-d6ed-4c8e-8064-0ae6855840c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:59.578457 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655de7f-d6ed-4c8e-8064-0ae6855840c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:59.578739 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655de7f-d6ed-4c8e-8064-0ae6855840c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:59.579012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655de7f-d6ed-4c8e-8064-0ae6855840c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:59.579694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655de7f-d6ed-4c8e-8064-0ae6855840c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:59.581664 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655de7f-d6ed-4c8e-8064-0ae6855840c7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:59.600774 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1333/2675] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:33:59 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:33:59.604785 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14529e-e455-4043-a055-5d8861ba9827 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:59.615716 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14529e-e455-4043-a055-5d8861ba9827 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:59.620301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e59877-5039-4661-aa55-4a22e3971ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:59.620951 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e59877-5039-4661-aa55-4a22e3971ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:59.621232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e59877-5039-4661-aa55-4a22e3971ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:59.621532 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e59877-5039-4661-aa55-4a22e3971ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:59.622256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e59877-5039-4661-aa55-4a22e3971ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:59.623861 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e59877-5039-4661-aa55-4a22e3971ba9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:59.634126 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1343/2676] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:33:59.638074 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655de7f-d6ed-4c8e-8064-0ae6855840c7 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:59.644255 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:59.648526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655de7f-d6ed-4c8e-8064-0ae6855840c7 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:59.654276 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617b2c2-7a66-4b3a-b458-1670a6ccd69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:59.655015 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617b2c2-7a66-4b3a-b458-1670a6ccd69d admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:59.655490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617b2c2-7a66-4b3a-b458-1670a6ccd69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:59.655933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617b2c2-7a66-4b3a-b458-1670a6ccd69d admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:59.656691 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617b2c2-7a66-4b3a-b458-1670a6ccd69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:59.658463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617b2c2-7a66-4b3a-b458-1670a6ccd69d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:59.669462 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1334/2677] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:33:59.673285 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e59877-5039-4661-aa55-4a22e3971ba9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:59.683226 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e59877-5039-4661-aa55-4a22e3971ba9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:59.687815 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6aaf3-9cab-40f1-a05b-cc3869c49ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:59.688674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6aaf3-9cab-40f1-a05b-cc3869c49ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:59.688953 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6aaf3-9cab-40f1-a05b-cc3869c49ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:59.689225 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6aaf3-9cab-40f1-a05b-cc3869c49ac2 admin admin] PATH_INFO: `/v3/projects/61c56e1ada784a0f9e901b35079e901f/users/389a52876a46474a81cb3554134777aa/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:59.706477 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6aaf3-9cab-40f1-a05b-cc3869c49ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c56e1ada784a0f9e901b35079e901f, user_id=389a52876a46474a81cb3554134777aa, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:59.709890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6aaf3-9cab-40f1-a05b-cc3869c49ac2 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:59.724974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1344/2678] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:33:59 2022] PUT /identity/v3/projects/61c56e1ada784a0f9e901b35079e901f/users/389a52876a46474a81cb3554134777aa/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:33:59.736286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4522f9-dad9-4e06-aefa-83b9fc349362 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:59.736752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4522f9-dad9-4e06-aefa-83b9fc349362 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:59.736866 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4522f9-dad9-4e06-aefa-83b9fc349362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:59.763340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1f4522f9-dad9-4e06-aefa-83b9fc349362 None None] MFA Rules not processed for user `389a52876a46474a81cb3554134777aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:33:59.764532 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1f4522f9-dad9-4e06-aefa-83b9fc349362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:59.827585 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1335/2679] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:33:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:33:59.838632 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6aaf3-9cab-40f1-a05b-cc3869c49ac2 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:33:59.840325 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-82c6aaf3-9cab-40f1-a05b-cc3869c49ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:33:59.866640 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:59.899072 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6aaf3-9cab-40f1-a05b-cc3869c49ac2 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:33:59.902703 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a10a84-4a71-4081-b22c-e8058c49210c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:33:59.903341 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a10a84-4a71-4081-b22c-e8058c49210c service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:33:59.903620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a10a84-4a71-4081-b22c-e8058c49210c service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:33:59.904009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a10a84-4a71-4081-b22c-e8058c49210c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:33:59.912914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a10a84-4a71-4081-b22c-e8058c49210c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:33:59.914417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a10a84-4a71-4081-b22c-e8058c49210c service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:33:59.923219 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1345/2680] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:33:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:34:01.277941 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf199b-58ae-4259-a6b4-59118364eab4 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:01.278511 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf199b-58ae-4259-a6b4-59118364eab4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:01.278511 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf199b-58ae-4259-a6b4-59118364eab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:01.296601 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-7faf199b-58ae-4259-a6b4-59118364eab4 None None] MFA Rules not processed for user `389a52876a46474a81cb3554134777aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:34:01.297853 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7faf199b-58ae-4259-a6b4-59118364eab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:01.305367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1336/2681] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:34:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:34:05.116534 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ec0b-3285-41cd-88b1-654ae9705bb3 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:05.117026 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ec0b-3285-41cd-88b1-654ae9705bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:05.117354 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ec0b-3285-41cd-88b1-654ae9705bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:05.135680 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f5b2ec0b-3285-41cd-88b1-654ae9705bb3 None None] MFA Rules not processed for user `54189575a60a4d9dbaabb78d44e9c31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:34:05.137198 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f5b2ec0b-3285-41cd-88b1-654ae9705bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:05.152245 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf199b-58ae-4259-a6b4-59118364eab4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:05.154428 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7faf199b-58ae-4259-a6b4-59118364eab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:05.239452 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1346/2682] 10.222.0.57 () {58 vars in 967 bytes} [Tue Jul 12 18:34:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:34:05.267528 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2ec0b-3285-41cd-88b1-654ae9705bb3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:05.268961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f5b2ec0b-3285-41cd-88b1-654ae9705bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:05.292627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf199b-58ae-4259-a6b4-59118364eab4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:05.300157 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d69934-dec5-48c1-bb13-f630db51c2a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:05.300829 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d69934-dec5-48c1-bb13-f630db51c2a6 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:05.301114 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d69934-dec5-48c1-bb13-f630db51c2a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:05.301446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d69934-dec5-48c1-bb13-f630db51c2a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:05.303477 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-88d69934-dec5-48c1-bb13-f630db51c2a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:05.319547 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d69934-dec5-48c1-bb13-f630db51c2a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:05.321185 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d69934-dec5-48c1-bb13-f630db51c2a6 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:05.343182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1337/2683] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:34:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:34:05.362628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2ec0b-3285-41cd-88b1-654ae9705bb3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:05.368864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228651a-2e72-4e32-bad6-22e41eed9dd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ade969d7aa3d49c08782a68ec5997382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:05.369886 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228651a-2e72-4e32-bad6-22e41eed9dd9 service swift] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:05.370282 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228651a-2e72-4e32-bad6-22e41eed9dd9 service swift] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:05.370622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228651a-2e72-4e32-bad6-22e41eed9dd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:05.381922 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228651a-2e72-4e32-bad6-22e41eed9dd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:05.384053 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228651a-2e72-4e32-bad6-22e41eed9dd9 service swift] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:05.392449 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1347/2684] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Jul 12 18:34:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 18:34:15.328456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=72 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:34:15.389051 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=73 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:34:15.951430 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0012e-b3b3-4678-9c44-d157fabd23bf None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:15.951718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0012e-b3b3-4678-9c44-d157fabd23bf None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:15.951999 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0012e-b3b3-4678-9c44-d157fabd23bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:15.969539 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-04f0012e-b3b3-4678-9c44-d157fabd23bf None None] MFA Rules not processed for user `54189575a60a4d9dbaabb78d44e9c31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:34:15.970722 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-04f0012e-b3b3-4678-9c44-d157fabd23bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:15.978318 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1338/2685] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Jul 12 18:34:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:34:15.990286 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228651a-2e72-4e32-bad6-22e41eed9dd9 service swift] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:16.000765 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228651a-2e72-4e32-bad6-22e41eed9dd9 service swift] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:16.005895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67adb9-959a-418c-856f-60b65f4e971b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ade969d7aa3d49c08782a68ec5997382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:16.006527 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67adb9-959a-418c-856f-60b65f4e971b service swift] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:16.006812 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67adb9-959a-418c-856f-60b65f4e971b service swift] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:16.007088 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67adb9-959a-418c-856f-60b65f4e971b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:16.015107 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67adb9-959a-418c-856f-60b65f4e971b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:16.016682 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67adb9-959a-418c-856f-60b65f4e971b service swift] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:16.025155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1348/2686] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Jul 12 18:34:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:34:16.527888 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425fd09-7a84-4967-8dc4-5f9b69e324a1 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:16.528412 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425fd09-7a84-4967-8dc4-5f9b69e324a1 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:16.528508 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425fd09-7a84-4967-8dc4-5f9b69e324a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:16.546456 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b425fd09-7a84-4967-8dc4-5f9b69e324a1 None None] MFA Rules not processed for user `54189575a60a4d9dbaabb78d44e9c31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:34:16.547664 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b425fd09-7a84-4967-8dc4-5f9b69e324a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:16.555527 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1339/2687] 10.222.0.57 () {58 vars in 967 bytes} [Tue Jul 12 18:34:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:34:16.567822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67adb9-959a-418c-856f-60b65f4e971b service swift] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:16.578967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67adb9-959a-418c-856f-60b65f4e971b service swift] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:16.584003 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1337344-f4d4-4eb9-8fbc-7f1ffe7170b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ade969d7aa3d49c08782a68ec5997382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:16.584637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1337344-f4d4-4eb9-8fbc-7f1ffe7170b2 service swift] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:16.584919 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1337344-f4d4-4eb9-8fbc-7f1ffe7170b2 service swift] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:16.585193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1337344-f4d4-4eb9-8fbc-7f1ffe7170b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:16.593191 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1337344-f4d4-4eb9-8fbc-7f1ffe7170b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:16.594796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1337344-f4d4-4eb9-8fbc-7f1ffe7170b2 service swift] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:16.603241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1349/2688] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Jul 12 18:34:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:34:16.787756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7640397-a60e-448c-be26-bfc9d5490184 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:16.788046 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7640397-a60e-448c-be26-bfc9d5490184 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:16.788324 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7640397-a60e-448c-be26-bfc9d5490184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:16.806234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b7640397-a60e-448c-be26-bfc9d5490184 None None] MFA Rules not processed for user `54189575a60a4d9dbaabb78d44e9c31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:34:16.807425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b7640397-a60e-448c-be26-bfc9d5490184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:16.814693 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1340/2689] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Jul 12 18:34:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:34:16.827745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1337344-f4d4-4eb9-8fbc-7f1ffe7170b2 service swift] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:16.838852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1337344-f4d4-4eb9-8fbc-7f1ffe7170b2 service swift] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:16.843927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be7257-41c8-4d80-8410-de7d49752367 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ade969d7aa3d49c08782a68ec5997382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:16.844559 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be7257-41c8-4d80-8410-de7d49752367 service swift] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:16.844843 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be7257-41c8-4d80-8410-de7d49752367 service swift] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:16.845120 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be7257-41c8-4d80-8410-de7d49752367 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:16.853784 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be7257-41c8-4d80-8410-de7d49752367 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:16.855374 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be7257-41c8-4d80-8410-de7d49752367 service swift] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:16.863363 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1350/2690] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Jul 12 18:34:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:34:17.174285 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32e6ce-7fd6-410c-a34a-e904384888f7 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:17.174582 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32e6ce-7fd6-410c-a34a-e904384888f7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:17.174861 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32e6ce-7fd6-410c-a34a-e904384888f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:17.193058 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-fb32e6ce-7fd6-410c-a34a-e904384888f7 None None] MFA Rules not processed for user `54189575a60a4d9dbaabb78d44e9c31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:34:17.194303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-fb32e6ce-7fd6-410c-a34a-e904384888f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:17.201988 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1341/2691] 10.222.0.57 () {58 vars in 967 bytes} [Tue Jul 12 18:34:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:34:17.214413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be7257-41c8-4d80-8410-de7d49752367 service swift] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:17.225601 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be7257-41c8-4d80-8410-de7d49752367 service swift] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:17.230628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d44459-8ad3-498e-b2a3-d82005a4d348 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ade969d7aa3d49c08782a68ec5997382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:17.231260 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d44459-8ad3-498e-b2a3-d82005a4d348 service swift] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:17.231541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d44459-8ad3-498e-b2a3-d82005a4d348 service swift] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:17.231819 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d44459-8ad3-498e-b2a3-d82005a4d348 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:17.239781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d44459-8ad3-498e-b2a3-d82005a4d348 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:17.241463 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d44459-8ad3-498e-b2a3-d82005a4d348 service swift] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:17.252441 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1351/2692] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Jul 12 18:34:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:34:19.279808 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32e6ce-7fd6-410c-a34a-e904384888f7 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:19.342968 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32e6ce-7fd6-410c-a34a-e904384888f7 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:19.347392 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99ad07-4cf0-474e-a556-d7c9f3ae59b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:19.348256 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99ad07-4cf0-474e-a556-d7c9f3ae59b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:19.348533 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99ad07-4cf0-474e-a556-d7c9f3ae59b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:19.349443 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99ad07-4cf0-474e-a556-d7c9f3ae59b8 admin admin] PATH_INFO: `/v3/users/389a52876a46474a81cb3554134777aa` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:19.350632 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99ad07-4cf0-474e-a556-d7c9f3ae59b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=389a52876a46474a81cb3554134777aa)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:19.352529 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99ad07-4cf0-474e-a556-d7c9f3ae59b8 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:19.395049 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ec99ad07-4cf0-474e-a556-d7c9f3ae59b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '389a52876a46474a81cb3554134777aa'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:34:19.396215 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ec99ad07-4cf0-474e-a556-d7c9f3ae59b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '389a52876a46474a81cb3554134777aa'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:34:19.403244 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ec99ad07-4cf0-474e-a556-d7c9f3ae59b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '389a52876a46474a81cb3554134777aa'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:34:19.403865 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ec99ad07-4cf0-474e-a556-d7c9f3ae59b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '389a52876a46474a81cb3554134777aa'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:34:19.410643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ec99ad07-4cf0-474e-a556-d7c9f3ae59b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '389a52876a46474a81cb3554134777aa'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:34:19.428077 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1342/2693] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:34:19 2022] DELETE /identity/v3/users/389a52876a46474a81cb3554134777aa => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:34:19.432684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee4821-7e97-496f-a29e-34f03fa4c9a8 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:19.433173 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee4821-7e97-496f-a29e-34f03fa4c9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:19.433301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee4821-7e97-496f-a29e-34f03fa4c9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:19.450490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-5eee4821-7e97-496f-a29e-34f03fa4c9a8 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:34:19.451675 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5eee4821-7e97-496f-a29e-34f03fa4c9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:19.508882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1352/2694] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:34:19.518742 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99ad07-4cf0-474e-a556-d7c9f3ae59b8 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:19.520116 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ec99ad07-4cf0-474e-a556-d7c9f3ae59b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:19.579072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99ad07-4cf0-474e-a556-d7c9f3ae59b8 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:19.582772 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a93533-0ef0-4049-b6d8-ff59ab62333a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:19.583490 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a93533-0ef0-4049-b6d8-ff59ab62333a service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:19.583791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a93533-0ef0-4049-b6d8-ff59ab62333a service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:19.584052 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a93533-0ef0-4049-b6d8-ff59ab62333a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:19.591019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:34:19.593430 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a93533-0ef0-4049-b6d8-ff59ab62333a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:19.595245 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a93533-0ef0-4049-b6d8-ff59ab62333a service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:19.606946 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1343/2695] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:34:19.772568 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee4821-7e97-496f-a29e-34f03fa4c9a8 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:19.773997 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5eee4821-7e97-496f-a29e-34f03fa4c9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:19.786755 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee4821-7e97-496f-a29e-34f03fa4c9a8 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:19.791355 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2751003-2cab-477f-b366-70fe43e573b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:19.792205 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2751003-2cab-477f-b366-70fe43e573b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:19.792490 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2751003-2cab-477f-b366-70fe43e573b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:19.792762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2751003-2cab-477f-b366-70fe43e573b6 admin admin] PATH_INFO: `/v3/projects/61c56e1ada784a0f9e901b35079e901f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:19.793956 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2751003-2cab-477f-b366-70fe43e573b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c56e1ada784a0f9e901b35079e901f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:19.795900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2751003-2cab-477f-b366-70fe43e573b6 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:19.843054 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e2751003-2cab-477f-b366-70fe43e573b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c56e1ada784a0f9e901b35079e901f', 'request_id': 'req-e2751003-2cab-477f-b366-70fe43e573b6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:34:19.850388 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e2751003-2cab-477f-b366-70fe43e573b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c56e1ada784a0f9e901b35079e901f', 'request_id': 'req-e2751003-2cab-477f-b366-70fe43e573b6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:34:19.856190 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e2751003-2cab-477f-b366-70fe43e573b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c56e1ada784a0f9e901b35079e901f', 'request_id': 'req-e2751003-2cab-477f-b366-70fe43e573b6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:34:19.867663 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e2751003-2cab-477f-b366-70fe43e573b6 admin admin] The token cache is being invalidate because project 61c56e1ada784a0f9e901b35079e901f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:34:19.867954 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e2751003-2cab-477f-b366-70fe43e573b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:34:19.868595 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e2751003-2cab-477f-b366-70fe43e573b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:34:19.870168 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1353/2696] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:34:19 2022] DELETE /identity/v3/projects/61c56e1ada784a0f9e901b35079e901f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:34:19.875133 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2597e-128d-4870-a6cb-f388ed1ca481 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:19.875427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2597e-128d-4870-a6cb-f388ed1ca481 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:19.875707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2597e-128d-4870-a6cb-f388ed1ca481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:19.893398 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-41b2597e-128d-4870-a6cb-f388ed1ca481 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:34:19.894604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-41b2597e-128d-4870-a6cb-f388ed1ca481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:19.954786 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1344/2697] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:34:19.963781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a102a7-59e4-4e70-b321-d74e98ac9aa8 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:19.964067 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a102a7-59e4-4e70-b321-d74e98ac9aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:19.964339 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a102a7-59e4-4e70-b321-d74e98ac9aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:19.983007 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b0a102a7-59e4-4e70-b321-d74e98ac9aa8 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:34:19.984194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b0a102a7-59e4-4e70-b321-d74e98ac9aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:19.991933 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1354/2698] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:34:19.995941 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2597e-128d-4870-a6cb-f388ed1ca481 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:20.005642 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2597e-128d-4870-a6cb-f388ed1ca481 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:20.010205 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7827cf1-c635-4d97-a34f-4115b29192f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:20.010870 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7827cf1-c635-4d97-a34f-4115b29192f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:20.011234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7827cf1-c635-4d97-a34f-4115b29192f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:20.011463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7827cf1-c635-4d97-a34f-4115b29192f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:20.012426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7827cf1-c635-4d97-a34f-4115b29192f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:34:20.012854 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7827cf1-c635-4d97-a34f-4115b29192f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:20.014824 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7827cf1-c635-4d97-a34f-4115b29192f4 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:20.027815 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1345/2699] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:34:20.032167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a102a7-59e4-4e70-b321-d74e98ac9aa8 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:20.041412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a102a7-59e4-4e70-b321-d74e98ac9aa8 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:20.046006 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deff904-56dc-41ea-92db-586989a0477d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:20.046642 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deff904-56dc-41ea-92db-586989a0477d admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:20.046921 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deff904-56dc-41ea-92db-586989a0477d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:20.047192 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deff904-56dc-41ea-92db-586989a0477d admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:20.047873 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deff904-56dc-41ea-92db-586989a0477d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:20.049824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deff904-56dc-41ea-92db-586989a0477d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:20.075478 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1355/2700] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:34:20 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:34:20.079566 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7827cf1-c635-4d97-a34f-4115b29192f4 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:20.090105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7827cf1-c635-4d97-a34f-4115b29192f4 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:20.145525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc542b8b-30d6-4549-bada-b4778f8f6b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:20.146188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc542b8b-30d6-4549-bada-b4778f8f6b8f admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:20.146475 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc542b8b-30d6-4549-bada-b4778f8f6b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:20.146756 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc542b8b-30d6-4549-bada-b4778f8f6b8f admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:20.147470 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc542b8b-30d6-4549-bada-b4778f8f6b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:20.149423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc542b8b-30d6-4549-bada-b4778f8f6b8f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:20.168662 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1346/2701] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:34:20 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:34:20.172718 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deff904-56dc-41ea-92db-586989a0477d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:20.178868 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:34:20.184998 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deff904-56dc-41ea-92db-586989a0477d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:20.190806 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ccd7b-cdb2-4320-b7b1-3936bccbc18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:20.191491 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ccd7b-cdb2-4320-b7b1-3936bccbc18a admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:20.191778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ccd7b-cdb2-4320-b7b1-3936bccbc18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:20.192054 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ccd7b-cdb2-4320-b7b1-3936bccbc18a admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:20.193422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ccd7b-cdb2-4320-b7b1-3936bccbc18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:20.195105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ccd7b-cdb2-4320-b7b1-3936bccbc18a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:20.205681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1356/2702] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:34:20.209385 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc542b8b-30d6-4549-bada-b4778f8f6b8f admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:20.219106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc542b8b-30d6-4549-bada-b4778f8f6b8f admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:20.224582 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b11b1-a6b2-4d0c-a154-4226a2d8a453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:20.225236 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b11b1-a6b2-4d0c-a154-4226a2d8a453 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:20.225547 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b11b1-a6b2-4d0c-a154-4226a2d8a453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:20.225822 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b11b1-a6b2-4d0c-a154-4226a2d8a453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:20.226540 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b11b1-a6b2-4d0c-a154-4226a2d8a453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:20.228125 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b11b1-a6b2-4d0c-a154-4226a2d8a453 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:20.237871 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1347/2703] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:34:20.241723 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ccd7b-cdb2-4320-b7b1-3936bccbc18a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:20.251382 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ccd7b-cdb2-4320-b7b1-3936bccbc18a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:20.256494 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9913d60-8a89-4ab6-85f5-acc461ff277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:20.257388 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9913d60-8a89-4ab6-85f5-acc461ff277a admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:20.257672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9913d60-8a89-4ab6-85f5-acc461ff277a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:20.257948 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9913d60-8a89-4ab6-85f5-acc461ff277a admin admin] PATH_INFO: `/v3/projects/a5b6bf56eaab493694bd240454a47e1a/users/1a1352f6402f496490656800297c3a44/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:20.272502 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9913d60-8a89-4ab6-85f5-acc461ff277a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b6bf56eaab493694bd240454a47e1a, user_id=1a1352f6402f496490656800297c3a44, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:20.275182 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9913d60-8a89-4ab6-85f5-acc461ff277a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:20.293456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1357/2704] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:34:20 2022] PUT /identity/v3/projects/a5b6bf56eaab493694bd240454a47e1a/users/1a1352f6402f496490656800297c3a44/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:34:20.298440 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c394a6b-0885-40dd-afaa-f66b21efe657 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:20.298916 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c394a6b-0885-40dd-afaa-f66b21efe657 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:20.299016 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c394a6b-0885-40dd-afaa-f66b21efe657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:20.316735 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2c394a6b-0885-40dd-afaa-f66b21efe657 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:34:20.318866 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2c394a6b-0885-40dd-afaa-f66b21efe657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:20.376923 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1348/2705] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:34:20.386971 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9913d60-8a89-4ab6-85f5-acc461ff277a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:20.388690 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f9913d60-8a89-4ab6-85f5-acc461ff277a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:20.445919 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9913d60-8a89-4ab6-85f5-acc461ff277a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:20.449797 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7e408-0e6b-4d6d-af6a-6e8835136fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:20.450428 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7e408-0e6b-4d6d-af6a-6e8835136fab service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:20.450704 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7e408-0e6b-4d6d-af6a-6e8835136fab service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:20.450974 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7e408-0e6b-4d6d-af6a-6e8835136fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:20.459895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7e408-0e6b-4d6d-af6a-6e8835136fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:20.461337 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7e408-0e6b-4d6d-af6a-6e8835136fab service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:20.470483 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1358/2706] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:34:24.409691 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2785e-6858-4c80-b1af-e68f8d2d6518 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:24.410219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2785e-6858-4c80-b1af-e68f8d2d6518 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:24.410319 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2785e-6858-4c80-b1af-e68f8d2d6518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:24.417326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:34:24.449102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-46f2785e-6858-4c80-b1af-e68f8d2d6518 None None] MFA Rules not processed for user `1a1352f6402f496490656800297c3a44`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:34:24.450816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-46f2785e-6858-4c80-b1af-e68f8d2d6518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:24.528364 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1349/2707] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:34:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:34:24.532860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7e408-0e6b-4d6d-af6a-6e8835136fab service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:24.544224 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7e408-0e6b-4d6d-af6a-6e8835136fab service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:24.548992 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09def0-acdd-4066-8af1-9b4600a4836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:24.549765 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09def0-acdd-4066-8af1-9b4600a4836b admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:24.550116 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09def0-acdd-4066-8af1-9b4600a4836b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:24.550457 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09def0-acdd-4066-8af1-9b4600a4836b admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:24.551372 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09def0-acdd-4066-8af1-9b4600a4836b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:24.553446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09def0-acdd-4066-8af1-9b4600a4836b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:24.590598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1359/2708] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:34:24 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:34:24.591716 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2785e-6858-4c80-b1af-e68f8d2d6518 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:24.603704 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2785e-6858-4c80-b1af-e68f8d2d6518 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:24.661746 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a08eb-38d7-47bc-9c6f-9ba0af575860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:24.662385 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a08eb-38d7-47bc-9c6f-9ba0af575860 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:24.662664 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a08eb-38d7-47bc-9c6f-9ba0af575860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:24.662956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a08eb-38d7-47bc-9c6f-9ba0af575860 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:24.663803 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a08eb-38d7-47bc-9c6f-9ba0af575860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:24.665859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a08eb-38d7-47bc-9c6f-9ba0af575860 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:24.686610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1350/2709] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:34:24 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:34:24.690574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09def0-acdd-4066-8af1-9b4600a4836b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:24.702999 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09def0-acdd-4066-8af1-9b4600a4836b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:24.707747 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3b68e-5941-4e6a-89d6-e8a4b24fe72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:24.708906 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3b68e-5941-4e6a-89d6-e8a4b24fe72d admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:24.709184 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3b68e-5941-4e6a-89d6-e8a4b24fe72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:24.709501 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3b68e-5941-4e6a-89d6-e8a4b24fe72d admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:24.710231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3b68e-5941-4e6a-89d6-e8a4b24fe72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:24.711994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3b68e-5941-4e6a-89d6-e8a4b24fe72d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:24.723311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1360/2710] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:34:24.728190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a08eb-38d7-47bc-9c6f-9ba0af575860 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:24.738427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a08eb-38d7-47bc-9c6f-9ba0af575860 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:24.743904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446dd65-ed06-421c-a364-5866f2d0b8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:24.744778 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446dd65-ed06-421c-a364-5866f2d0b8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:24.745055 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446dd65-ed06-421c-a364-5866f2d0b8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:24.745359 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446dd65-ed06-421c-a364-5866f2d0b8d4 admin admin] PATH_INFO: `/v3/projects/36f7f4162e91415089eb7fb9206a9a1b/users/3eb600d1eaea47318ec305cc6967c278/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:24.760198 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446dd65-ed06-421c-a364-5866f2d0b8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f7f4162e91415089eb7fb9206a9a1b, user_id=3eb600d1eaea47318ec305cc6967c278, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:24.762884 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446dd65-ed06-421c-a364-5866f2d0b8d4 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:24.776137 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1351/2711] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:34:24 2022] PUT /identity/v3/projects/36f7f4162e91415089eb7fb9206a9a1b/users/3eb600d1eaea47318ec305cc6967c278/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:34:24.780181 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3b68e-5941-4e6a-89d6-e8a4b24fe72d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:24.790142 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3b68e-5941-4e6a-89d6-e8a4b24fe72d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:24.846068 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af54504-6f19-4368-ab73-aa96a674cc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:24.846753 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af54504-6f19-4368-ab73-aa96a674cc77 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:24.847038 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af54504-6f19-4368-ab73-aa96a674cc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:24.847316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af54504-6f19-4368-ab73-aa96a674cc77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:24.848044 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af54504-6f19-4368-ab73-aa96a674cc77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:24.849691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af54504-6f19-4368-ab73-aa96a674cc77 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:24.859809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1361/2712] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:34:24.863922 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446dd65-ed06-421c-a364-5866f2d0b8d4 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:24.874247 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446dd65-ed06-421c-a364-5866f2d0b8d4 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:24.878786 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba9bc2-4fdc-41dd-a778-c57c60e1c152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:24.880199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba9bc2-4fdc-41dd-a778-c57c60e1c152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:24.880503 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba9bc2-4fdc-41dd-a778-c57c60e1c152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:24.880779 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba9bc2-4fdc-41dd-a778-c57c60e1c152 admin admin] PATH_INFO: `/v3/projects/36f7f4162e91415089eb7fb9206a9a1b/users/3eb600d1eaea47318ec305cc6967c278/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:24.882812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba9bc2-4fdc-41dd-a778-c57c60e1c152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f7f4162e91415089eb7fb9206a9a1b, user_id=3eb600d1eaea47318ec305cc6967c278, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:24.885483 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba9bc2-4fdc-41dd-a778-c57c60e1c152 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:24.896038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1352/2713] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:34:24 2022] PUT /identity/v3/projects/36f7f4162e91415089eb7fb9206a9a1b/users/3eb600d1eaea47318ec305cc6967c278/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:34:29.757110 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79df283-071c-42d6-9618-754469af2290 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:29.757725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79df283-071c-42d6-9618-754469af2290 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:29.757725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79df283-071c-42d6-9618-754469af2290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:29.788102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e79df283-071c-42d6-9618-754469af2290 None None] MFA Rules not processed for user `3eb600d1eaea47318ec305cc6967c278`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:34:29.789735 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e79df283-071c-42d6-9618-754469af2290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:29.815248 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:34:29.877228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1362/2714] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:34:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:34:29.894494 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba9bc2-4fdc-41dd-a778-c57c60e1c152 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:29.897713 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2fba9bc2-4fdc-41dd-a778-c57c60e1c152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:29.949212 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:34:29.981555 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba9bc2-4fdc-41dd-a778-c57c60e1c152 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:29.988121 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85afb6-9337-49b3-b691-6640d3faaf5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:29.988811 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85afb6-9337-49b3-b691-6640d3faaf5f service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:29.989123 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85afb6-9337-49b3-b691-6640d3faaf5f service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:29.989435 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85afb6-9337-49b3-b691-6640d3faaf5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:30.060928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85afb6-9337-49b3-b691-6640d3faaf5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:30.062568 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85afb6-9337-49b3-b691-6640d3faaf5f service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:30.073354 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1353/2715] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:34:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:34:31.037762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c46d6-3be0-41a8-92a1-95d67bd3ecd5 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:31.038272 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c46d6-3be0-41a8-92a1-95d67bd3ecd5 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:31.038272 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c46d6-3be0-41a8-92a1-95d67bd3ecd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:31.056361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c01c46d6-3be0-41a8-92a1-95d67bd3ecd5 None None] MFA Rules not processed for user `1a1352f6402f496490656800297c3a44`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:34:31.057612 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c01c46d6-3be0-41a8-92a1-95d67bd3ecd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:31.064697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1363/2716] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:34:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:34:40.068672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=36 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:34:41.050461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=22 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:34:47.508806 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aa00b-910b-406e-a83a-a70158225242 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:47.509335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aa00b-910b-406e-a83a-a70158225242 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:47.509536 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aa00b-910b-406e-a83a-a70158225242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:47.527199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1b1aa00b-910b-406e-a83a-a70158225242 None None] MFA Rules not processed for user `f95e7e055704446ab4f592b6da2adb70`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:34:47.528420 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1b1aa00b-910b-406e-a83a-a70158225242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:47.604987 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1354/2717] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:34:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:34:57.596379 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=25 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:34:58.009211 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c46d6-3be0-41a8-92a1-95d67bd3ecd5 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:58.064558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c46d6-3be0-41a8-92a1-95d67bd3ecd5 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:58.068717 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e28109-20f5-4a8e-a254-c245c2b13614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:58.069391 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28109-20f5-4a8e-a254-c245c2b13614 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:58.069679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28109-20f5-4a8e-a254-c245c2b13614 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:58.069959 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28109-20f5-4a8e-a254-c245c2b13614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:58.079250 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e28109-20f5-4a8e-a254-c245c2b13614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:58.080722 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e28109-20f5-4a8e-a254-c245c2b13614 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:58.090833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1364/2718] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:34:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:35:00.014224 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1aa00b-910b-406e-a83a-a70158225242 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:35:00.027520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1aa00b-910b-406e-a83a-a70158225242 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:35:00.033275 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c982fe-54c8-45a6-a7e9-356ae1ffd896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:35:00.033934 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c982fe-54c8-45a6-a7e9-356ae1ffd896 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:35:00.034214 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c982fe-54c8-45a6-a7e9-356ae1ffd896 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:35:00.034486 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c982fe-54c8-45a6-a7e9-356ae1ffd896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:35:00.036916 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f7c982fe-54c8-45a6-a7e9-356ae1ffd896 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:35:00.049865 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c982fe-54c8-45a6-a7e9-356ae1ffd896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:35:00.051970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c982fe-54c8-45a6-a7e9-356ae1ffd896 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:35:00.063147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1355/2719] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:35:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:35:08.086571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=26 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:35:10.059010 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=6 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:35:53.835763 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6d736-c68a-4e6c-a0e3-5c1930d433ff None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:35:53.836342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6d736-c68a-4e6c-a0e3-5c1930d433ff None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:35:53.836803 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6d736-c68a-4e6c-a0e3-5c1930d433ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:35:53.875028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-cee6d736-c68a-4e6c-a0e3-5c1930d433ff None None] MFA Rules not processed for user `54189575a60a4d9dbaabb78d44e9c31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:35:53.876300 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-cee6d736-c68a-4e6c-a0e3-5c1930d433ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:35:53.959646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1365/2720] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Jul 12 18:35:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:35:54.005416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c982fe-54c8-45a6-a7e9-356ae1ffd896 service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:35:54.006829 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f7c982fe-54c8-45a6-a7e9-356ae1ffd896 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:35:54.123226 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c982fe-54c8-45a6-a7e9-356ae1ffd896 service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:35:54.128966 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b154413-fae4-4828-b0c9-54c45d7c7700 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ade969d7aa3d49c08782a68ec5997382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:35:54.129640 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b154413-fae4-4828-b0c9-54c45d7c7700 service swift] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:35:54.129925 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b154413-fae4-4828-b0c9-54c45d7c7700 service swift] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:35:54.130204 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b154413-fae4-4828-b0c9-54c45d7c7700 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:35:54.138178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b154413-fae4-4828-b0c9-54c45d7c7700 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:35:54.139793 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b154413-fae4-4828-b0c9-54c45d7c7700 service swift] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:35:54.148005 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1356/2721] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Jul 12 18:35:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:36:03.957557 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=45 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:36:04.144748 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=54 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:36:09.743335 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4045fb-8d12-47cb-904a-c6a95f9c2585 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:36:09.743781 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4045fb-8d12-47cb-904a-c6a95f9c2585 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:36:09.743890 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4045fb-8d12-47cb-904a-c6a95f9c2585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:36:09.761835 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-da4045fb-8d12-47cb-904a-c6a95f9c2585 None None] MFA Rules not processed for user `54189575a60a4d9dbaabb78d44e9c31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:36:09.763030 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-da4045fb-8d12-47cb-904a-c6a95f9c2585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:36:09.770871 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1366/2722] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Jul 12 18:36:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:36:09.782399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b154413-fae4-4828-b0c9-54c45d7c7700 service swift] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:36:09.792887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b154413-fae4-4828-b0c9-54c45d7c7700 service swift] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:36:09.798404 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae6e95-8d3c-4869-bdf5-4fee5e1a1bb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ade969d7aa3d49c08782a68ec5997382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:36:09.799033 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae6e95-8d3c-4869-bdf5-4fee5e1a1bb0 service swift] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:36:09.799316 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae6e95-8d3c-4869-bdf5-4fee5e1a1bb0 service swift] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:36:09.799588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae6e95-8d3c-4869-bdf5-4fee5e1a1bb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:36:09.807631 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae6e95-8d3c-4869-bdf5-4fee5e1a1bb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:36:09.809213 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae6e95-8d3c-4869-bdf5-4fee5e1a1bb0 service swift] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:36:09.818038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1357/2723] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Jul 12 18:36:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:36:19.757156 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:36:19.814776 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=6 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:36:24.584232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7dae9-a91e-4537-bc16-b778d81604a3 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:36:24.584685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7dae9-a91e-4537-bc16-b778d81604a3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:36:24.584794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7dae9-a91e-4537-bc16-b778d81604a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:36:24.603361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-99f7dae9-a91e-4537-bc16-b778d81604a3 None None] MFA Rules not processed for user `54189575a60a4d9dbaabb78d44e9c31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:36:24.604520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-99f7dae9-a91e-4537-bc16-b778d81604a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:36:24.612345 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1367/2724] 10.222.0.57 () {58 vars in 967 bytes} [Tue Jul 12 18:36:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:36:24.624259 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae6e95-8d3c-4869-bdf5-4fee5e1a1bb0 service swift] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:36:24.634862 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae6e95-8d3c-4869-bdf5-4fee5e1a1bb0 service swift] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:36:24.639773 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63f73b-f945-4b94-ba7a-4736016182a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ade969d7aa3d49c08782a68ec5997382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:36:24.640395 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63f73b-f945-4b94-ba7a-4736016182a6 service swift] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:36:24.640674 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63f73b-f945-4b94-ba7a-4736016182a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:36:24.640950 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63f73b-f945-4b94-ba7a-4736016182a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:36:24.648772 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63f73b-f945-4b94-ba7a-4736016182a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:36:24.650367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63f73b-f945-4b94-ba7a-4736016182a6 service swift] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:36:24.658752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1358/2725] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Jul 12 18:36:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:36:34.597975 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:36:34.655017 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=6 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:36:49.870261 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7dae9-a91e-4537-bc16-b778d81604a3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:36:49.872094 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-99f7dae9-a91e-4537-bc16-b778d81604a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:36:49.967466 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7dae9-a91e-4537-bc16-b778d81604a3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:36:49.972446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfc53c-0842-4bc6-8df3-9f7864289b0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206242c775be40c7b96af6de635e2065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:36:49.973078 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfc53c-0842-4bc6-8df3-9f7864289b0b service placement] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:36:49.973389 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfc53c-0842-4bc6-8df3-9f7864289b0b service placement] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:36:49.973665 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfc53c-0842-4bc6-8df3-9f7864289b0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:36:49.975407 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b2bfc53c-0842-4bc6-8df3-9f7864289b0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:36:49.986489 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bfc53c-0842-4bc6-8df3-9f7864289b0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:36:49.988064 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bfc53c-0842-4bc6-8df3-9f7864289b0b service placement] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:36:49.997987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1368/2726] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:36:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:36:59.993522 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=41 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:37:09.155303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63f73b-f945-4b94-ba7a-4736016182a6 service swift] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:37:09.156887 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-dc63f73b-f945-4b94-ba7a-4736016182a6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:37:09.171895 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63f73b-f945-4b94-ba7a-4736016182a6 service swift] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:37:09.176937 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4caea-64d6-43b2-9b69-8023f460d202 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206242c775be40c7b96af6de635e2065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:37:09.177809 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4caea-64d6-43b2-9b69-8023f460d202 service placement] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:09.178159 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4caea-64d6-43b2-9b69-8023f460d202 service placement] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:09.178496 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4caea-64d6-43b2-9b69-8023f460d202 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:09.180306 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8bd4caea-64d6-43b2-9b69-8023f460d202 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:37:09.193210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4caea-64d6-43b2-9b69-8023f460d202 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:37:09.194818 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4caea-64d6-43b2-9b69-8023f460d202 service placement] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:37:09.215611 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1359/2727] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:37:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:37:09.230918 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfc53c-0842-4bc6-8df3-9f7864289b0b service placement] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:37:09.232443 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b2bfc53c-0842-4bc6-8df3-9f7864289b0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:37:09.338011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfc53c-0842-4bc6-8df3-9f7864289b0b service placement] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:37:09.342564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d608e-28fd-401e-82ca-94ce830e3e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:37:09.343438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d608e-28fd-401e-82ca-94ce830e3e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:09.343720 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d608e-28fd-401e-82ca-94ce830e3e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:09.343994 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d608e-28fd-401e-82ca-94ce830e3e11 admin admin] PATH_INFO: `/v3/users/f95e7e055704446ab4f592b6da2adb70` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:09.345189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d608e-28fd-401e-82ca-94ce830e3e11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f95e7e055704446ab4f592b6da2adb70)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:37:09.347151 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d608e-28fd-401e-82ca-94ce830e3e11 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:37:09.391805 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d69d608e-28fd-401e-82ca-94ce830e3e11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f95e7e055704446ab4f592b6da2adb70'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:37:09.392456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d69d608e-28fd-401e-82ca-94ce830e3e11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f95e7e055704446ab4f592b6da2adb70'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:37:09.404137 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d69d608e-28fd-401e-82ca-94ce830e3e11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f95e7e055704446ab4f592b6da2adb70'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:37:09.411681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d69d608e-28fd-401e-82ca-94ce830e3e11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f95e7e055704446ab4f592b6da2adb70'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:37:09.412335 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d69d608e-28fd-401e-82ca-94ce830e3e11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f95e7e055704446ab4f592b6da2adb70'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:37:09.425156 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1369/2728] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:37:09 2022] DELETE /identity/v3/users/f95e7e055704446ab4f592b6da2adb70 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:37:09.603684 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4caea-64d6-43b2-9b69-8023f460d202 service placement] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:37:09.619105 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4caea-64d6-43b2-9b69-8023f460d202 service placement] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:37:09.678269 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e604d0-59f2-4231-9f27-4be410b8ed93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:37:09.679279 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e604d0-59f2-4231-9f27-4be410b8ed93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:09.679627 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e604d0-59f2-4231-9f27-4be410b8ed93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:09.679912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e604d0-59f2-4231-9f27-4be410b8ed93 admin admin] PATH_INFO: `/v3/projects/0673034e36554471825a5a135a60991d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:09.681178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e604d0-59f2-4231-9f27-4be410b8ed93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0673034e36554471825a5a135a60991d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:37:09.683139 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e604d0-59f2-4231-9f27-4be410b8ed93 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:37:09.733407 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d6e604d0-59f2-4231-9f27-4be410b8ed93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0673034e36554471825a5a135a60991d', 'request_id': 'req-d6e604d0-59f2-4231-9f27-4be410b8ed93'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:37:09.738994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d6e604d0-59f2-4231-9f27-4be410b8ed93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0673034e36554471825a5a135a60991d', 'request_id': 'req-d6e604d0-59f2-4231-9f27-4be410b8ed93'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:37:09.745367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d6e604d0-59f2-4231-9f27-4be410b8ed93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0673034e36554471825a5a135a60991d', 'request_id': 'req-d6e604d0-59f2-4231-9f27-4be410b8ed93'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:37:09.760162 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d6e604d0-59f2-4231-9f27-4be410b8ed93 admin admin] The token cache is being invalidate because project 0673034e36554471825a5a135a60991d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:37:09.760162 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d6e604d0-59f2-4231-9f27-4be410b8ed93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:37:09.761013 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d6e604d0-59f2-4231-9f27-4be410b8ed93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:37:09.762575 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1360/2729] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:37:09 2022] DELETE /identity/v3/projects/0673034e36554471825a5a135a60991d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:37:09.767913 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ece6f-b712-4a3e-b3f8-0304a029b078 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:09.768201 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ece6f-b712-4a3e-b3f8-0304a029b078 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:09.768485 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ece6f-b712-4a3e-b3f8-0304a029b078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:09.830252 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9a8ece6f-b712-4a3e-b3f8-0304a029b078 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:37:09.831505 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9a8ece6f-b712-4a3e-b3f8-0304a029b078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:37:09.845175 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:37:09.899543 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1370/2730] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:37:09.903400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e7d89-a392-4e5c-98a3-1307db78e042 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:09.903692 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e7d89-a392-4e5c-98a3-1307db78e042 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:09.903975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e7d89-a392-4e5c-98a3-1307db78e042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:09.923215 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-228e7d89-a392-4e5c-98a3-1307db78e042 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:37:09.924460 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-228e7d89-a392-4e5c-98a3-1307db78e042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:37:09.932791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1361/2731] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:37:09.937777 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ece6f-b712-4a3e-b3f8-0304a029b078 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:37:09.947900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ece6f-b712-4a3e-b3f8-0304a029b078 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:37:09.953081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edc8f2-55cb-451b-ac5d-2ccc5f7eba78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:37:09.953775 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edc8f2-55cb-451b-ac5d-2ccc5f7eba78 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:09.954061 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edc8f2-55cb-451b-ac5d-2ccc5f7eba78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:09.954341 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edc8f2-55cb-451b-ac5d-2ccc5f7eba78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:09.955077 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edc8f2-55cb-451b-ac5d-2ccc5f7eba78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:37:09.955389 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edc8f2-55cb-451b-ac5d-2ccc5f7eba78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:37:09.958120 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edc8f2-55cb-451b-ac5d-2ccc5f7eba78 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:37:09.969734 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1371/2732] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:37:09.974134 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e7d89-a392-4e5c-98a3-1307db78e042 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:37:09.983647 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e7d89-a392-4e5c-98a3-1307db78e042 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:37:09.988353 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56df626-9c77-420e-88c5-dc9c9e4fb6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:37:09.989003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56df626-9c77-420e-88c5-dc9c9e4fb6af admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:09.989313 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56df626-9c77-420e-88c5-dc9c9e4fb6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:09.989593 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56df626-9c77-420e-88c5-dc9c9e4fb6af admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:09.990282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56df626-9c77-420e-88c5-dc9c9e4fb6af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:37:09.992492 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56df626-9c77-420e-88c5-dc9c9e4fb6af admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:37:10.019266 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1362/2733] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:37:09 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:37:10.023624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edc8f2-55cb-451b-ac5d-2ccc5f7eba78 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:37:10.038719 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edc8f2-55cb-451b-ac5d-2ccc5f7eba78 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:37:10.072827 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fe210-7c0f-49ea-82e1-8e7c659c0693 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:10.073668 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fe210-7c0f-49ea-82e1-8e7c659c0693 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:10.073959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fe210-7c0f-49ea-82e1-8e7c659c0693 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:10.075322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1363/2734] 10.222.0.57 () {54 vars in 921 bytes} [Tue Jul 12 18:37:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:37:10.081785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1f556-4967-42d4-a8c5-abb517779e53 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:10.082067 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1f556-4967-42d4-a8c5-abb517779e53 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:10.082935 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1f556-4967-42d4-a8c5-abb517779e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:10.105790 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dfcbb-35d6-43bd-a4f8-a140cf13a48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:37:10.106700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dfcbb-35d6-43bd-a4f8-a140cf13a48d admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:10.106989 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dfcbb-35d6-43bd-a4f8-a140cf13a48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:10.107273 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dfcbb-35d6-43bd-a4f8-a140cf13a48d admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:10.108016 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164dfcbb-35d6-43bd-a4f8-a140cf13a48d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:37:10.110025 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164dfcbb-35d6-43bd-a4f8-a140cf13a48d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:37:10.119920 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-15b1f556-4967-42d4-a8c5-abb517779e53 None None] MFA Rules not processed for user `b6dc63ae259842209831040cbf45d316`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:37:10.121116 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-15b1f556-4967-42d4-a8c5-abb517779e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:37:10.136812 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1372/2735] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:37:10 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:37:10.137569 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dfcbb-35d6-43bd-a4f8-a140cf13a48d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:37:10.148469 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dfcbb-35d6-43bd-a4f8-a140cf13a48d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:37:10.153369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944887e8-20fb-40d1-aebd-c24752f54a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:37:10.154045 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944887e8-20fb-40d1-aebd-c24752f54a24 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:10.154329 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944887e8-20fb-40d1-aebd-c24752f54a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:10.154610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944887e8-20fb-40d1-aebd-c24752f54a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:10.155925 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944887e8-20fb-40d1-aebd-c24752f54a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:37:10.157837 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944887e8-20fb-40d1-aebd-c24752f54a24 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:37:10.158498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:37:10.169411 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1373/2736] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:37:10.173627 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944887e8-20fb-40d1-aebd-c24752f54a24 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:37:10.184972 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944887e8-20fb-40d1-aebd-c24752f54a24 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:37:10.191047 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c0f5b-c3a9-48a9-bc6b-2bead95262b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:37:10.191775 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1364/2737] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Jul 12 18:37:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:37:10.197548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c0f5b-c3a9-48a9-bc6b-2bead95262b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:10.198171 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c0f5b-c3a9-48a9-bc6b-2bead95262b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:10.198171 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c0f5b-c3a9-48a9-bc6b-2bead95262b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:10.198882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c0f5b-c3a9-48a9-bc6b-2bead95262b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:37:10.200559 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c0f5b-c3a9-48a9-bc6b-2bead95262b0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:37:10.207055 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1f556-4967-42d4-a8c5-abb517779e53 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:37:10.209206 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-15b1f556-4967-42d4-a8c5-abb517779e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:37:10.214509 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1374/2738] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:37:10.219095 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c0f5b-c3a9-48a9-bc6b-2bead95262b0 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:37:10.223124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1f556-4967-42d4-a8c5-abb517779e53 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:37:10.227323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05e4b8-acdb-4fbf-8bc5-7350f438c8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:37:10.227966 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05e4b8-acdb-4fbf-8bc5-7350f438c8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:10.228251 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05e4b8-acdb-4fbf-8bc5-7350f438c8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:10.228526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05e4b8-acdb-4fbf-8bc5-7350f438c8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:10.229086 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c0f5b-c3a9-48a9-bc6b-2bead95262b0 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:37:10.233671 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587a2cd-45b8-4c00-a85d-38ebb89237c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:37:10.234532 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587a2cd-45b8-4c00-a85d-38ebb89237c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:10.234814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587a2cd-45b8-4c00-a85d-38ebb89237c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:10.235084 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587a2cd-45b8-4c00-a85d-38ebb89237c2 admin admin] PATH_INFO: `/v3/projects/4dd7a69667df4ae7bf94effe6b5a3b2c/users/419f1db80dc74f37a6583934ff38731f/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:10.236579 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05e4b8-acdb-4fbf-8bc5-7350f438c8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:37:10.238053 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05e4b8-acdb-4fbf-8bc5-7350f438c8b1 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:37:10.246176 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1365/2739] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:37:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:37:10.250070 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587a2cd-45b8-4c00-a85d-38ebb89237c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd7a69667df4ae7bf94effe6b5a3b2c, user_id=419f1db80dc74f37a6583934ff38731f, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:37:10.252709 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587a2cd-45b8-4c00-a85d-38ebb89237c2 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:37:10.267011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1375/2740] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:37:10 2022] PUT /identity/v3/projects/4dd7a69667df4ae7bf94effe6b5a3b2c/users/419f1db80dc74f37a6583934ff38731f/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:37:10.271985 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01aa94-c563-49af-a090-bfdca1f80b26 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:10.272272 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01aa94-c563-49af-a090-bfdca1f80b26 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:10.272554 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01aa94-c563-49af-a090-bfdca1f80b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:10.289794 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4a01aa94-c563-49af-a090-bfdca1f80b26 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:37:10.290986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4a01aa94-c563-49af-a090-bfdca1f80b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:37:10.350078 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1366/2741] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:37:10.359447 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587a2cd-45b8-4c00-a85d-38ebb89237c2 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:37:10.413422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587a2cd-45b8-4c00-a85d-38ebb89237c2 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:37:10.417072 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fc5f2-61fe-4151-b0e5-fb302cf51e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:37:10.417740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fc5f2-61fe-4151-b0e5-fb302cf51e3f service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:10.418023 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fc5f2-61fe-4151-b0e5-fb302cf51e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:10.418298 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fc5f2-61fe-4151-b0e5-fb302cf51e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:10.424161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:37:10.428524 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4fc5f2-61fe-4151-b0e5-fb302cf51e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:37:10.430156 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4fc5f2-61fe-4151-b0e5-fb302cf51e3f service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:37:10.440628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1376/2742] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:37:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:37:11.362221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861a30c-c54a-44cc-a54a-7e993a2f0e60 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:11.363250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861a30c-c54a-44cc-a54a-7e993a2f0e60 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:11.363812 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861a30c-c54a-44cc-a54a-7e993a2f0e60 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:11.365450 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1367/2743] 10.222.0.57 () {54 vars in 921 bytes} [Tue Jul 12 18:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:37:11.374265 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578cafd-f35f-47d8-a698-810e867031bd None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:11.375179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578cafd-f35f-47d8-a698-810e867031bd None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:11.375603 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578cafd-f35f-47d8-a698-810e867031bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:11.431713 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e578cafd-f35f-47d8-a698-810e867031bd None None] MFA Rules not processed for user `a7c1bb51c2b642ffa4708122d826fc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:37:11.433313 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e578cafd-f35f-47d8-a698-810e867031bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:37:11.537408 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1377/2744] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Jul 12 18:37:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:37:11.549781 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861a30c-c54a-44cc-a54a-7e993a2f0e60 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:37:11.563498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861a30c-c54a-44cc-a54a-7e993a2f0e60 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:37:11.571969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d82ba-a615-4247-9e8e-5ea85a52b7d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:37:11.572927 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d82ba-a615-4247-9e8e-5ea85a52b7d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:11.573419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d82ba-a615-4247-9e8e-5ea85a52b7d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:11.573925 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d82ba-a615-4247-9e8e-5ea85a52b7d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:11.587096 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d82ba-a615-4247-9e8e-5ea85a52b7d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:37:11.588821 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d82ba-a615-4247-9e8e-5ea85a52b7d0 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:37:11.603525 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1368/2745] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:37:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:37:14.697111 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5006f-754a-4957-b55c-3b0e6e7fec78 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:14.697608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5006f-754a-4957-b55c-3b0e6e7fec78 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:14.697705 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5006f-754a-4957-b55c-3b0e6e7fec78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:14.727140 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2ff5006f-754a-4957-b55c-3b0e6e7fec78 None None] MFA Rules not processed for user `419f1db80dc74f37a6583934ff38731f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:37:14.728370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2ff5006f-754a-4957-b55c-3b0e6e7fec78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:37:14.794999 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1378/2746] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:37:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:37:14.809815 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d82ba-a615-4247-9e8e-5ea85a52b7d0 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:37:14.811340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ca4d82ba-a615-4247-9e8e-5ea85a52b7d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:37:14.826876 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d82ba-a615-4247-9e8e-5ea85a52b7d0 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:37:14.832885 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23702511-6024-45e4-afb0-c851c21844e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:37:14.833577 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23702511-6024-45e4-afb0-c851c21844e6 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:14.833899 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23702511-6024-45e4-afb0-c851c21844e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:14.834116 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23702511-6024-45e4-afb0-c851c21844e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:14.843767 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23702511-6024-45e4-afb0-c851c21844e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:37:14.845440 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23702511-6024-45e4-afb0-c851c21844e6 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:37:14.866112 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1369/2747] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:37:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:37:16.557780 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e0373-7e9e-4973-bf63-3e8baeea4638 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:16.559113 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e0373-7e9e-4973-bf63-3e8baeea4638 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:16.559600 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e0373-7e9e-4973-bf63-3e8baeea4638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:16.579208 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9d2e0373-7e9e-4973-bf63-3e8baeea4638 None None] MFA Rules not processed for user `419f1db80dc74f37a6583934ff38731f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:37:16.580444 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9d2e0373-7e9e-4973-bf63-3e8baeea4638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:37:16.587482 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1379/2748] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:37:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:37:16.924029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23702511-6024-45e4-afb0-c851c21844e6 service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:37:16.925665 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-23702511-6024-45e4-afb0-c851c21844e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:37:16.937703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23702511-6024-45e4-afb0-c851c21844e6 service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:37:16.941853 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7926927-2cb2-4133-915a-5cc19d5b2570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:37:16.942497 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7926927-2cb2-4133-915a-5cc19d5b2570 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:37:16.942810 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7926927-2cb2-4133-915a-5cc19d5b2570 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:37:16.943089 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7926927-2cb2-4133-915a-5cc19d5b2570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:37:16.945152 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e7926927-2cb2-4133-915a-5cc19d5b2570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:37:16.955958 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7926927-2cb2-4133-915a-5cc19d5b2570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:37:16.957550 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7926927-2cb2-4133-915a-5cc19d5b2570 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:37:16.966443 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1370/2749] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:37:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:37:26.573680 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=78 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:37:26.962449 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=61 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:10.410319 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e0373-7e9e-4973-bf63-3e8baeea4638 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:38:10.411698 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9d2e0373-7e9e-4973-bf63-3e8baeea4638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:38:10.490316 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e0373-7e9e-4973-bf63-3e8baeea4638 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:38:10.493924 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209fe59-7f71-4a3e-ad3e-9ecca448397a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:38:10.494563 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209fe59-7f71-4a3e-ad3e-9ecca448397a service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:38:10.494846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209fe59-7f71-4a3e-ad3e-9ecca448397a service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:38:10.495120 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209fe59-7f71-4a3e-ad3e-9ecca448397a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:38:10.497155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0209fe59-7f71-4a3e-ad3e-9ecca448397a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:38:10.510438 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209fe59-7f71-4a3e-ad3e-9ecca448397a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:38:10.511862 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209fe59-7f71-4a3e-ad3e-9ecca448397a service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:38:10.522651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1380/2750] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:38:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:38:14.321029 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7926927-2cb2-4133-915a-5cc19d5b2570 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:38:14.329962 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7926927-2cb2-4133-915a-5cc19d5b2570 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:38:14.333677 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e64cb3-8b98-4db7-b23c-39591d67c649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:38:14.334310 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e64cb3-8b98-4db7-b23c-39591d67c649 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:38:14.334596 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e64cb3-8b98-4db7-b23c-39591d67c649 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:38:14.334896 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e64cb3-8b98-4db7-b23c-39591d67c649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:38:14.336673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-38e64cb3-8b98-4db7-b23c-39591d67c649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:38:14.349892 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e64cb3-8b98-4db7-b23c-39591d67c649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:38:14.351312 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e64cb3-8b98-4db7-b23c-39591d67c649 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:38:14.362907 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1371/2751] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:38:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:38:20.517867 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=35 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:24.357902 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=6 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:40.702250 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209fe59-7f71-4a3e-ad3e-9ecca448397a service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:38:40.726714 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209fe59-7f71-4a3e-ad3e-9ecca448397a service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:38:40.730864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdf501-7372-418d-9d7a-12df0923dd47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:38:40.731522 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdf501-7372-418d-9d7a-12df0923dd47 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:38:40.731811 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdf501-7372-418d-9d7a-12df0923dd47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:38:40.732235 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdf501-7372-418d-9d7a-12df0923dd47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:38:40.734155 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f3bdf501-7372-418d-9d7a-12df0923dd47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:38:40.745778 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdf501-7372-418d-9d7a-12df0923dd47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:38:40.747243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdf501-7372-418d-9d7a-12df0923dd47 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:38:40.757844 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1381/2752] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:38:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:38:50.608584 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e64cb3-8b98-4db7-b23c-39591d67c649 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:38:50.611446 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-38e64cb3-8b98-4db7-b23c-39591d67c649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:38:50.633621 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e64cb3-8b98-4db7-b23c-39591d67c649 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:38:50.638154 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a471280-f8bf-494c-8a9b-98d8422723a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:38:50.639069 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a471280-f8bf-494c-8a9b-98d8422723a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:38:50.639348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a471280-f8bf-494c-8a9b-98d8422723a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:38:50.639619 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a471280-f8bf-494c-8a9b-98d8422723a9 admin admin] PATH_INFO: `/v3/users/1a1352f6402f496490656800297c3a44` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:38:50.640801 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a471280-f8bf-494c-8a9b-98d8422723a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a1352f6402f496490656800297c3a44)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:38:50.642727 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a471280-f8bf-494c-8a9b-98d8422723a9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:38:50.690992 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4a471280-f8bf-494c-8a9b-98d8422723a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a1352f6402f496490656800297c3a44'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:50.691640 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4a471280-f8bf-494c-8a9b-98d8422723a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a1352f6402f496490656800297c3a44'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:50.699073 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4a471280-f8bf-494c-8a9b-98d8422723a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a1352f6402f496490656800297c3a44'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:50.699681 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4a471280-f8bf-494c-8a9b-98d8422723a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a1352f6402f496490656800297c3a44'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:50.706651 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4a471280-f8bf-494c-8a9b-98d8422723a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a1352f6402f496490656800297c3a44'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:50.724321 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1372/2753] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:38:50 2022] DELETE /identity/v3/users/1a1352f6402f496490656800297c3a44 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:38:50.754464 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=6 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:50.894531 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdf501-7372-418d-9d7a-12df0923dd47 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:38:50.906923 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdf501-7372-418d-9d7a-12df0923dd47 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:38:50.963061 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8bcd6-5ccf-49b4-ba07-a82b931884b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:38:50.963926 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8bcd6-5ccf-49b4-ba07-a82b931884b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:38:50.964209 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8bcd6-5ccf-49b4-ba07-a82b931884b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:38:50.964486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8bcd6-5ccf-49b4-ba07-a82b931884b0 admin admin] PATH_INFO: `/v3/projects/a5b6bf56eaab493694bd240454a47e1a` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:38:50.965716 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8bcd6-5ccf-49b4-ba07-a82b931884b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b6bf56eaab493694bd240454a47e1a)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:38:50.968128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8bcd6-5ccf-49b4-ba07-a82b931884b0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:38:51.014296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-fec8bcd6-5ccf-49b4-ba07-a82b931884b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b6bf56eaab493694bd240454a47e1a', 'request_id': 'req-fec8bcd6-5ccf-49b4-ba07-a82b931884b0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:51.021230 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-fec8bcd6-5ccf-49b4-ba07-a82b931884b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b6bf56eaab493694bd240454a47e1a', 'request_id': 'req-fec8bcd6-5ccf-49b4-ba07-a82b931884b0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:51.026695 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-fec8bcd6-5ccf-49b4-ba07-a82b931884b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b6bf56eaab493694bd240454a47e1a', 'request_id': 'req-fec8bcd6-5ccf-49b4-ba07-a82b931884b0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:51.037760 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-fec8bcd6-5ccf-49b4-ba07-a82b931884b0 admin admin] The token cache is being invalidate because project a5b6bf56eaab493694bd240454a47e1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:38:51.038046 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-fec8bcd6-5ccf-49b4-ba07-a82b931884b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:51.038662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-fec8bcd6-5ccf-49b4-ba07-a82b931884b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:51.040337 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1382/2754] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:38:50 2022] DELETE /identity/v3/projects/a5b6bf56eaab493694bd240454a47e1a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:38:51.044454 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a471280-f8bf-494c-8a9b-98d8422723a9 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:38:51.046464 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4a471280-f8bf-494c-8a9b-98d8422723a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:38:51.060181 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a471280-f8bf-494c-8a9b-98d8422723a9 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:38:51.116701 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd083b66-2d2c-4b04-833f-8db5687d432d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:38:51.117592 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd083b66-2d2c-4b04-833f-8db5687d432d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:38:51.117871 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd083b66-2d2c-4b04-833f-8db5687d432d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:38:51.118143 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd083b66-2d2c-4b04-833f-8db5687d432d admin admin] PATH_INFO: `/v3/users/3eb600d1eaea47318ec305cc6967c278` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:38:51.119344 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd083b66-2d2c-4b04-833f-8db5687d432d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb600d1eaea47318ec305cc6967c278)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:38:51.121248 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd083b66-2d2c-4b04-833f-8db5687d432d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:38:51.166614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bd083b66-2d2c-4b04-833f-8db5687d432d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb600d1eaea47318ec305cc6967c278'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:51.167162 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bd083b66-2d2c-4b04-833f-8db5687d432d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb600d1eaea47318ec305cc6967c278'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:51.174238 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bd083b66-2d2c-4b04-833f-8db5687d432d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb600d1eaea47318ec305cc6967c278'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:51.174836 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bd083b66-2d2c-4b04-833f-8db5687d432d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb600d1eaea47318ec305cc6967c278'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:51.181595 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bd083b66-2d2c-4b04-833f-8db5687d432d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb600d1eaea47318ec305cc6967c278'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:51.189151 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:51.200107 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1373/2755] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:38:51 2022] DELETE /identity/v3/users/3eb600d1eaea47318ec305cc6967c278 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:38:51.376647 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8bcd6-5ccf-49b4-ba07-a82b931884b0 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:38:51.378129 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-fec8bcd6-5ccf-49b4-ba07-a82b931884b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:38:51.392294 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8bcd6-5ccf-49b4-ba07-a82b931884b0 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:38:51.447761 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad803cc-324f-42ff-b173-04be4aec85bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:38:51.448810 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad803cc-324f-42ff-b173-04be4aec85bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:38:51.449087 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad803cc-324f-42ff-b173-04be4aec85bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:38:51.449387 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad803cc-324f-42ff-b173-04be4aec85bd admin admin] PATH_INFO: `/v3/projects/36f7f4162e91415089eb7fb9206a9a1b` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:38:51.450571 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad803cc-324f-42ff-b173-04be4aec85bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f7f4162e91415089eb7fb9206a9a1b)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:38:51.453039 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad803cc-324f-42ff-b173-04be4aec85bd admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:38:51.487732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:51.501480 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3ad803cc-324f-42ff-b173-04be4aec85bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f7f4162e91415089eb7fb9206a9a1b', 'request_id': 'req-3ad803cc-324f-42ff-b173-04be4aec85bd'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:51.509192 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3ad803cc-324f-42ff-b173-04be4aec85bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f7f4162e91415089eb7fb9206a9a1b', 'request_id': 'req-3ad803cc-324f-42ff-b173-04be4aec85bd'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:51.515532 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3ad803cc-324f-42ff-b173-04be4aec85bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f7f4162e91415089eb7fb9206a9a1b', 'request_id': 'req-3ad803cc-324f-42ff-b173-04be4aec85bd'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:51.526667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3ad803cc-324f-42ff-b173-04be4aec85bd admin admin] The token cache is being invalidate because project 36f7f4162e91415089eb7fb9206a9a1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:38:51.526970 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3ad803cc-324f-42ff-b173-04be4aec85bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:51.527587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3ad803cc-324f-42ff-b173-04be4aec85bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:38:51.529106 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1383/2756] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:38:51 2022] DELETE /identity/v3/projects/36f7f4162e91415089eb7fb9206a9a1b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:39:01.199316 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:39:01.523616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:39:59.559930 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40b6df-ca42-41b9-98e0-ede260fb6070 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:39:59.560478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40b6df-ca42-41b9-98e0-ede260fb6070 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:39:59.560581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40b6df-ca42-41b9-98e0-ede260fb6070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:39:59.579782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-eb40b6df-ca42-41b9-98e0-ede260fb6070 None None] MFA Rules not processed for user `419f1db80dc74f37a6583934ff38731f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:39:59.581167 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-eb40b6df-ca42-41b9-98e0-ede260fb6070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:39:59.636083 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1374/2757] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:39:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:39:59.932854 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad803cc-324f-42ff-b173-04be4aec85bd admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:39:59.934320 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3ad803cc-324f-42ff-b173-04be4aec85bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:40:00.000322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad803cc-324f-42ff-b173-04be4aec85bd admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:40:00.004412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7684e5-048b-4b4e-b09e-1cef264638ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:40:00.005055 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7684e5-048b-4b4e-b09e-1cef264638ac service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:40:00.005379 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7684e5-048b-4b4e-b09e-1cef264638ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:40:00.005660 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7684e5-048b-4b4e-b09e-1cef264638ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:40:00.007455 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-db7684e5-048b-4b4e-b09e-1cef264638ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:40:00.016897 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7684e5-048b-4b4e-b09e-1cef264638ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:40:00.018391 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7684e5-048b-4b4e-b09e-1cef264638ac service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:40:00.027300 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1384/2758] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:39:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:40:00.344820 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40b6df-ca42-41b9-98e0-ede260fb6070 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:40:00.346862 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-eb40b6df-ca42-41b9-98e0-ede260fb6070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:40:00.416511 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40b6df-ca42-41b9-98e0-ede260fb6070 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:40:00.421476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdb9b5-dd78-4ece-a7c2-f3b98865664b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206242c775be40c7b96af6de635e2065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:40:00.422121 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdb9b5-dd78-4ece-a7c2-f3b98865664b service placement] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:40:00.422403 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdb9b5-dd78-4ece-a7c2-f3b98865664b service placement] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:40:00.422675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdb9b5-dd78-4ece-a7c2-f3b98865664b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:40:00.425340 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a3cdb9b5-dd78-4ece-a7c2-f3b98865664b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:40:00.437382 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdb9b5-dd78-4ece-a7c2-f3b98865664b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:40:00.438988 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdb9b5-dd78-4ece-a7c2-f3b98865664b service placement] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:40:00.448944 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1375/2759] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:40:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:40:02.879365 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7684e5-048b-4b4e-b09e-1cef264638ac service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:40:02.881362 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-db7684e5-048b-4b4e-b09e-1cef264638ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:40:02.981576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7684e5-048b-4b4e-b09e-1cef264638ac service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:40:02.989654 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e90c6-aae7-46d4-aa2e-df56898ca689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:40:02.990407 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e90c6-aae7-46d4-aa2e-df56898ca689 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:40:02.990693 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e90c6-aae7-46d4-aa2e-df56898ca689 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:40:02.990969 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e90c6-aae7-46d4-aa2e-df56898ca689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:40:02.992876 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9b3e90c6-aae7-46d4-aa2e-df56898ca689 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:40:03.006531 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e90c6-aae7-46d4-aa2e-df56898ca689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:40:03.008159 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e90c6-aae7-46d4-aa2e-df56898ca689 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:40:03.020553 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1385/2760] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:40:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:40:08.226607 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdb9b5-dd78-4ece-a7c2-f3b98865664b service placement] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:40:08.228058 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a3cdb9b5-dd78-4ece-a7c2-f3b98865664b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:40:08.245469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdb9b5-dd78-4ece-a7c2-f3b98865664b service placement] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:40:08.251062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f23408-a25d-47fa-94bb-c109f66432f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:40:08.252194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f23408-a25d-47fa-94bb-c109f66432f1 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:40:08.252476 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f23408-a25d-47fa-94bb-c109f66432f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:40:08.252754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f23408-a25d-47fa-94bb-c109f66432f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:40:08.254544 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a4f23408-a25d-47fa-94bb-c109f66432f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:40:08.267964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f23408-a25d-47fa-94bb-c109f66432f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:40:08.269586 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f23408-a25d-47fa-94bb-c109f66432f1 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:40:08.280785 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1376/2761] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:40:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:40:13.015570 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=60 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:40:18.275854 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=63 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:10.852311 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e90c6-aae7-46d4-aa2e-df56898ca689 service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:10.855014 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9b3e90c6-aae7-46d4-aa2e-df56898ca689 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:10.919117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e90c6-aae7-46d4-aa2e-df56898ca689 service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:10.923589 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af1c95-6b8d-4cdf-9aca-c2a499cc1319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:10.924453 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af1c95-6b8d-4cdf-9aca-c2a499cc1319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:10.924730 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af1c95-6b8d-4cdf-9aca-c2a499cc1319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:10.925002 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af1c95-6b8d-4cdf-9aca-c2a499cc1319 admin admin] PATH_INFO: `/v3/users/419f1db80dc74f37a6583934ff38731f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:10.926201 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af1c95-6b8d-4cdf-9aca-c2a499cc1319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=419f1db80dc74f37a6583934ff38731f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:10.928115 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af1c95-6b8d-4cdf-9aca-c2a499cc1319 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:10.973510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-74af1c95-6b8d-4cdf-9aca-c2a499cc1319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419f1db80dc74f37a6583934ff38731f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:10.974167 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-74af1c95-6b8d-4cdf-9aca-c2a499cc1319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419f1db80dc74f37a6583934ff38731f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:10.986760 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-74af1c95-6b8d-4cdf-9aca-c2a499cc1319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419f1db80dc74f37a6583934ff38731f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:10.993625 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-74af1c95-6b8d-4cdf-9aca-c2a499cc1319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419f1db80dc74f37a6583934ff38731f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:10.994262 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-74af1c95-6b8d-4cdf-9aca-c2a499cc1319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419f1db80dc74f37a6583934ff38731f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:11.006317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1386/2762] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:41:10 2022] DELETE /identity/v3/users/419f1db80dc74f37a6583934ff38731f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:11.179162 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f23408-a25d-47fa-94bb-c109f66432f1 service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:11.190160 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f23408-a25d-47fa-94bb-c109f66432f1 service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:11.251718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293399cd-43ce-4209-b651-f35d4da01b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:11.252577 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293399cd-43ce-4209-b651-f35d4da01b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:11.252859 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293399cd-43ce-4209-b651-f35d4da01b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:11.253136 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293399cd-43ce-4209-b651-f35d4da01b2e admin admin] PATH_INFO: `/v3/projects/4dd7a69667df4ae7bf94effe6b5a3b2c` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:11.254359 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293399cd-43ce-4209-b651-f35d4da01b2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd7a69667df4ae7bf94effe6b5a3b2c)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:11.256291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293399cd-43ce-4209-b651-f35d4da01b2e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:11.302144 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-293399cd-43ce-4209-b651-f35d4da01b2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd7a69667df4ae7bf94effe6b5a3b2c', 'request_id': 'req-293399cd-43ce-4209-b651-f35d4da01b2e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:11.307658 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-293399cd-43ce-4209-b651-f35d4da01b2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd7a69667df4ae7bf94effe6b5a3b2c', 'request_id': 'req-293399cd-43ce-4209-b651-f35d4da01b2e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:11.313599 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-293399cd-43ce-4209-b651-f35d4da01b2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd7a69667df4ae7bf94effe6b5a3b2c', 'request_id': 'req-293399cd-43ce-4209-b651-f35d4da01b2e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:11.325994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-293399cd-43ce-4209-b651-f35d4da01b2e admin admin] The token cache is being invalidate because project 4dd7a69667df4ae7bf94effe6b5a3b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:41:11.326284 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-293399cd-43ce-4209-b651-f35d4da01b2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:11.327167 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-293399cd-43ce-4209-b651-f35d4da01b2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:11.328681 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1377/2763] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:41:11 2022] DELETE /identity/v3/projects/4dd7a69667df4ae7bf94effe6b5a3b2c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:11.333587 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d9cff-cd72-4999-93ac-ab9ef56c976a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:11.333881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d9cff-cd72-4999-93ac-ab9ef56c976a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:11.334181 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d9cff-cd72-4999-93ac-ab9ef56c976a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:11.355099 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-542d9cff-cd72-4999-93ac-ab9ef56c976a None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:11.356303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-542d9cff-cd72-4999-93ac-ab9ef56c976a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:11.414301 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1387/2764] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:41:11.422931 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a324d20-9832-4e8d-892c-cf34f7474f58 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:11.423217 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a324d20-9832-4e8d-892c-cf34f7474f58 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:11.423517 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a324d20-9832-4e8d-892c-cf34f7474f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:11.441967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-0a324d20-9832-4e8d-892c-cf34f7474f58 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:11.443154 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0a324d20-9832-4e8d-892c-cf34f7474f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:11.451948 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1378/2765] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:41:11.456116 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d9cff-cd72-4999-93ac-ab9ef56c976a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:11.466277 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d9cff-cd72-4999-93ac-ab9ef56c976a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:11.470853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92966cea-62af-4a39-9caf-5d3f193c35fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:11.471492 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92966cea-62af-4a39-9caf-5d3f193c35fa admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:11.471777 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92966cea-62af-4a39-9caf-5d3f193c35fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:11.472049 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92966cea-62af-4a39-9caf-5d3f193c35fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:11.472763 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92966cea-62af-4a39-9caf-5d3f193c35fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:11.473067 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92966cea-62af-4a39-9caf-5d3f193c35fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:11.474681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92966cea-62af-4a39-9caf-5d3f193c35fa admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:11.486059 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1388/2766] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:11.490150 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a324d20-9832-4e8d-892c-cf34f7474f58 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:11.499634 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a324d20-9832-4e8d-892c-cf34f7474f58 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:11.504234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6066a8d-eef9-4015-863f-a03bc83a4e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:11.504865 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6066a8d-eef9-4015-863f-a03bc83a4e32 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:11.505142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6066a8d-eef9-4015-863f-a03bc83a4e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:11.505449 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6066a8d-eef9-4015-863f-a03bc83a4e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:11.506119 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6066a8d-eef9-4015-863f-a03bc83a4e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:11.507997 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6066a8d-eef9-4015-863f-a03bc83a4e32 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:11.543923 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1379/2767] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:41:11 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:11.547882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92966cea-62af-4a39-9caf-5d3f193c35fa admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:11.557816 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92966cea-62af-4a39-9caf-5d3f193c35fa admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:11.562931 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:11.615194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ae69c-532b-4b87-acd1-408a3e74ddb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:11.615860 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ae69c-532b-4b87-acd1-408a3e74ddb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:11.616141 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ae69c-532b-4b87-acd1-408a3e74ddb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:11.616415 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ae69c-532b-4b87-acd1-408a3e74ddb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:11.617106 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ae69c-532b-4b87-acd1-408a3e74ddb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:11.619072 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ae69c-532b-4b87-acd1-408a3e74ddb7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:11.638153 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1389/2768] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:41:11 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:41:11.642251 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6066a8d-eef9-4015-863f-a03bc83a4e32 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:11.652974 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6066a8d-eef9-4015-863f-a03bc83a4e32 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:11.657688 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fbad8-76a6-4664-bc51-6890cf32ff93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:11.658302 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fbad8-76a6-4664-bc51-6890cf32ff93 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:11.658695 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fbad8-76a6-4664-bc51-6890cf32ff93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:11.658850 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fbad8-76a6-4664-bc51-6890cf32ff93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:11.659569 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fbad8-76a6-4664-bc51-6890cf32ff93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:11.661194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fbad8-76a6-4664-bc51-6890cf32ff93 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:11.673094 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1380/2769] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:41:11.677110 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ae69c-532b-4b87-acd1-408a3e74ddb7 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:11.687240 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ae69c-532b-4b87-acd1-408a3e74ddb7 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:11.692011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328676-78d4-48c3-8a6e-7f405dfd76ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:11.692667 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328676-78d4-48c3-8a6e-7f405dfd76ec admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:11.692946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328676-78d4-48c3-8a6e-7f405dfd76ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:11.693221 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328676-78d4-48c3-8a6e-7f405dfd76ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:11.693975 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb328676-78d4-48c3-8a6e-7f405dfd76ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:11.695574 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb328676-78d4-48c3-8a6e-7f405dfd76ec admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:11.706214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1390/2770] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:41:11.710277 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fbad8-76a6-4664-bc51-6890cf32ff93 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:11.722274 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fbad8-76a6-4664-bc51-6890cf32ff93 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:11.727291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11a2af-97a6-4f3f-a8c4-4a119f4f34ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:11.728729 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11a2af-97a6-4f3f-a8c4-4a119f4f34ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:11.729011 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11a2af-97a6-4f3f-a8c4-4a119f4f34ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:11.729323 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11a2af-97a6-4f3f-a8c4-4a119f4f34ef admin admin] PATH_INFO: `/v3/projects/37542dde79574b8bb9e4565da640795f/users/b7ffebed8124491b9f7d78cca993538d/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:11.744883 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11a2af-97a6-4f3f-a8c4-4a119f4f34ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=37542dde79574b8bb9e4565da640795f, user_id=b7ffebed8124491b9f7d78cca993538d, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:11.747680 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11a2af-97a6-4f3f-a8c4-4a119f4f34ef admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:11.760594 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1381/2771] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:41:11 2022] PUT /identity/v3/projects/37542dde79574b8bb9e4565da640795f/users/b7ffebed8124491b9f7d78cca993538d/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:41:11.770816 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d102f04-1c99-4171-8cc5-0f186fb5a62a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:11.771230 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d102f04-1c99-4171-8cc5-0f186fb5a62a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:11.771577 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d102f04-1c99-4171-8cc5-0f186fb5a62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:11.802553 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6d102f04-1c99-4171-8cc5-0f186fb5a62a None None] MFA Rules not processed for user `b7ffebed8124491b9f7d78cca993538d`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:11.803780 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6d102f04-1c99-4171-8cc5-0f186fb5a62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:11.869241 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1391/2772] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:41:11.873967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11a2af-97a6-4f3f-a8c4-4a119f4f34ef admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:11.893676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:11.937920 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11a2af-97a6-4f3f-a8c4-4a119f4f34ef admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:11.942639 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62827156-1847-441e-af59-fc1f8a38c123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:11.943292 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62827156-1847-441e-af59-fc1f8a38c123 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:11.943578 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62827156-1847-441e-af59-fc1f8a38c123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:11.943854 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62827156-1847-441e-af59-fc1f8a38c123 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:11.944535 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62827156-1847-441e-af59-fc1f8a38c123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:11.946501 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62827156-1847-441e-af59-fc1f8a38c123 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:11.971035 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1382/2773] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:41:11 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:11.975135 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d102f04-1c99-4171-8cc5-0f186fb5a62a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:11.986510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d102f04-1c99-4171-8cc5-0f186fb5a62a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:12.041509 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa17011-dff6-4c35-bf93-ad2c77641eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:12.042196 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa17011-dff6-4c35-bf93-ad2c77641eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:12.042477 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa17011-dff6-4c35-bf93-ad2c77641eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:12.042749 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa17011-dff6-4c35-bf93-ad2c77641eb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:12.043431 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa17011-dff6-4c35-bf93-ad2c77641eb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:12.045412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa17011-dff6-4c35-bf93-ad2c77641eb8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:12.064853 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1392/2774] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:41:11 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:12.068918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62827156-1847-441e-af59-fc1f8a38c123 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:12.079435 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62827156-1847-441e-af59-fc1f8a38c123 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:12.084076 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30135871-f8ac-431a-9127-16e6e4554f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:12.084724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30135871-f8ac-431a-9127-16e6e4554f3c admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:12.085004 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30135871-f8ac-431a-9127-16e6e4554f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:12.085303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30135871-f8ac-431a-9127-16e6e4554f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:12.086015 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30135871-f8ac-431a-9127-16e6e4554f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:12.087648 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30135871-f8ac-431a-9127-16e6e4554f3c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:12.097900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1383/2775] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:41:12.101696 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa17011-dff6-4c35-bf93-ad2c77641eb8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:12.108296 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:12.112387 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa17011-dff6-4c35-bf93-ad2c77641eb8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:12.117995 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5560562-4daf-483f-bf67-cc5557e42937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:12.119446 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5560562-4daf-483f-bf67-cc5557e42937 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:12.119669 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5560562-4daf-483f-bf67-cc5557e42937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:12.119939 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5560562-4daf-483f-bf67-cc5557e42937 admin admin] PATH_INFO: `/v3/projects/24365e9248834e3486ea93fb64468d10/users/08a1e761f04c437aa15aa76e0d1fcacb/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:12.134220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5560562-4daf-483f-bf67-cc5557e42937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24365e9248834e3486ea93fb64468d10, user_id=08a1e761f04c437aa15aa76e0d1fcacb, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:12.137835 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5560562-4daf-483f-bf67-cc5557e42937 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:12.150598 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1393/2776] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:41:12 2022] PUT /identity/v3/projects/24365e9248834e3486ea93fb64468d10/users/08a1e761f04c437aa15aa76e0d1fcacb/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:41:12.154488 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30135871-f8ac-431a-9127-16e6e4554f3c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:12.166802 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30135871-f8ac-431a-9127-16e6e4554f3c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:12.223243 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286a54a-dc82-4f5b-b092-f537d23f8d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:12.223904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286a54a-dc82-4f5b-b092-f537d23f8d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:12.224190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286a54a-dc82-4f5b-b092-f537d23f8d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:12.225094 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286a54a-dc82-4f5b-b092-f537d23f8d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:12.225877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286a54a-dc82-4f5b-b092-f537d23f8d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:12.227491 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286a54a-dc82-4f5b-b092-f537d23f8d27 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:12.237764 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1384/2777] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:41:12.241788 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5560562-4daf-483f-bf67-cc5557e42937 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:12.251947 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5560562-4daf-483f-bf67-cc5557e42937 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:12.256899 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c076cb0-3417-43a5-b962-c5a4817cd13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:12.257804 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c076cb0-3417-43a5-b962-c5a4817cd13f admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:12.258090 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c076cb0-3417-43a5-b962-c5a4817cd13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:12.258370 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c076cb0-3417-43a5-b962-c5a4817cd13f admin admin] PATH_INFO: `/v3/projects/24365e9248834e3486ea93fb64468d10/users/08a1e761f04c437aa15aa76e0d1fcacb/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:12.260377 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c076cb0-3417-43a5-b962-c5a4817cd13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=24365e9248834e3486ea93fb64468d10, user_id=08a1e761f04c437aa15aa76e0d1fcacb, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:12.263068 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c076cb0-3417-43a5-b962-c5a4817cd13f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:12.273147 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1394/2778] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:41:12 2022] PUT /identity/v3/projects/24365e9248834e3486ea93fb64468d10/users/08a1e761f04c437aa15aa76e0d1fcacb/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:12.283596 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09168fc5-180d-4073-9f8c-b33498c183da None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:12.283889 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09168fc5-180d-4073-9f8c-b33498c183da None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:12.284167 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09168fc5-180d-4073-9f8c-b33498c183da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:12.310328 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-09168fc5-180d-4073-9f8c-b33498c183da None None] MFA Rules not processed for user `08a1e761f04c437aa15aa76e0d1fcacb`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:12.311520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-09168fc5-180d-4073-9f8c-b33498c183da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:12.379798 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1385/2779] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:41:12.392603 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c076cb0-3417-43a5-b962-c5a4817cd13f admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:12.394324 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2c076cb0-3417-43a5-b962-c5a4817cd13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:12.455010 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c076cb0-3417-43a5-b962-c5a4817cd13f admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:12.458700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb5288-d759-48a6-9083-ac43a168f748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:12.459347 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb5288-d759-48a6-9083-ac43a168f748 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:12.459634 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb5288-d759-48a6-9083-ac43a168f748 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:12.459915 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb5288-d759-48a6-9083-ac43a168f748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:12.469463 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb5288-d759-48a6-9083-ac43a168f748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:12.470903 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb5288-d759-48a6-9083-ac43a168f748 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:12.481193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1395/2780] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:41:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:41:12.554017 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09168fc5-180d-4073-9f8c-b33498c183da None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:12.563668 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09168fc5-180d-4073-9f8c-b33498c183da None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:12.567318 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad6c17-9b57-4324-a483-14429328b9bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:12.567957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad6c17-9b57-4324-a483-14429328b9bc service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:12.568240 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad6c17-9b57-4324-a483-14429328b9bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:12.568524 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad6c17-9b57-4324-a483-14429328b9bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:12.578931 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:12.628062 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad6c17-9b57-4324-a483-14429328b9bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:12.629530 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad6c17-9b57-4324-a483-14429328b9bc service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:12.639129 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1386/2781] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:41:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:41:19.356477 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb5288-d759-48a6-9083-ac43a168f748 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:19.418146 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb5288-d759-48a6-9083-ac43a168f748 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:19.422684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd56fc-b0be-4900-9597-0e50cc7e49ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:19.423540 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd56fc-b0be-4900-9597-0e50cc7e49ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:19.423822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd56fc-b0be-4900-9597-0e50cc7e49ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:19.424097 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd56fc-b0be-4900-9597-0e50cc7e49ba admin admin] PATH_INFO: `/v3/users/b7ffebed8124491b9f7d78cca993538d` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:19.425304 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd56fc-b0be-4900-9597-0e50cc7e49ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ffebed8124491b9f7d78cca993538d)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:19.427231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd56fc-b0be-4900-9597-0e50cc7e49ba admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:19.474135 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-15dd56fc-b0be-4900-9597-0e50cc7e49ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ffebed8124491b9f7d78cca993538d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:19.474711 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-15dd56fc-b0be-4900-9597-0e50cc7e49ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ffebed8124491b9f7d78cca993538d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:19.486642 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-15dd56fc-b0be-4900-9597-0e50cc7e49ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ffebed8124491b9f7d78cca993538d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:19.491839 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:19.494073 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-15dd56fc-b0be-4900-9597-0e50cc7e49ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ffebed8124491b9f7d78cca993538d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:19.495035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-15dd56fc-b0be-4900-9597-0e50cc7e49ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ffebed8124491b9f7d78cca993538d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:19.508343 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1396/2782] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:41:19 2022] DELETE /identity/v3/users/b7ffebed8124491b9f7d78cca993538d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:19.513430 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ce2a6-ad3a-40ed-9583-334c91c69d92 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:19.513890 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ce2a6-ad3a-40ed-9583-334c91c69d92 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:19.514009 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ce2a6-ad3a-40ed-9583-334c91c69d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:19.531765 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-f89ce2a6-ad3a-40ed-9583-334c91c69d92 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:19.532967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f89ce2a6-ad3a-40ed-9583-334c91c69d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:19.592553 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1387/2783] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:41:19.602275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd56fc-b0be-4900-9597-0e50cc7e49ba admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:19.603697 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-15dd56fc-b0be-4900-9597-0e50cc7e49ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:19.660130 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd56fc-b0be-4900-9597-0e50cc7e49ba admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:19.663930 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf97e52-e47a-4703-b1ce-f3cfc2f2315f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:19.664594 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf97e52-e47a-4703-b1ce-f3cfc2f2315f service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:19.664872 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf97e52-e47a-4703-b1ce-f3cfc2f2315f service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:19.665142 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf97e52-e47a-4703-b1ce-f3cfc2f2315f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:19.674214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf97e52-e47a-4703-b1ce-f3cfc2f2315f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:19.675637 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf97e52-e47a-4703-b1ce-f3cfc2f2315f service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:19.685364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1397/2784] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:41:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:41:19.952100 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ce2a6-ad3a-40ed-9583-334c91c69d92 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:19.953735 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f89ce2a6-ad3a-40ed-9583-334c91c69d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:19.966290 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ce2a6-ad3a-40ed-9583-334c91c69d92 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:19.971038 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc37e2-0f00-48d0-bae4-375e226111d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:19.971913 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc37e2-0f00-48d0-bae4-375e226111d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:19.972200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc37e2-0f00-48d0-bae4-375e226111d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:19.972479 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc37e2-0f00-48d0-bae4-375e226111d3 admin admin] PATH_INFO: `/v3/projects/37542dde79574b8bb9e4565da640795f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:19.973708 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc37e2-0f00-48d0-bae4-375e226111d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37542dde79574b8bb9e4565da640795f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:19.975754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc37e2-0f00-48d0-bae4-375e226111d3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:20.022366 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b9bc37e2-0f00-48d0-bae4-375e226111d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37542dde79574b8bb9e4565da640795f', 'request_id': 'req-b9bc37e2-0f00-48d0-bae4-375e226111d3'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:20.027929 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b9bc37e2-0f00-48d0-bae4-375e226111d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37542dde79574b8bb9e4565da640795f', 'request_id': 'req-b9bc37e2-0f00-48d0-bae4-375e226111d3'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:20.033919 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b9bc37e2-0f00-48d0-bae4-375e226111d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37542dde79574b8bb9e4565da640795f', 'request_id': 'req-b9bc37e2-0f00-48d0-bae4-375e226111d3'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:20.050524 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b9bc37e2-0f00-48d0-bae4-375e226111d3 admin admin] The token cache is being invalidate because project 37542dde79574b8bb9e4565da640795f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:41:20.050754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b9bc37e2-0f00-48d0-bae4-375e226111d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:20.051391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b9bc37e2-0f00-48d0-bae4-375e226111d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:20.052965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1388/2785] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:41:19 2022] DELETE /identity/v3/projects/37542dde79574b8bb9e4565da640795f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:20.057706 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf97e52-e47a-4703-b1ce-f3cfc2f2315f service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:20.068181 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf97e52-e47a-4703-b1ce-f3cfc2f2315f service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:20.123542 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901988e-c2e2-418e-8450-1bb177457693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:20.124393 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901988e-c2e2-418e-8450-1bb177457693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:20.124674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901988e-c2e2-418e-8450-1bb177457693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:20.124948 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901988e-c2e2-418e-8450-1bb177457693 admin admin] PATH_INFO: `/v3/users/08a1e761f04c437aa15aa76e0d1fcacb` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:20.126143 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901988e-c2e2-418e-8450-1bb177457693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a1e761f04c437aa15aa76e0d1fcacb)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:20.128061 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901988e-c2e2-418e-8450-1bb177457693 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:20.173978 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2901988e-c2e2-418e-8450-1bb177457693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a1e761f04c437aa15aa76e0d1fcacb'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:20.174708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2901988e-c2e2-418e-8450-1bb177457693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a1e761f04c437aa15aa76e0d1fcacb'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:20.188608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2901988e-c2e2-418e-8450-1bb177457693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a1e761f04c437aa15aa76e0d1fcacb'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:20.195416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2901988e-c2e2-418e-8450-1bb177457693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a1e761f04c437aa15aa76e0d1fcacb'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:20.196078 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2901988e-c2e2-418e-8450-1bb177457693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a1e761f04c437aa15aa76e0d1fcacb'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:20.210628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1398/2786] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:41:20 2022] DELETE /identity/v3/users/08a1e761f04c437aa15aa76e0d1fcacb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:20.472379 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc37e2-0f00-48d0-bae4-375e226111d3 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:20.473832 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b9bc37e2-0f00-48d0-bae4-375e226111d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:20.488588 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc37e2-0f00-48d0-bae4-375e226111d3 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:20.523418 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:20.559640 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a245a-d98f-43b4-93f8-b4392094e2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:20.560445 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a245a-d98f-43b4-93f8-b4392094e2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:20.560724 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a245a-d98f-43b4-93f8-b4392094e2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:20.560997 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a245a-d98f-43b4-93f8-b4392094e2e5 admin admin] PATH_INFO: `/v3/projects/24365e9248834e3486ea93fb64468d10` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:20.562224 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a245a-d98f-43b4-93f8-b4392094e2e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24365e9248834e3486ea93fb64468d10)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:20.570109 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a245a-d98f-43b4-93f8-b4392094e2e5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:20.621241 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bc7a245a-d98f-43b4-93f8-b4392094e2e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24365e9248834e3486ea93fb64468d10', 'request_id': 'req-bc7a245a-d98f-43b4-93f8-b4392094e2e5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:20.626703 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bc7a245a-d98f-43b4-93f8-b4392094e2e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24365e9248834e3486ea93fb64468d10', 'request_id': 'req-bc7a245a-d98f-43b4-93f8-b4392094e2e5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:20.632763 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bc7a245a-d98f-43b4-93f8-b4392094e2e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24365e9248834e3486ea93fb64468d10', 'request_id': 'req-bc7a245a-d98f-43b4-93f8-b4392094e2e5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:20.645109 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bc7a245a-d98f-43b4-93f8-b4392094e2e5 admin admin] The token cache is being invalidate because project 24365e9248834e3486ea93fb64468d10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:41:20.645430 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bc7a245a-d98f-43b4-93f8-b4392094e2e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:20.646060 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bc7a245a-d98f-43b4-93f8-b4392094e2e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:20.647591 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1389/2787] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:41:20 2022] DELETE /identity/v3/projects/24365e9248834e3486ea93fb64468d10 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:20.652659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d083de-d941-41d1-85d5-219ad7635307 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:20.653120 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d083de-d941-41d1-85d5-219ad7635307 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:20.653219 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d083de-d941-41d1-85d5-219ad7635307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:20.671880 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-67d083de-d941-41d1-85d5-219ad7635307 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:20.673139 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-67d083de-d941-41d1-85d5-219ad7635307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:20.678874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:20.734403 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1399/2788] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:41:20.741970 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f161b-bcf6-406e-972e-2b7408d46d54 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:20.742275 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f161b-bcf6-406e-972e-2b7408d46d54 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:20.742551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f161b-bcf6-406e-972e-2b7408d46d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:20.762019 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ab0f161b-bcf6-406e-972e-2b7408d46d54 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:20.763271 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ab0f161b-bcf6-406e-972e-2b7408d46d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:20.771312 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1390/2789] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:41:20.775485 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d083de-d941-41d1-85d5-219ad7635307 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:20.785282 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d083de-d941-41d1-85d5-219ad7635307 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:20.789793 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41383b1a-562a-4ff0-ba36-5d70954a811a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:20.790451 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41383b1a-562a-4ff0-ba36-5d70954a811a admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:20.790732 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41383b1a-562a-4ff0-ba36-5d70954a811a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:20.791024 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41383b1a-562a-4ff0-ba36-5d70954a811a admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:20.791725 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41383b1a-562a-4ff0-ba36-5d70954a811a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:20.792028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41383b1a-562a-4ff0-ba36-5d70954a811a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:20.793644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41383b1a-562a-4ff0-ba36-5d70954a811a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:20.804849 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1400/2790] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:20.809563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f161b-bcf6-406e-972e-2b7408d46d54 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:20.818741 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f161b-bcf6-406e-972e-2b7408d46d54 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:20.823953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ddf62-a452-41d0-97cc-5c1d024c6462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:20.824596 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ddf62-a452-41d0-97cc-5c1d024c6462 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:20.824878 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ddf62-a452-41d0-97cc-5c1d024c6462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:20.825153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ddf62-a452-41d0-97cc-5c1d024c6462 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:20.825877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ddf62-a452-41d0-97cc-5c1d024c6462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:20.828034 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ddf62-a452-41d0-97cc-5c1d024c6462 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:20.853427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1391/2791] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:41:20 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:20.858017 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41383b1a-562a-4ff0-ba36-5d70954a811a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:20.867956 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41383b1a-562a-4ff0-ba36-5d70954a811a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:20.924003 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f214e6d-7fc2-4b91-be02-1409a7e0bc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:20.924661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f214e6d-7fc2-4b91-be02-1409a7e0bc2d admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:20.924947 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f214e6d-7fc2-4b91-be02-1409a7e0bc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:20.925223 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f214e6d-7fc2-4b91-be02-1409a7e0bc2d admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:20.925945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f214e6d-7fc2-4b91-be02-1409a7e0bc2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:20.927891 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f214e6d-7fc2-4b91-be02-1409a7e0bc2d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:20.947841 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1401/2792] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:41:20 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:20.952236 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ddf62-a452-41d0-97cc-5c1d024c6462 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:20.963012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ddf62-a452-41d0-97cc-5c1d024c6462 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:20.967738 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a02dfc-c226-4bbd-94b6-8b97dbf1100d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:20.968396 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a02dfc-c226-4bbd-94b6-8b97dbf1100d admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:20.968688 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a02dfc-c226-4bbd-94b6-8b97dbf1100d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:20.968988 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a02dfc-c226-4bbd-94b6-8b97dbf1100d admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:20.969743 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a02dfc-c226-4bbd-94b6-8b97dbf1100d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:20.971344 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a02dfc-c226-4bbd-94b6-8b97dbf1100d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:20.982300 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1392/2793] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:41:20.985987 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f214e6d-7fc2-4b91-be02-1409a7e0bc2d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:20.996526 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f214e6d-7fc2-4b91-be02-1409a7e0bc2d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:21.001149 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f298d9-9584-4270-86dd-6eb15239951e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:21.001833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f298d9-9584-4270-86dd-6eb15239951e admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:21.002116 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f298d9-9584-4270-86dd-6eb15239951e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:21.002395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f298d9-9584-4270-86dd-6eb15239951e admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:21.003117 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f298d9-9584-4270-86dd-6eb15239951e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:21.004740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f298d9-9584-4270-86dd-6eb15239951e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:21.014551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1402/2794] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:41:21.018394 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a02dfc-c226-4bbd-94b6-8b97dbf1100d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:21.028321 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a02dfc-c226-4bbd-94b6-8b97dbf1100d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:21.032945 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b324b-486d-42a9-996f-5d1e818ee874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:21.033834 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b324b-486d-42a9-996f-5d1e818ee874 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:21.034117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b324b-486d-42a9-996f-5d1e818ee874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:21.034392 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b324b-486d-42a9-996f-5d1e818ee874 admin admin] PATH_INFO: `/v3/projects/9adfe953c72e436d820d54a7b81c1bba/users/6d6860bbee7f427388cd4b6a84b98d4e/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:21.049086 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b324b-486d-42a9-996f-5d1e818ee874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9adfe953c72e436d820d54a7b81c1bba, user_id=6d6860bbee7f427388cd4b6a84b98d4e, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:21.051765 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b324b-486d-42a9-996f-5d1e818ee874 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:21.065769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1393/2795] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:41:21 2022] PUT /identity/v3/projects/9adfe953c72e436d820d54a7b81c1bba/users/6d6860bbee7f427388cd4b6a84b98d4e/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:21.076837 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fee98-6bb2-40cf-98cb-5416682634c0 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:21.077345 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fee98-6bb2-40cf-98cb-5416682634c0 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:21.077849 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fee98-6bb2-40cf-98cb-5416682634c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:21.105364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d28fee98-6bb2-40cf-98cb-5416682634c0 None None] MFA Rules not processed for user `6d6860bbee7f427388cd4b6a84b98d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:21.106556 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d28fee98-6bb2-40cf-98cb-5416682634c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:21.169269 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1403/2796] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:41:21.173856 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b324b-486d-42a9-996f-5d1e818ee874 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:21.237757 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b324b-486d-42a9-996f-5d1e818ee874 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:21.242439 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aaf03-9df8-4aa2-b743-b3f1b98743aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:21.243094 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aaf03-9df8-4aa2-b743-b3f1b98743aa admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:21.243383 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aaf03-9df8-4aa2-b743-b3f1b98743aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:21.243658 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aaf03-9df8-4aa2-b743-b3f1b98743aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:21.244342 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8aaf03-9df8-4aa2-b743-b3f1b98743aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:21.246290 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8aaf03-9df8-4aa2-b743-b3f1b98743aa admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:21.250423 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:21.274453 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1394/2797] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:41:21 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:21.279212 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fee98-6bb2-40cf-98cb-5416682634c0 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:21.290120 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fee98-6bb2-40cf-98cb-5416682634c0 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:21.294403 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:21.348603 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7bd25-e270-4c8a-bc1c-7d7c1e44a363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:21.349201 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7bd25-e270-4c8a-bc1c-7d7c1e44a363 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:21.349516 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7bd25-e270-4c8a-bc1c-7d7c1e44a363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:21.349794 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7bd25-e270-4c8a-bc1c-7d7c1e44a363 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:21.350507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7bd25-e270-4c8a-bc1c-7d7c1e44a363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:21.352442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7bd25-e270-4c8a-bc1c-7d7c1e44a363 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:21.371809 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1404/2798] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:41:21 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:41:21.375913 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aaf03-9df8-4aa2-b743-b3f1b98743aa admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:21.386108 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aaf03-9df8-4aa2-b743-b3f1b98743aa admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:21.390747 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d269827-9d3c-4324-b9ad-bb9dc37abc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:21.391400 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d269827-9d3c-4324-b9ad-bb9dc37abc00 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:21.391682 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d269827-9d3c-4324-b9ad-bb9dc37abc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:21.391956 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d269827-9d3c-4324-b9ad-bb9dc37abc00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:21.392671 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d269827-9d3c-4324-b9ad-bb9dc37abc00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:21.394299 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d269827-9d3c-4324-b9ad-bb9dc37abc00 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:21.405274 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1395/2799] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:41:21.409099 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7bd25-e270-4c8a-bc1c-7d7c1e44a363 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:21.419333 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7bd25-e270-4c8a-bc1c-7d7c1e44a363 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:21.423849 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b4846-aa92-4032-97b4-63cea09e6e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:21.424705 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b4846-aa92-4032-97b4-63cea09e6e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:21.424983 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b4846-aa92-4032-97b4-63cea09e6e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:21.425279 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b4846-aa92-4032-97b4-63cea09e6e03 admin admin] PATH_INFO: `/v3/projects/577ebb57a27d40168376827be7e19881/users/a94484cc00ae41c7985080b023584ce4/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:21.439557 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b4846-aa92-4032-97b4-63cea09e6e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=577ebb57a27d40168376827be7e19881, user_id=a94484cc00ae41c7985080b023584ce4, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:21.442230 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b4846-aa92-4032-97b4-63cea09e6e03 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:21.455120 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1405/2800] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:41:21 2022] PUT /identity/v3/projects/577ebb57a27d40168376827be7e19881/users/a94484cc00ae41c7985080b023584ce4/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:41:21.459175 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d269827-9d3c-4324-b9ad-bb9dc37abc00 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:21.469596 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d269827-9d3c-4324-b9ad-bb9dc37abc00 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:21.523635 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cfaf5-9532-4665-9046-52273375d460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:21.524289 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cfaf5-9532-4665-9046-52273375d460 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:21.524571 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cfaf5-9532-4665-9046-52273375d460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:21.524842 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cfaf5-9532-4665-9046-52273375d460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:21.526106 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cfaf5-9532-4665-9046-52273375d460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:21.527700 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cfaf5-9532-4665-9046-52273375d460 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:21.537466 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1396/2801] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:41:21.542304 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b4846-aa92-4032-97b4-63cea09e6e03 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:21.552672 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b4846-aa92-4032-97b4-63cea09e6e03 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:21.557361 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91babb77-393f-4931-acca-f439600a6054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:21.558242 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91babb77-393f-4931-acca-f439600a6054 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:21.558530 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91babb77-393f-4931-acca-f439600a6054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:21.558833 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91babb77-393f-4931-acca-f439600a6054 admin admin] PATH_INFO: `/v3/projects/577ebb57a27d40168376827be7e19881/users/a94484cc00ae41c7985080b023584ce4/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:21.562462 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91babb77-393f-4931-acca-f439600a6054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=577ebb57a27d40168376827be7e19881, user_id=a94484cc00ae41c7985080b023584ce4, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:21.563620 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91babb77-393f-4931-acca-f439600a6054 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:21.575744 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1406/2802] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:41:21 2022] PUT /identity/v3/projects/577ebb57a27d40168376827be7e19881/users/a94484cc00ae41c7985080b023584ce4/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:21.587207 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb5f8c-6142-4d36-a55c-5f04aa422960 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:21.587495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb5f8c-6142-4d36-a55c-5f04aa422960 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:21.587772 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb5f8c-6142-4d36-a55c-5f04aa422960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:21.614178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-31cb5f8c-6142-4d36-a55c-5f04aa422960 None None] MFA Rules not processed for user `a94484cc00ae41c7985080b023584ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:21.615330 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-31cb5f8c-6142-4d36-a55c-5f04aa422960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:21.682419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1397/2803] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:21 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:41:21.693498 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91babb77-393f-4931-acca-f439600a6054 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:21.695315 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-91babb77-393f-4931-acca-f439600a6054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:21.751379 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91babb77-393f-4931-acca-f439600a6054 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:21.755039 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f2ac9-b43d-4587-a611-7958246f3d65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:21.755661 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f2ac9-b43d-4587-a611-7958246f3d65 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:21.755941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f2ac9-b43d-4587-a611-7958246f3d65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:21.756210 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f2ac9-b43d-4587-a611-7958246f3d65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:21.765437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f2ac9-b43d-4587-a611-7958246f3d65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:21.766857 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f2ac9-b43d-4587-a611-7958246f3d65 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:21.776474 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1407/2804] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:41:21 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:41:21.846234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb5f8c-6142-4d36-a55c-5f04aa422960 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:21.855949 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb5f8c-6142-4d36-a55c-5f04aa422960 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:21.859514 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d36c6-7c98-4be4-b04f-218115d0be54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:21.860146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d36c6-7c98-4be4-b04f-218115d0be54 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:21.860426 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d36c6-7c98-4be4-b04f-218115d0be54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:21.860696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d36c6-7c98-4be4-b04f-218115d0be54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:21.913358 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:21.915651 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d36c6-7c98-4be4-b04f-218115d0be54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:21.917464 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d36c6-7c98-4be4-b04f-218115d0be54 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:21.926972 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1398/2805] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:41:21 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:41:28.818634 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f2ac9-b43d-4587-a611-7958246f3d65 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:28.879880 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f2ac9-b43d-4587-a611-7958246f3d65 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:28.884415 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06935d38-0f6f-4007-8ce1-321e9e8328f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:28.885854 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06935d38-0f6f-4007-8ce1-321e9e8328f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:28.886137 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06935d38-0f6f-4007-8ce1-321e9e8328f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:28.886414 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06935d38-0f6f-4007-8ce1-321e9e8328f5 admin admin] PATH_INFO: `/v3/users/6d6860bbee7f427388cd4b6a84b98d4e` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:28.887597 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06935d38-0f6f-4007-8ce1-321e9e8328f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d6860bbee7f427388cd4b6a84b98d4e)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:28.889565 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06935d38-0f6f-4007-8ce1-321e9e8328f5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:28.891821 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:28.935543 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-06935d38-0f6f-4007-8ce1-321e9e8328f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d6860bbee7f427388cd4b6a84b98d4e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:28.936251 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-06935d38-0f6f-4007-8ce1-321e9e8328f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d6860bbee7f427388cd4b6a84b98d4e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:28.949151 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-06935d38-0f6f-4007-8ce1-321e9e8328f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d6860bbee7f427388cd4b6a84b98d4e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:28.956685 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-06935d38-0f6f-4007-8ce1-321e9e8328f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d6860bbee7f427388cd4b6a84b98d4e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:28.957412 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-06935d38-0f6f-4007-8ce1-321e9e8328f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d6860bbee7f427388cd4b6a84b98d4e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:28.969691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1408/2806] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:41:28 2022] DELETE /identity/v3/users/6d6860bbee7f427388cd4b6a84b98d4e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:28.974335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53016cbf-a090-4a9d-9a74-82c7676edda0 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:28.974848 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53016cbf-a090-4a9d-9a74-82c7676edda0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:28.974964 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53016cbf-a090-4a9d-9a74-82c7676edda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:28.991969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-53016cbf-a090-4a9d-9a74-82c7676edda0 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:28.993165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-53016cbf-a090-4a9d-9a74-82c7676edda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:29.050874 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1399/2807] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:41:29.060959 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06935d38-0f6f-4007-8ce1-321e9e8328f5 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:29.062313 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-06935d38-0f6f-4007-8ce1-321e9e8328f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:29.120506 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06935d38-0f6f-4007-8ce1-321e9e8328f5 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:29.124240 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c58b0-2dcd-4481-a3db-183b09c85e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:29.124882 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c58b0-2dcd-4481-a3db-183b09c85e0c service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:29.125169 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c58b0-2dcd-4481-a3db-183b09c85e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:29.125476 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c58b0-2dcd-4481-a3db-183b09c85e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:29.134465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c58b0-2dcd-4481-a3db-183b09c85e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:29.135940 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c58b0-2dcd-4481-a3db-183b09c85e0c service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:29.145234 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1409/2808] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:41:29.414190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53016cbf-a090-4a9d-9a74-82c7676edda0 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:29.415636 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-53016cbf-a090-4a9d-9a74-82c7676edda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:29.432868 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53016cbf-a090-4a9d-9a74-82c7676edda0 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:29.438286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacccd4-e46d-43d9-89d7-8bf5baf61eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:29.439201 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacccd4-e46d-43d9-89d7-8bf5baf61eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:29.439433 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacccd4-e46d-43d9-89d7-8bf5baf61eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:29.439710 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacccd4-e46d-43d9-89d7-8bf5baf61eac admin admin] PATH_INFO: `/v3/projects/9adfe953c72e436d820d54a7b81c1bba` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:29.440923 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacccd4-e46d-43d9-89d7-8bf5baf61eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9adfe953c72e436d820d54a7b81c1bba)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:29.442873 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacccd4-e46d-43d9-89d7-8bf5baf61eac admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:29.489921 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8aacccd4-e46d-43d9-89d7-8bf5baf61eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9adfe953c72e436d820d54a7b81c1bba', 'request_id': 'req-8aacccd4-e46d-43d9-89d7-8bf5baf61eac'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:29.496214 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8aacccd4-e46d-43d9-89d7-8bf5baf61eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9adfe953c72e436d820d54a7b81c1bba', 'request_id': 'req-8aacccd4-e46d-43d9-89d7-8bf5baf61eac'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:29.502386 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8aacccd4-e46d-43d9-89d7-8bf5baf61eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9adfe953c72e436d820d54a7b81c1bba', 'request_id': 'req-8aacccd4-e46d-43d9-89d7-8bf5baf61eac'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:29.515348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8aacccd4-e46d-43d9-89d7-8bf5baf61eac admin admin] The token cache is being invalidate because project 9adfe953c72e436d820d54a7b81c1bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:41:29.515637 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8aacccd4-e46d-43d9-89d7-8bf5baf61eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:29.516262 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8aacccd4-e46d-43d9-89d7-8bf5baf61eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:29.517846 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1400/2809] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:41:29 2022] DELETE /identity/v3/projects/9adfe953c72e436d820d54a7b81c1bba => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:41:29.521880 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c58b0-2dcd-4481-a3db-183b09c85e0c service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:29.531653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c58b0-2dcd-4481-a3db-183b09c85e0c service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:29.588905 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58352433-fce2-4bea-ac1e-405b8aa48403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:29.589746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58352433-fce2-4bea-ac1e-405b8aa48403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:29.590028 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58352433-fce2-4bea-ac1e-405b8aa48403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:29.590303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58352433-fce2-4bea-ac1e-405b8aa48403 admin admin] PATH_INFO: `/v3/users/a94484cc00ae41c7985080b023584ce4` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:29.591483 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58352433-fce2-4bea-ac1e-405b8aa48403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a94484cc00ae41c7985080b023584ce4)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:29.593447 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58352433-fce2-4bea-ac1e-405b8aa48403 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:29.621442 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:29.640966 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-58352433-fce2-4bea-ac1e-405b8aa48403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a94484cc00ae41c7985080b023584ce4'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:29.641653 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-58352433-fce2-4bea-ac1e-405b8aa48403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a94484cc00ae41c7985080b023584ce4'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:29.653415 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-58352433-fce2-4bea-ac1e-405b8aa48403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a94484cc00ae41c7985080b023584ce4'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:29.660202 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-58352433-fce2-4bea-ac1e-405b8aa48403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a94484cc00ae41c7985080b023584ce4'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:29.660846 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-58352433-fce2-4bea-ac1e-405b8aa48403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a94484cc00ae41c7985080b023584ce4'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:29.672964 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1410/2810] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:41:29 2022] DELETE /identity/v3/users/a94484cc00ae41c7985080b023584ce4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:29.943983 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacccd4-e46d-43d9-89d7-8bf5baf61eac admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:29.945519 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8aacccd4-e46d-43d9-89d7-8bf5baf61eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:29.960153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacccd4-e46d-43d9-89d7-8bf5baf61eac admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:30.017616 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc33dd-8fd6-45a6-8909-57b9e5d36da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:30.018478 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc33dd-8fd6-45a6-8909-57b9e5d36da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:30.018758 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc33dd-8fd6-45a6-8909-57b9e5d36da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:30.019032 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc33dd-8fd6-45a6-8909-57b9e5d36da1 admin admin] PATH_INFO: `/v3/projects/577ebb57a27d40168376827be7e19881` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:30.020217 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc33dd-8fd6-45a6-8909-57b9e5d36da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=577ebb57a27d40168376827be7e19881)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:30.022187 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc33dd-8fd6-45a6-8909-57b9e5d36da1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:30.045104 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:30.073237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-abcc33dd-8fd6-45a6-8909-57b9e5d36da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577ebb57a27d40168376827be7e19881', 'request_id': 'req-abcc33dd-8fd6-45a6-8909-57b9e5d36da1'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:30.078921 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-abcc33dd-8fd6-45a6-8909-57b9e5d36da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577ebb57a27d40168376827be7e19881', 'request_id': 'req-abcc33dd-8fd6-45a6-8909-57b9e5d36da1'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:30.084963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-abcc33dd-8fd6-45a6-8909-57b9e5d36da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577ebb57a27d40168376827be7e19881', 'request_id': 'req-abcc33dd-8fd6-45a6-8909-57b9e5d36da1'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:30.096643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-abcc33dd-8fd6-45a6-8909-57b9e5d36da1 admin admin] The token cache is being invalidate because project 577ebb57a27d40168376827be7e19881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:41:30.096927 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-abcc33dd-8fd6-45a6-8909-57b9e5d36da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:30.097563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-abcc33dd-8fd6-45a6-8909-57b9e5d36da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:30.099072 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1401/2811] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:41:29 2022] DELETE /identity/v3/projects/577ebb57a27d40168376827be7e19881 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:30.104580 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ba280-0dbf-45a0-8cfb-68ab363e1206 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:30.105051 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ba280-0dbf-45a0-8cfb-68ab363e1206 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:30.105275 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ba280-0dbf-45a0-8cfb-68ab363e1206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:30.122990 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-998ba280-0dbf-45a0-8cfb-68ab363e1206 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:30.124206 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-998ba280-0dbf-45a0-8cfb-68ab363e1206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:30.180946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1411/2812] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:41:30.189927 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7822c6-9f4d-4fd8-830e-f4863ad234cd None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:30.190219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7822c6-9f4d-4fd8-830e-f4863ad234cd None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:30.190499 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7822c6-9f4d-4fd8-830e-f4863ad234cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:30.208842 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8f7822c6-9f4d-4fd8-830e-f4863ad234cd None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:30.210086 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8f7822c6-9f4d-4fd8-830e-f4863ad234cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:30.218624 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1402/2813] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:41:30.222691 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ba280-0dbf-45a0-8cfb-68ab363e1206 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:30.232937 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ba280-0dbf-45a0-8cfb-68ab363e1206 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:30.237584 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc5194-1f12-4ab5-9803-989797f261ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:30.238232 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc5194-1f12-4ab5-9803-989797f261ec admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:30.238516 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc5194-1f12-4ab5-9803-989797f261ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:30.238795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc5194-1f12-4ab5-9803-989797f261ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:30.239517 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc5194-1f12-4ab5-9803-989797f261ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:30.239827 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc5194-1f12-4ab5-9803-989797f261ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:30.241455 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc5194-1f12-4ab5-9803-989797f261ec admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:30.253303 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1412/2814] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:30.257875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7822c6-9f4d-4fd8-830e-f4863ad234cd None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:30.269236 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7822c6-9f4d-4fd8-830e-f4863ad234cd None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:30.274515 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f065e-1fa4-47c6-b400-7ed8d851e6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:30.275157 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f065e-1fa4-47c6-b400-7ed8d851e6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:30.275928 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f065e-1fa4-47c6-b400-7ed8d851e6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:30.276200 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f065e-1fa4-47c6-b400-7ed8d851e6b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:30.277088 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f065e-1fa4-47c6-b400-7ed8d851e6b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:30.280023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f065e-1fa4-47c6-b400-7ed8d851e6b5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:30.306728 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1403/2815] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:41:30 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:30.310926 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc5194-1f12-4ab5-9803-989797f261ec admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:30.320945 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc5194-1f12-4ab5-9803-989797f261ec admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:30.376565 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1420e-900c-40df-9cf1-d4ffd2b13b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:30.377180 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1420e-900c-40df-9cf1-d4ffd2b13b1a admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:30.377500 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1420e-900c-40df-9cf1-d4ffd2b13b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:30.377783 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1420e-900c-40df-9cf1-d4ffd2b13b1a admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:30.378480 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1420e-900c-40df-9cf1-d4ffd2b13b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:30.380410 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1420e-900c-40df-9cf1-d4ffd2b13b1a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:30.399477 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1413/2816] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:41:30 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:41:30.404269 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f065e-1fa4-47c6-b400-7ed8d851e6b5 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:30.414547 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f065e-1fa4-47c6-b400-7ed8d851e6b5 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:30.419769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05736ab-e6d5-4550-8b83-f6faaf8b2bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:30.420428 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05736ab-e6d5-4550-8b83-f6faaf8b2bde admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:30.420718 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05736ab-e6d5-4550-8b83-f6faaf8b2bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:30.420996 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05736ab-e6d5-4550-8b83-f6faaf8b2bde admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:30.421766 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05736ab-e6d5-4550-8b83-f6faaf8b2bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:30.423363 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05736ab-e6d5-4550-8b83-f6faaf8b2bde admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:30.434831 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1404/2817] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:41:30.438878 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1420e-900c-40df-9cf1-d4ffd2b13b1a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:30.448753 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1420e-900c-40df-9cf1-d4ffd2b13b1a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:30.453616 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd087642-8d1f-43e3-932a-ed5bfd79169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:30.454258 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd087642-8d1f-43e3-932a-ed5bfd79169e admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:30.454541 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd087642-8d1f-43e3-932a-ed5bfd79169e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:30.454819 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd087642-8d1f-43e3-932a-ed5bfd79169e admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:30.455566 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd087642-8d1f-43e3-932a-ed5bfd79169e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:30.457161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd087642-8d1f-43e3-932a-ed5bfd79169e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:30.467374 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1414/2818] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:41:30.471377 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05736ab-e6d5-4550-8b83-f6faaf8b2bde admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:30.482195 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05736ab-e6d5-4550-8b83-f6faaf8b2bde admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:30.486814 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adffe6a-5902-4531-924e-5c02a0e78125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:30.487677 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adffe6a-5902-4531-924e-5c02a0e78125 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:30.487959 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adffe6a-5902-4531-924e-5c02a0e78125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:30.488234 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adffe6a-5902-4531-924e-5c02a0e78125 admin admin] PATH_INFO: `/v3/projects/622ec1c07ef84ecdab66ed7ee6746f66/users/66b02df5baa94e17b9fde4d7c9b579be/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:30.502938 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adffe6a-5902-4531-924e-5c02a0e78125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=622ec1c07ef84ecdab66ed7ee6746f66, user_id=66b02df5baa94e17b9fde4d7c9b579be, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:30.505628 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adffe6a-5902-4531-924e-5c02a0e78125 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:30.517915 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1405/2819] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:41:30 2022] PUT /identity/v3/projects/622ec1c07ef84ecdab66ed7ee6746f66/users/66b02df5baa94e17b9fde4d7c9b579be/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:30.528910 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabe479-65d1-4a54-877f-255db4e928c9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:30.529229 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabe479-65d1-4a54-877f-255db4e928c9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:30.529523 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabe479-65d1-4a54-877f-255db4e928c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:30.549153 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:30.559495 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8aabe479-65d1-4a54-877f-255db4e928c9 None None] MFA Rules not processed for user `66b02df5baa94e17b9fde4d7c9b579be`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:30.561146 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8aabe479-65d1-4a54-877f-255db4e928c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:30.628744 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1415/2820] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:41:30.633471 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adffe6a-5902-4531-924e-5c02a0e78125 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:30.696620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adffe6a-5902-4531-924e-5c02a0e78125 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:30.701995 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c573611-45ad-4d04-bbed-c7ebb9a51f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:30.702662 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c573611-45ad-4d04-bbed-c7ebb9a51f50 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:30.702942 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c573611-45ad-4d04-bbed-c7ebb9a51f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:30.703218 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c573611-45ad-4d04-bbed-c7ebb9a51f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:30.703914 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c573611-45ad-4d04-bbed-c7ebb9a51f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:30.705877 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c573611-45ad-4d04-bbed-c7ebb9a51f50 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:30.731256 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1406/2821] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:41:30 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:30.735444 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabe479-65d1-4a54-877f-255db4e928c9 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:30.746228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabe479-65d1-4a54-877f-255db4e928c9 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:30.804852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389492f9-2d07-47e1-8579-55d3b2117f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:30.805551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389492f9-2d07-47e1-8579-55d3b2117f75 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:30.805832 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389492f9-2d07-47e1-8579-55d3b2117f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:30.806105 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389492f9-2d07-47e1-8579-55d3b2117f75 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:30.806795 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389492f9-2d07-47e1-8579-55d3b2117f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:30.808706 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389492f9-2d07-47e1-8579-55d3b2117f75 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:30.828673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1416/2822] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:41:30 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:41:30.832726 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c573611-45ad-4d04-bbed-c7ebb9a51f50 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:30.843427 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c573611-45ad-4d04-bbed-c7ebb9a51f50 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:30.848064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa33e23-630c-419c-83bd-96fd652e79f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:30.848715 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa33e23-630c-419c-83bd-96fd652e79f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:30.848998 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa33e23-630c-419c-83bd-96fd652e79f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:30.849294 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa33e23-630c-419c-83bd-96fd652e79f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:30.850016 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa33e23-630c-419c-83bd-96fd652e79f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:30.851606 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa33e23-630c-419c-83bd-96fd652e79f5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:30.861967 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1407/2823] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:41:30.865798 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389492f9-2d07-47e1-8579-55d3b2117f75 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:30.876005 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389492f9-2d07-47e1-8579-55d3b2117f75 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:30.880701 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdad0f-69bd-457f-8a78-30a376126dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:30.881322 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdad0f-69bd-457f-8a78-30a376126dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:30.881611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdad0f-69bd-457f-8a78-30a376126dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:30.881887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdad0f-69bd-457f-8a78-30a376126dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:30.882606 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdad0f-69bd-457f-8a78-30a376126dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:30.884203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdad0f-69bd-457f-8a78-30a376126dbd admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:30.894466 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1417/2824] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:41:30.898337 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa33e23-630c-419c-83bd-96fd652e79f5 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:30.910666 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa33e23-630c-419c-83bd-96fd652e79f5 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:30.917211 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd15a2-4d01-4b77-81ae-fd3ab70691e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:30.918605 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd15a2-4d01-4b77-81ae-fd3ab70691e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:30.919023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd15a2-4d01-4b77-81ae-fd3ab70691e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:30.919433 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd15a2-4d01-4b77-81ae-fd3ab70691e3 admin admin] PATH_INFO: `/v3/projects/e06f65d2a54e454fb423969742149151/users/61fe9f2225bd49f4a25468b2491d8809/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:30.943489 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd15a2-4d01-4b77-81ae-fd3ab70691e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06f65d2a54e454fb423969742149151, user_id=61fe9f2225bd49f4a25468b2491d8809, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:30.943489 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd15a2-4d01-4b77-81ae-fd3ab70691e3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:30.946976 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:30.960180 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1408/2825] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:41:30 2022] PUT /identity/v3/projects/e06f65d2a54e454fb423969742149151/users/61fe9f2225bd49f4a25468b2491d8809/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:30.974510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e771cb-6e81-405b-b0e1-2f8f7ee0120c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:30.974917 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e771cb-6e81-405b-b0e1-2f8f7ee0120c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:30.975265 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e771cb-6e81-405b-b0e1-2f8f7ee0120c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.001764 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f3e771cb-6e81-405b-b0e1-2f8f7ee0120c None None] MFA Rules not processed for user `61fe9f2225bd49f4a25468b2491d8809`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:31.002977 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f3e771cb-6e81-405b-b0e1-2f8f7ee0120c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:31.065497 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1418/2826] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:41:31.070120 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd15a2-4d01-4b77-81ae-fd3ab70691e3 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:31.131077 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd15a2-4d01-4b77-81ae-fd3ab70691e3 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:31.136219 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2695a-4de5-4fb0-87a0-8e20de388e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:31.136872 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2695a-4de5-4fb0-87a0-8e20de388e2c admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.137155 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2695a-4de5-4fb0-87a0-8e20de388e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.137464 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2695a-4de5-4fb0-87a0-8e20de388e2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.138145 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2695a-4de5-4fb0-87a0-8e20de388e2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:31.140041 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2695a-4de5-4fb0-87a0-8e20de388e2c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:31.164280 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1409/2827] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:41:31 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:31.168408 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e771cb-6e81-405b-b0e1-2f8f7ee0120c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:31.179068 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e771cb-6e81-405b-b0e1-2f8f7ee0120c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:31.183161 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:31.237055 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17355807-10af-423e-9bf8-3e657fa4636d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:31.237750 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17355807-10af-423e-9bf8-3e657fa4636d admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.238029 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17355807-10af-423e-9bf8-3e657fa4636d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.238643 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17355807-10af-423e-9bf8-3e657fa4636d admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.241703 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17355807-10af-423e-9bf8-3e657fa4636d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:31.243946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17355807-10af-423e-9bf8-3e657fa4636d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:31.266100 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1419/2828] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:41:31 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:31.269791 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2695a-4de5-4fb0-87a0-8e20de388e2c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:31.280288 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2695a-4de5-4fb0-87a0-8e20de388e2c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:31.284960 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89e4c8-d639-4ed5-be52-0a4cefbd76b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:31.285663 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89e4c8-d639-4ed5-be52-0a4cefbd76b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.285951 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89e4c8-d639-4ed5-be52-0a4cefbd76b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.286225 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89e4c8-d639-4ed5-be52-0a4cefbd76b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.286963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89e4c8-d639-4ed5-be52-0a4cefbd76b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:31.288570 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89e4c8-d639-4ed5-be52-0a4cefbd76b3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:31.299118 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1410/2829] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:41:31.303136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17355807-10af-423e-9bf8-3e657fa4636d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:31.313608 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17355807-10af-423e-9bf8-3e657fa4636d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:31.318279 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41193-0cec-44c0-bed1-124ff83aec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:31.319176 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41193-0cec-44c0-bed1-124ff83aec6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.319461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41193-0cec-44c0-bed1-124ff83aec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.319740 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41193-0cec-44c0-bed1-124ff83aec6e admin admin] PATH_INFO: `/v3/projects/06d287a257c7463597087fc04274a4c4/users/b02bdae329634066a6deefafba1f98fe/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.335116 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa41193-0cec-44c0-bed1-124ff83aec6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d287a257c7463597087fc04274a4c4, user_id=b02bdae329634066a6deefafba1f98fe, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:31.337826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa41193-0cec-44c0-bed1-124ff83aec6e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:31.349982 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1420/2830] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:41:31 2022] PUT /identity/v3/projects/06d287a257c7463597087fc04274a4c4/users/b02bdae329634066a6deefafba1f98fe/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:41:31.354404 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89e4c8-d639-4ed5-be52-0a4cefbd76b3 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:31.364643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89e4c8-d639-4ed5-be52-0a4cefbd76b3 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:31.420287 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6a788-e7ca-4eb6-bd0f-5cf5dba642c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:31.420875 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6a788-e7ca-4eb6-bd0f-5cf5dba642c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.421153 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6a788-e7ca-4eb6-bd0f-5cf5dba642c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.421459 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6a788-e7ca-4eb6-bd0f-5cf5dba642c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.422165 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6a788-e7ca-4eb6-bd0f-5cf5dba642c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:31.423749 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6a788-e7ca-4eb6-bd0f-5cf5dba642c3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:31.433954 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1411/2831] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:41:31.438179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41193-0cec-44c0-bed1-124ff83aec6e admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:31.448486 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41193-0cec-44c0-bed1-124ff83aec6e admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:31.453477 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9789f-f803-4bc4-8b65-72bb6fd17da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:31.454346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9789f-f803-4bc4-8b65-72bb6fd17da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.454628 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9789f-f803-4bc4-8b65-72bb6fd17da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.454905 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9789f-f803-4bc4-8b65-72bb6fd17da1 admin admin] PATH_INFO: `/v3/projects/06d287a257c7463597087fc04274a4c4/users/b02bdae329634066a6deefafba1f98fe/roles/b32328bbd4d0434c8735a7edf46c81c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.456922 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9789f-f803-4bc4-8b65-72bb6fd17da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d287a257c7463597087fc04274a4c4, user_id=b02bdae329634066a6deefafba1f98fe, role_id=b32328bbd4d0434c8735a7edf46c81c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:31.459604 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9789f-f803-4bc4-8b65-72bb6fd17da1 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:31.469700 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1421/2832] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:41:31 2022] PUT /identity/v3/projects/06d287a257c7463597087fc04274a4c4/users/b02bdae329634066a6deefafba1f98fe/roles/b32328bbd4d0434c8735a7edf46c81c5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:31.479972 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cf5be-98cd-4bb9-be1c-10a649c03919 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.480282 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cf5be-98cd-4bb9-be1c-10a649c03919 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.480558 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cf5be-98cd-4bb9-be1c-10a649c03919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.506413 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-993cf5be-98cd-4bb9-be1c-10a649c03919 None None] MFA Rules not processed for user `b02bdae329634066a6deefafba1f98fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:31.507604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-993cf5be-98cd-4bb9-be1c-10a649c03919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:31.556435 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:31.576714 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1412/2833] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:41:31.588126 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9789f-f803-4bc4-8b65-72bb6fd17da1 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:31.589940 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d4a9789f-f803-4bc4-8b65-72bb6fd17da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:31.648152 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9789f-f803-4bc4-8b65-72bb6fd17da1 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:31.652011 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b59f8-cec1-41b2-a403-f33d3b1e26b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:31.652660 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b59f8-cec1-41b2-a403-f33d3b1e26b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.653309 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b59f8-cec1-41b2-a403-f33d3b1e26b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.653594 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b59f8-cec1-41b2-a403-f33d3b1e26b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.709904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b59f8-cec1-41b2-a403-f33d3b1e26b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:31.711283 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b59f8-cec1-41b2-a403-f33d3b1e26b9 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:31.720695 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1422/2834] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:41:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:41:33.182658 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cf5be-98cd-4bb9-be1c-10a649c03919 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:33.184158 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-993cf5be-98cd-4bb9-be1c-10a649c03919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:33.195833 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cf5be-98cd-4bb9-be1c-10a649c03919 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:33.199932 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3dbf3-7f55-40d3-adf5-052dc05ee6b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:33.200563 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3dbf3-7f55-40d3-adf5-052dc05ee6b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:33.200841 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3dbf3-7f55-40d3-adf5-052dc05ee6b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:33.201113 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3dbf3-7f55-40d3-adf5-052dc05ee6b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:33.255614 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3dbf3-7f55-40d3-adf5-052dc05ee6b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:33.256943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3dbf3-7f55-40d3-adf5-052dc05ee6b4 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:33.266215 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1413/2835] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:41:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:41:33.778798 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b59f8-cec1-41b2-a403-f33d3b1e26b9 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:33.787335 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b59f8-cec1-41b2-a403-f33d3b1e26b9 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:33.791464 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0a6fb-9d9e-4ec3-a9d8-10ce425c4403 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:33.792035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0a6fb-9d9e-4ec3-a9d8-10ce425c4403 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:33.792312 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0a6fb-9d9e-4ec3-a9d8-10ce425c4403 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:33.792582 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0a6fb-9d9e-4ec3-a9d8-10ce425c4403 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:33.801811 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0a6fb-9d9e-4ec3-a9d8-10ce425c4403 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:33.803278 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0a6fb-9d9e-4ec3-a9d8-10ce425c4403 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:33.808867 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:33.814268 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1423/2836] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:41:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:41:37.622994 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3dbf3-7f55-40d3-adf5-052dc05ee6b4 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:37.686260 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3dbf3-7f55-40d3-adf5-052dc05ee6b4 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:37.690787 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4279109-b750-4f07-810f-06fe574074b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:37.691650 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4279109-b750-4f07-810f-06fe574074b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:37.691933 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4279109-b750-4f07-810f-06fe574074b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:37.692210 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4279109-b750-4f07-810f-06fe574074b6 admin admin] PATH_INFO: `/v3/users/66b02df5baa94e17b9fde4d7c9b579be` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:37.693469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4279109-b750-4f07-810f-06fe574074b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b02df5baa94e17b9fde4d7c9b579be)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:37.695397 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4279109-b750-4f07-810f-06fe574074b6 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:37.742058 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c4279109-b750-4f07-810f-06fe574074b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b02df5baa94e17b9fde4d7c9b579be'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:37.742732 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c4279109-b750-4f07-810f-06fe574074b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b02df5baa94e17b9fde4d7c9b579be'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:37.749740 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c4279109-b750-4f07-810f-06fe574074b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b02df5baa94e17b9fde4d7c9b579be'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:37.750362 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c4279109-b750-4f07-810f-06fe574074b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b02df5baa94e17b9fde4d7c9b579be'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:37.757215 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c4279109-b750-4f07-810f-06fe574074b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b02df5baa94e17b9fde4d7c9b579be'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:37.774382 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1414/2837] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:41:37 2022] DELETE /identity/v3/users/66b02df5baa94e17b9fde4d7c9b579be => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:37.779515 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7992a0d-6ae5-43f9-8d9a-757366c533f4 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:37.780026 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7992a0d-6ae5-43f9-8d9a-757366c533f4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:37.780128 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7992a0d-6ae5-43f9-8d9a-757366c533f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:37.799413 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d7992a0d-6ae5-43f9-8d9a-757366c533f4 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:37.800615 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d7992a0d-6ae5-43f9-8d9a-757366c533f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:37.857928 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1424/2838] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:41:37.867757 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4279109-b750-4f07-810f-06fe574074b6 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:37.869142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c4279109-b750-4f07-810f-06fe574074b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:37.880129 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:37.927694 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4279109-b750-4f07-810f-06fe574074b6 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:37.931326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b6fec-8f1b-4cdc-af9c-33cf22eb4230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:37.931969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b6fec-8f1b-4cdc-af9c-33cf22eb4230 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:37.932254 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b6fec-8f1b-4cdc-af9c-33cf22eb4230 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:37.932531 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b6fec-8f1b-4cdc-af9c-33cf22eb4230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:37.942159 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b6fec-8f1b-4cdc-af9c-33cf22eb4230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:37.943640 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b6fec-8f1b-4cdc-af9c-33cf22eb4230 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:37.953468 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1415/2839] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:41:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:41:38.220281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7992a0d-6ae5-43f9-8d9a-757366c533f4 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:38.221757 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d7992a0d-6ae5-43f9-8d9a-757366c533f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:38.233891 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7992a0d-6ae5-43f9-8d9a-757366c533f4 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:38.238563 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792e137-0ad0-49bd-8f0b-ff577cc209af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:38.239421 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792e137-0ad0-49bd-8f0b-ff577cc209af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:38.239706 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792e137-0ad0-49bd-8f0b-ff577cc209af admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:38.239980 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792e137-0ad0-49bd-8f0b-ff577cc209af admin admin] PATH_INFO: `/v3/projects/622ec1c07ef84ecdab66ed7ee6746f66` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:38.241199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792e137-0ad0-49bd-8f0b-ff577cc209af admin admin] RBAC: Authorizing `identity:delete_project(project_id=622ec1c07ef84ecdab66ed7ee6746f66)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:38.243121 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792e137-0ad0-49bd-8f0b-ff577cc209af admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:38.290470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5792e137-0ad0-49bd-8f0b-ff577cc209af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '622ec1c07ef84ecdab66ed7ee6746f66', 'request_id': 'req-5792e137-0ad0-49bd-8f0b-ff577cc209af'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:38.297455 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5792e137-0ad0-49bd-8f0b-ff577cc209af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '622ec1c07ef84ecdab66ed7ee6746f66', 'request_id': 'req-5792e137-0ad0-49bd-8f0b-ff577cc209af'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:38.302914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5792e137-0ad0-49bd-8f0b-ff577cc209af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '622ec1c07ef84ecdab66ed7ee6746f66', 'request_id': 'req-5792e137-0ad0-49bd-8f0b-ff577cc209af'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:38.315353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5792e137-0ad0-49bd-8f0b-ff577cc209af admin admin] The token cache is being invalidate because project 622ec1c07ef84ecdab66ed7ee6746f66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:41:38.315644 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5792e137-0ad0-49bd-8f0b-ff577cc209af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:38.316323 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5792e137-0ad0-49bd-8f0b-ff577cc209af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:38.317961 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1425/2840] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:41:38 2022] DELETE /identity/v3/projects/622ec1c07ef84ecdab66ed7ee6746f66 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:38.321903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b6fec-8f1b-4cdc-af9c-33cf22eb4230 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:38.332399 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b6fec-8f1b-4cdc-af9c-33cf22eb4230 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:38.388021 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292264a2-dd7b-451f-8c0a-9d485f1fcb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:38.388880 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292264a2-dd7b-451f-8c0a-9d485f1fcb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:38.389161 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292264a2-dd7b-451f-8c0a-9d485f1fcb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:38.389463 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292264a2-dd7b-451f-8c0a-9d485f1fcb05 admin admin] PATH_INFO: `/v3/users/61fe9f2225bd49f4a25468b2491d8809` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:38.390643 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292264a2-dd7b-451f-8c0a-9d485f1fcb05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61fe9f2225bd49f4a25468b2491d8809)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:38.392615 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292264a2-dd7b-451f-8c0a-9d485f1fcb05 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:38.437228 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-292264a2-dd7b-451f-8c0a-9d485f1fcb05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61fe9f2225bd49f4a25468b2491d8809'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:38.437911 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-292264a2-dd7b-451f-8c0a-9d485f1fcb05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61fe9f2225bd49f4a25468b2491d8809'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:38.444986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-292264a2-dd7b-451f-8c0a-9d485f1fcb05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61fe9f2225bd49f4a25468b2491d8809'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:38.445620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-292264a2-dd7b-451f-8c0a-9d485f1fcb05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61fe9f2225bd49f4a25468b2491d8809'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:38.453295 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-292264a2-dd7b-451f-8c0a-9d485f1fcb05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61fe9f2225bd49f4a25468b2491d8809'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:38.471178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1416/2841] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:41:38 2022] DELETE /identity/v3/users/61fe9f2225bd49f4a25468b2491d8809 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:41:38.734416 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792e137-0ad0-49bd-8f0b-ff577cc209af admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:38.735867 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5792e137-0ad0-49bd-8f0b-ff577cc209af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:38.751808 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792e137-0ad0-49bd-8f0b-ff577cc209af admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:38.809208 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff43660-ea89-4c80-bb29-202377b763be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:38.810095 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff43660-ea89-4c80-bb29-202377b763be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:38.810378 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff43660-ea89-4c80-bb29-202377b763be admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:38.810654 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff43660-ea89-4c80-bb29-202377b763be admin admin] PATH_INFO: `/v3/projects/e06f65d2a54e454fb423969742149151` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:38.811838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff43660-ea89-4c80-bb29-202377b763be admin admin] RBAC: Authorizing `identity:delete_project(project_id=e06f65d2a54e454fb423969742149151)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:38.813769 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff43660-ea89-4c80-bb29-202377b763be admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:38.843243 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:38.860609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0ff43660-ea89-4c80-bb29-202377b763be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e06f65d2a54e454fb423969742149151', 'request_id': 'req-0ff43660-ea89-4c80-bb29-202377b763be'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:38.868496 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0ff43660-ea89-4c80-bb29-202377b763be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e06f65d2a54e454fb423969742149151', 'request_id': 'req-0ff43660-ea89-4c80-bb29-202377b763be'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:38.874704 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0ff43660-ea89-4c80-bb29-202377b763be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e06f65d2a54e454fb423969742149151', 'request_id': 'req-0ff43660-ea89-4c80-bb29-202377b763be'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:38.885641 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0ff43660-ea89-4c80-bb29-202377b763be admin admin] The token cache is being invalidate because project e06f65d2a54e454fb423969742149151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:41:38.885929 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0ff43660-ea89-4c80-bb29-202377b763be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:38.886553 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0ff43660-ea89-4c80-bb29-202377b763be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:38.888062 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1426/2842] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:41:38 2022] DELETE /identity/v3/projects/e06f65d2a54e454fb423969742149151 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:38.892049 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292264a2-dd7b-451f-8c0a-9d485f1fcb05 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:38.893464 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-292264a2-dd7b-451f-8c0a-9d485f1fcb05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:38.905963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292264a2-dd7b-451f-8c0a-9d485f1fcb05 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:38.934996 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:38.967629 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390ada3-c058-40ab-9f1b-a9d47eaf13ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:38.968498 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390ada3-c058-40ab-9f1b-a9d47eaf13ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:38.968782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390ada3-c058-40ab-9f1b-a9d47eaf13ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:38.969059 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390ada3-c058-40ab-9f1b-a9d47eaf13ad admin admin] PATH_INFO: `/v3/users/b02bdae329634066a6deefafba1f98fe` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:38.970303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390ada3-c058-40ab-9f1b-a9d47eaf13ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=b02bdae329634066a6deefafba1f98fe)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:38.972267 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390ada3-c058-40ab-9f1b-a9d47eaf13ad admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:39.017638 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5390ada3-c058-40ab-9f1b-a9d47eaf13ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b02bdae329634066a6deefafba1f98fe'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:39.018291 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5390ada3-c058-40ab-9f1b-a9d47eaf13ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b02bdae329634066a6deefafba1f98fe'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:39.026603 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5390ada3-c058-40ab-9f1b-a9d47eaf13ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b02bdae329634066a6deefafba1f98fe'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:39.027401 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5390ada3-c058-40ab-9f1b-a9d47eaf13ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b02bdae329634066a6deefafba1f98fe'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:39.034369 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5390ada3-c058-40ab-9f1b-a9d47eaf13ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b02bdae329634066a6deefafba1f98fe'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:39.052036 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1417/2843] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:41:38 2022] DELETE /identity/v3/users/b02bdae329634066a6deefafba1f98fe => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:39.316593 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff43660-ea89-4c80-bb29-202377b763be admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:39.318116 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0ff43660-ea89-4c80-bb29-202377b763be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:39.331231 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff43660-ea89-4c80-bb29-202377b763be admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:39.387551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb16b79-5ee6-43df-a4d9-dd8444b7c3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:39.388422 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb16b79-5ee6-43df-a4d9-dd8444b7c3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:39.388706 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb16b79-5ee6-43df-a4d9-dd8444b7c3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:39.388983 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb16b79-5ee6-43df-a4d9-dd8444b7c3d3 admin admin] PATH_INFO: `/v3/projects/06d287a257c7463597087fc04274a4c4` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:39.390228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb16b79-5ee6-43df-a4d9-dd8444b7c3d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d287a257c7463597087fc04274a4c4)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:39.392134 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb16b79-5ee6-43df-a4d9-dd8444b7c3d3 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:39.438003 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8bb16b79-5ee6-43df-a4d9-dd8444b7c3d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d287a257c7463597087fc04274a4c4', 'request_id': 'req-8bb16b79-5ee6-43df-a4d9-dd8444b7c3d3'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:39.444772 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8bb16b79-5ee6-43df-a4d9-dd8444b7c3d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d287a257c7463597087fc04274a4c4', 'request_id': 'req-8bb16b79-5ee6-43df-a4d9-dd8444b7c3d3'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:39.450104 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8bb16b79-5ee6-43df-a4d9-dd8444b7c3d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d287a257c7463597087fc04274a4c4', 'request_id': 'req-8bb16b79-5ee6-43df-a4d9-dd8444b7c3d3'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:39.460867 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8bb16b79-5ee6-43df-a4d9-dd8444b7c3d3 admin admin] The token cache is being invalidate because project 06d287a257c7463597087fc04274a4c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:41:39.461148 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8bb16b79-5ee6-43df-a4d9-dd8444b7c3d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:39.461799 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8bb16b79-5ee6-43df-a4d9-dd8444b7c3d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:41:39.463307 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1427/2844] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:41:39 2022] DELETE /identity/v3/projects/06d287a257c7463597087fc04274a4c4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:39.468688 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6a4b2-294c-4d24-83f7-e0ec72f21b25 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:39.468986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6a4b2-294c-4d24-83f7-e0ec72f21b25 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:39.469296 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6a4b2-294c-4d24-83f7-e0ec72f21b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:39.488250 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-eaa6a4b2-294c-4d24-83f7-e0ec72f21b25 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:39.489485 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-eaa6a4b2-294c-4d24-83f7-e0ec72f21b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:39.548094 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1418/2845] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:41:39.556950 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dc129-f3b7-4ac6-8d35-a88c19ec94ff None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:39.557276 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dc129-f3b7-4ac6-8d35-a88c19ec94ff None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:39.557576 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dc129-f3b7-4ac6-8d35-a88c19ec94ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:39.576018 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ec6dc129-f3b7-4ac6-8d35-a88c19ec94ff None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:39.577619 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ec6dc129-f3b7-4ac6-8d35-a88c19ec94ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:39.585854 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1428/2846] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:41:39.590754 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6a4b2-294c-4d24-83f7-e0ec72f21b25 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:39.600569 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6a4b2-294c-4d24-83f7-e0ec72f21b25 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:39.605155 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1684208-3a1b-4ab2-96c1-c572ac26d323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:39.605837 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1684208-3a1b-4ab2-96c1-c572ac26d323 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:39.606124 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1684208-3a1b-4ab2-96c1-c572ac26d323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:39.606403 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1684208-3a1b-4ab2-96c1-c572ac26d323 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:39.607130 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1684208-3a1b-4ab2-96c1-c572ac26d323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:39.607436 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1684208-3a1b-4ab2-96c1-c572ac26d323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:39.609026 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1684208-3a1b-4ab2-96c1-c572ac26d323 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:39.620518 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1419/2847] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:39.624887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dc129-f3b7-4ac6-8d35-a88c19ec94ff None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:39.634215 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dc129-f3b7-4ac6-8d35-a88c19ec94ff None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:39.639328 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6815b1-5f30-465a-8199-5b5c9a4aaad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:39.639965 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6815b1-5f30-465a-8199-5b5c9a4aaad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:39.640350 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6815b1-5f30-465a-8199-5b5c9a4aaad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:39.640630 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6815b1-5f30-465a-8199-5b5c9a4aaad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:39.641356 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6815b1-5f30-465a-8199-5b5c9a4aaad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:39.643258 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6815b1-5f30-465a-8199-5b5c9a4aaad5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:39.668704 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1429/2848] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:41:39 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:39.673146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1684208-3a1b-4ab2-96c1-c572ac26d323 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:39.683304 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1684208-3a1b-4ab2-96c1-c572ac26d323 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:39.716852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:39.740482 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a922d6e-811a-4ee5-b12b-7de502ca8ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:39.741142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a922d6e-811a-4ee5-b12b-7de502ca8ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:39.741529 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a922d6e-811a-4ee5-b12b-7de502ca8ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:39.741809 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a922d6e-811a-4ee5-b12b-7de502ca8ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:39.742522 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a922d6e-811a-4ee5-b12b-7de502ca8ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:39.744439 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a922d6e-811a-4ee5-b12b-7de502ca8ce8 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:39.764864 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1420/2849] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:41:39 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:39.769081 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6815b1-5f30-465a-8199-5b5c9a4aaad5 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:39.780169 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6815b1-5f30-465a-8199-5b5c9a4aaad5 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:39.784824 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6cf2e-4eae-445d-aba7-625fe8a3b00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:39.785517 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6cf2e-4eae-445d-aba7-625fe8a3b00e admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:39.785800 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6cf2e-4eae-445d-aba7-625fe8a3b00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:39.786079 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6cf2e-4eae-445d-aba7-625fe8a3b00e admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:39.786803 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6cf2e-4eae-445d-aba7-625fe8a3b00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:39.788407 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6cf2e-4eae-445d-aba7-625fe8a3b00e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:39.798656 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1430/2850] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:41:39.802374 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a922d6e-811a-4ee5-b12b-7de502ca8ce8 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:39.812085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a922d6e-811a-4ee5-b12b-7de502ca8ce8 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:39.816587 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f74b1-48bd-48be-ab2f-316681439afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:39.817235 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f74b1-48bd-48be-ab2f-316681439afd admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:39.817542 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f74b1-48bd-48be-ab2f-316681439afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:39.817816 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f74b1-48bd-48be-ab2f-316681439afd admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:39.818526 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f74b1-48bd-48be-ab2f-316681439afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:39.820102 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f74b1-48bd-48be-ab2f-316681439afd admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:39.830646 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1421/2851] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:41:39.834793 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6cf2e-4eae-445d-aba7-625fe8a3b00e admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:39.841617 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:39.845577 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6cf2e-4eae-445d-aba7-625fe8a3b00e admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:39.851572 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a38bb8-fb58-4361-94ad-0bec5d2b03aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:39.852507 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a38bb8-fb58-4361-94ad-0bec5d2b03aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:39.852999 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a38bb8-fb58-4361-94ad-0bec5d2b03aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:39.853528 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a38bb8-fb58-4361-94ad-0bec5d2b03aa admin admin] PATH_INFO: `/v3/projects/33abbbeefd504c2ba16170876f5853f0/users/3c8a15a0dd1e4e09a4440007a7f76f88/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:39.868264 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a38bb8-fb58-4361-94ad-0bec5d2b03aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=33abbbeefd504c2ba16170876f5853f0, user_id=3c8a15a0dd1e4e09a4440007a7f76f88, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:39.870962 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a38bb8-fb58-4361-94ad-0bec5d2b03aa admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:39.883615 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1431/2852] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:41:39 2022] PUT /identity/v3/projects/33abbbeefd504c2ba16170876f5853f0/users/3c8a15a0dd1e4e09a4440007a7f76f88/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:39.894451 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128c098-0e10-4904-baa4-b76359545c74 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:39.895001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128c098-0e10-4904-baa4-b76359545c74 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:39.895271 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128c098-0e10-4904-baa4-b76359545c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:39.922174 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c128c098-0e10-4904-baa4-b76359545c74 None None] MFA Rules not processed for user `3c8a15a0dd1e4e09a4440007a7f76f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:39.923377 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c128c098-0e10-4904-baa4-b76359545c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:39.988270 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1422/2853] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:41:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:41:40.000548 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a38bb8-fb58-4361-94ad-0bec5d2b03aa admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:40.002255 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d9a38bb8-fb58-4361-94ad-0bec5d2b03aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:40.080419 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a38bb8-fb58-4361-94ad-0bec5d2b03aa admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:40.084044 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d80cdf-b028-4ac0-a911-d91dd42ee741 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5602d0a51329412ab6e908e7787531a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:40.084684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d80cdf-b028-4ac0-a911-d91dd42ee741 service glance] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:40.084965 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d80cdf-b028-4ac0-a911-d91dd42ee741 service glance] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:40.085239 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d80cdf-b028-4ac0-a911-d91dd42ee741 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:40.093520 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d80cdf-b028-4ac0-a911-d91dd42ee741 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:40.094956 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d80cdf-b028-4ac0-a911-d91dd42ee741 service glance] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:40.103615 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1432/2854] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:41:39 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:41:49.985237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=49,keystone:INSERT=3 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:50.099729 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:54.903037 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128c098-0e10-4904-baa4-b76359545c74 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:54.905321 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c128c098-0e10-4904-baa4-b76359545c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:54.972904 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128c098-0e10-4904-baa4-b76359545c74 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:54.977782 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f55a05-318e-4e58-90e3-863853100699 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206242c775be40c7b96af6de635e2065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:54.978419 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f55a05-318e-4e58-90e3-863853100699 service placement] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:54.978697 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f55a05-318e-4e58-90e3-863853100699 service placement] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:54.978968 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f55a05-318e-4e58-90e3-863853100699 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:54.980677 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-39f55a05-318e-4e58-90e3-863853100699 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:54.991942 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f55a05-318e-4e58-90e3-863853100699 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:54.993539 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f55a05-318e-4e58-90e3-863853100699 service placement] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:55.003912 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1423/2855] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:41:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:42:04.785034 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d80cdf-b028-4ac0-a911-d91dd42ee741 service glance] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:04.848521 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d80cdf-b028-4ac0-a911-d91dd42ee741 service glance] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:04.852916 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb983b3-c73c-444c-a135-91d4aa6d7585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:04.853802 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb983b3-c73c-444c-a135-91d4aa6d7585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:04.854079 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb983b3-c73c-444c-a135-91d4aa6d7585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:04.854349 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb983b3-c73c-444c-a135-91d4aa6d7585 admin admin] PATH_INFO: `/v3/users/3c8a15a0dd1e4e09a4440007a7f76f88` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:04.855510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb983b3-c73c-444c-a135-91d4aa6d7585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c8a15a0dd1e4e09a4440007a7f76f88)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:04.857454 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb983b3-c73c-444c-a135-91d4aa6d7585 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:04.903284 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1cb983b3-c73c-444c-a135-91d4aa6d7585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c8a15a0dd1e4e09a4440007a7f76f88'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:42:04.903944 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1cb983b3-c73c-444c-a135-91d4aa6d7585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c8a15a0dd1e4e09a4440007a7f76f88'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:42:04.915603 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1cb983b3-c73c-444c-a135-91d4aa6d7585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c8a15a0dd1e4e09a4440007a7f76f88'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:42:04.922852 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1cb983b3-c73c-444c-a135-91d4aa6d7585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c8a15a0dd1e4e09a4440007a7f76f88'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:42:04.923504 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1cb983b3-c73c-444c-a135-91d4aa6d7585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c8a15a0dd1e4e09a4440007a7f76f88'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:42:04.935688 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1433/2856] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:42:04 2022] DELETE /identity/v3/users/3c8a15a0dd1e4e09a4440007a7f76f88 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:42:04.940794 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e2d3e-84b6-447a-bc5c-7d216da616c4 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:04.941293 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e2d3e-84b6-447a-bc5c-7d216da616c4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:04.941409 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e2d3e-84b6-447a-bc5c-7d216da616c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:04.959055 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-944e2d3e-84b6-447a-bc5c-7d216da616c4 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:04.960269 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-944e2d3e-84b6-447a-bc5c-7d216da616c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:05.019171 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1424/2857] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:42:05.027543 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb983b3-c73c-444c-a135-91d4aa6d7585 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:05.028985 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1cb983b3-c73c-444c-a135-91d4aa6d7585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:05.086600 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb983b3-c73c-444c-a135-91d4aa6d7585 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:05.090554 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca1e67-b412-4d5f-8615-b0f57ec2a206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:05.091207 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca1e67-b412-4d5f-8615-b0f57ec2a206 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.091491 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca1e67-b412-4d5f-8615-b0f57ec2a206 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.091770 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca1e67-b412-4d5f-8615-b0f57ec2a206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.101371 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca1e67-b412-4d5f-8615-b0f57ec2a206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:05.102748 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca1e67-b412-4d5f-8615-b0f57ec2a206 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:05.112611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1434/2858] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:42:05.380920 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e2d3e-84b6-447a-bc5c-7d216da616c4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:05.382447 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-944e2d3e-84b6-447a-bc5c-7d216da616c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:05.394438 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e2d3e-84b6-447a-bc5c-7d216da616c4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:05.399604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699c732-d65d-4223-b0af-15e798845f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:05.400469 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699c732-d65d-4223-b0af-15e798845f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.400787 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699c732-d65d-4223-b0af-15e798845f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.400985 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699c732-d65d-4223-b0af-15e798845f4c admin admin] PATH_INFO: `/v3/projects/33abbbeefd504c2ba16170876f5853f0` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.402251 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699c732-d65d-4223-b0af-15e798845f4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=33abbbeefd504c2ba16170876f5853f0)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:05.404241 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699c732-d65d-4223-b0af-15e798845f4c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:05.456788 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4699c732-d65d-4223-b0af-15e798845f4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33abbbeefd504c2ba16170876f5853f0', 'request_id': 'req-4699c732-d65d-4223-b0af-15e798845f4c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:42:05.462326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4699c732-d65d-4223-b0af-15e798845f4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33abbbeefd504c2ba16170876f5853f0', 'request_id': 'req-4699c732-d65d-4223-b0af-15e798845f4c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:42:05.469381 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4699c732-d65d-4223-b0af-15e798845f4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33abbbeefd504c2ba16170876f5853f0', 'request_id': 'req-4699c732-d65d-4223-b0af-15e798845f4c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:42:05.482010 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4699c732-d65d-4223-b0af-15e798845f4c admin admin] The token cache is being invalidate because project 33abbbeefd504c2ba16170876f5853f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:42:05.482299 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4699c732-d65d-4223-b0af-15e798845f4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:42:05.482918 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4699c732-d65d-4223-b0af-15e798845f4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:42:05.485075 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1425/2859] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:42:05 2022] DELETE /identity/v3/projects/33abbbeefd504c2ba16170876f5853f0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:42:05.490572 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53195ca6-f917-4590-9694-4ddcca507a5f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.490854 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53195ca6-f917-4590-9694-4ddcca507a5f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.491127 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53195ca6-f917-4590-9694-4ddcca507a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.508566 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-53195ca6-f917-4590-9694-4ddcca507a5f None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:05.509810 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-53195ca6-f917-4590-9694-4ddcca507a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:05.526220 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:05.571002 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1435/2860] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:42:05.578741 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c036d17-3150-45b2-bf2b-811948a637f6 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.579026 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c036d17-3150-45b2-bf2b-811948a637f6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.579303 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c036d17-3150-45b2-bf2b-811948a637f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.598573 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5c036d17-3150-45b2-bf2b-811948a637f6 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:05.599769 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5c036d17-3150-45b2-bf2b-811948a637f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:05.607648 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1426/2861] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:42:05.612305 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53195ca6-f917-4590-9694-4ddcca507a5f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:05.622012 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53195ca6-f917-4590-9694-4ddcca507a5f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:05.626769 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5bdf9-f535-48ea-adb0-be75328cf597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:05.627364 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5bdf9-f535-48ea-adb0-be75328cf597 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.627649 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5bdf9-f535-48ea-adb0-be75328cf597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.627925 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5bdf9-f535-48ea-adb0-be75328cf597 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.628650 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5bdf9-f535-48ea-adb0-be75328cf597 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:05.628984 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5bdf9-f535-48ea-adb0-be75328cf597 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:05.630646 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5bdf9-f535-48ea-adb0-be75328cf597 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:05.641967 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1436/2862] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:05.645889 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c036d17-3150-45b2-bf2b-811948a637f6 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:05.655054 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c036d17-3150-45b2-bf2b-811948a637f6 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:05.660379 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58171e99-2c62-4a87-9c99-3956559fecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:05.661023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58171e99-2c62-4a87-9c99-3956559fecd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.661331 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58171e99-2c62-4a87-9c99-3956559fecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.661605 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58171e99-2c62-4a87-9c99-3956559fecd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.662281 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58171e99-2c62-4a87-9c99-3956559fecd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:05.664163 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58171e99-2c62-4a87-9c99-3956559fecd8 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:05.667517 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:05.691247 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1427/2863] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:42:05 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:42:05.695391 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5bdf9-f535-48ea-adb0-be75328cf597 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:05.706112 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5bdf9-f535-48ea-adb0-be75328cf597 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:05.760907 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003326a2-c199-4e41-ae70-febdd19c2347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:05.761596 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003326a2-c199-4e41-ae70-febdd19c2347 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.761878 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003326a2-c199-4e41-ae70-febdd19c2347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.762152 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003326a2-c199-4e41-ae70-febdd19c2347 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.762822 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003326a2-c199-4e41-ae70-febdd19c2347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:05.765215 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003326a2-c199-4e41-ae70-febdd19c2347 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:05.785281 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1437/2864] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:42:05 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:42:05.789439 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58171e99-2c62-4a87-9c99-3956559fecd8 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:05.800108 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58171e99-2c62-4a87-9c99-3956559fecd8 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:05.804750 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b05b2-68ca-453e-8815-3f18a7116663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:05.805441 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b05b2-68ca-453e-8815-3f18a7116663 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.805727 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b05b2-68ca-453e-8815-3f18a7116663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.806004 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b05b2-68ca-453e-8815-3f18a7116663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.806725 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b05b2-68ca-453e-8815-3f18a7116663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:05.808316 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b05b2-68ca-453e-8815-3f18a7116663 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:05.818066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1428/2865] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:42:05.821877 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003326a2-c199-4e41-ae70-febdd19c2347 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:05.832142 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003326a2-c199-4e41-ae70-febdd19c2347 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:05.836708 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8a666-adaf-48ee-b9f3-bd5e0438c88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:05.837387 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8a666-adaf-48ee-b9f3-bd5e0438c88c admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.837673 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8a666-adaf-48ee-b9f3-bd5e0438c88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.837948 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8a666-adaf-48ee-b9f3-bd5e0438c88c admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.838668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8a666-adaf-48ee-b9f3-bd5e0438c88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:05.840260 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8a666-adaf-48ee-b9f3-bd5e0438c88c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:05.850946 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1438/2866] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:42:05.854760 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b05b2-68ca-453e-8815-3f18a7116663 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:05.864447 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b05b2-68ca-453e-8815-3f18a7116663 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:05.868965 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1d2bd-1b4c-4543-958a-8eefd17be653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:05.869862 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1d2bd-1b4c-4543-958a-8eefd17be653 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.870146 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1d2bd-1b4c-4543-958a-8eefd17be653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.870417 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1d2bd-1b4c-4543-958a-8eefd17be653 admin admin] PATH_INFO: `/v3/projects/4e64d3df24f34044bf7f87345b9c0096/users/6688943a42cd4d7697836461e34fb240/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.884587 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1d2bd-1b4c-4543-958a-8eefd17be653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e64d3df24f34044bf7f87345b9c0096, user_id=6688943a42cd4d7697836461e34fb240, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:05.887190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1d2bd-1b4c-4543-958a-8eefd17be653 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:05.899957 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1429/2867] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:42:05 2022] PUT /identity/v3/projects/4e64d3df24f34044bf7f87345b9c0096/users/6688943a42cd4d7697836461e34fb240/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:42:05.904805 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0fca4-623b-4692-8718-edfdefb7c478 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.905170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0fca4-623b-4692-8718-edfdefb7c478 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.906093 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0fca4-623b-4692-8718-edfdefb7c478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.923960 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9fd0fca4-623b-4692-8718-edfdefb7c478 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:05.925162 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9fd0fca4-623b-4692-8718-edfdefb7c478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:05.982789 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1439/2868] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:42:05.992696 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1d2bd-1b4c-4543-958a-8eefd17be653 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:05.994429 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-78f1d2bd-1b4c-4543-958a-8eefd17be653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:06.052227 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1d2bd-1b4c-4543-958a-8eefd17be653 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:06.055961 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397ff53-5935-4cee-9a4e-d594f7558008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:06.056604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397ff53-5935-4cee-9a4e-d594f7558008 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:06.056891 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397ff53-5935-4cee-9a4e-d594f7558008 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:06.057190 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397ff53-5935-4cee-9a4e-d594f7558008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:06.066900 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397ff53-5935-4cee-9a4e-d594f7558008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:06.068326 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397ff53-5935-4cee-9a4e-d594f7558008 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:06.078147 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1430/2869] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:42:06.705228 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6deb429-29c7-48a5-8748-3d8addd907ae None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:06.705564 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6deb429-29c7-48a5-8748-3d8addd907ae None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:06.705854 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6deb429-29c7-48a5-8748-3d8addd907ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:06.731607 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c6deb429-29c7-48a5-8748-3d8addd907ae None None] MFA Rules not processed for user `6688943a42cd4d7697836461e34fb240`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:06.732826 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c6deb429-29c7-48a5-8748-3d8addd907ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:06.752173 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:06.803947 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1440/2870] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:42:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:42:06.815317 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397ff53-5935-4cee-9a4e-d594f7558008 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:06.816757 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5397ff53-5935-4cee-9a4e-d594f7558008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:06.874014 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397ff53-5935-4cee-9a4e-d594f7558008 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:06.877559 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d171100-cb33-429d-9785-b37db29cd299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:06.878197 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d171100-cb33-429d-9785-b37db29cd299 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:06.878475 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d171100-cb33-429d-9785-b37db29cd299 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:06.878746 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d171100-cb33-429d-9785-b37db29cd299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:06.887262 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d171100-cb33-429d-9785-b37db29cd299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:06.888707 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d171100-cb33-429d-9785-b37db29cd299 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:06.897784 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1431/2871] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:42:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:42:08.231033 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a1502-249f-48c3-a743-bfd2cdbb8da8 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:08.231518 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a1502-249f-48c3-a743-bfd2cdbb8da8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:08.231634 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a1502-249f-48c3-a743-bfd2cdbb8da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:08.248972 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-884a1502-249f-48c3-a743-bfd2cdbb8da8 None None] MFA Rules not processed for user `6688943a42cd4d7697836461e34fb240`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:08.250935 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-884a1502-249f-48c3-a743-bfd2cdbb8da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:08.257651 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1441/2872] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:42:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:42:16.893749 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=73,keystone:INSERT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:18.243942 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=22 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:35.226442 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470a91a-5cea-4e92-99b1-df288af94a99 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:35.227056 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470a91a-5cea-4e92-99b1-df288af94a99 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:35.227056 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470a91a-5cea-4e92-99b1-df288af94a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:35.244955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e470a91a-5cea-4e92-99b1-df288af94a99 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:35.246182 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e470a91a-5cea-4e92-99b1-df288af94a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:35.253963 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1432/2873] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 12 18:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:42:35.297493 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a1502-249f-48c3-a743-bfd2cdbb8da8 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:35.299172 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-884a1502-249f-48c3-a743-bfd2cdbb8da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:35.371674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a1502-249f-48c3-a743-bfd2cdbb8da8 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:35.377061 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb807d-91c6-47a4-90f9-abfb5103d05b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:35.377739 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb807d-91c6-47a4-90f9-abfb5103d05b service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:35.378060 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb807d-91c6-47a4-90f9-abfb5103d05b service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:35.378336 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb807d-91c6-47a4-90f9-abfb5103d05b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:35.387340 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb807d-91c6-47a4-90f9-abfb5103d05b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:35.388927 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb807d-91c6-47a4-90f9-abfb5103d05b service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:35.398864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1442/2874] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:42:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:42:38.296495 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f82e8-538d-4dae-b80b-02569fd438b7 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:38.297047 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f82e8-538d-4dae-b80b-02569fd438b7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:38.297047 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f82e8-538d-4dae-b80b-02569fd438b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:38.315397 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6f9f82e8-538d-4dae-b80b-02569fd438b7 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:38.316604 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6f9f82e8-538d-4dae-b80b-02569fd438b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:38.324579 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1433/2875] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 12 18:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:42:38.345360 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb807d-91c6-47a4-90f9-abfb5103d05b service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:38.346759 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-17bb807d-91c6-47a4-90f9-abfb5103d05b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:38.362931 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb807d-91c6-47a4-90f9-abfb5103d05b service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:38.369247 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8909e86-929e-402c-b1ef-edc88f750aca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:38.369993 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8909e86-929e-402c-b1ef-edc88f750aca service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:38.370276 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8909e86-929e-402c-b1ef-edc88f750aca service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:38.370550 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8909e86-929e-402c-b1ef-edc88f750aca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:38.378665 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8909e86-929e-402c-b1ef-edc88f750aca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:38.380270 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8909e86-929e-402c-b1ef-edc88f750aca service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:38.389561 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1443/2876] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:42:41.518998 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558b8ca-85ed-4fdd-80fa-76c52a7f7322 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:41.519543 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558b8ca-85ed-4fdd-80fa-76c52a7f7322 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:41.519543 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558b8ca-85ed-4fdd-80fa-76c52a7f7322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:41.538371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a558b8ca-85ed-4fdd-80fa-76c52a7f7322 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:41.539676 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a558b8ca-85ed-4fdd-80fa-76c52a7f7322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:41.548237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1434/2877] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 12 18:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:42:41.572914 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8909e86-929e-402c-b1ef-edc88f750aca service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:41.584408 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8909e86-929e-402c-b1ef-edc88f750aca service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:41.590199 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e5fea-b846-48b2-95e1-c1013149bcdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:41.590831 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e5fea-b846-48b2-95e1-c1013149bcdd service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:41.591114 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e5fea-b846-48b2-95e1-c1013149bcdd service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:41.591388 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e5fea-b846-48b2-95e1-c1013149bcdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:41.599562 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e5fea-b846-48b2-95e1-c1013149bcdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:41.601170 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e5fea-b846-48b2-95e1-c1013149bcdd service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:41.610439 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1444/2878] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:42:44.625840 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd90498-7b9c-4dc1-8237-5d4063a0bcb9 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:44.626320 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd90498-7b9c-4dc1-8237-5d4063a0bcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:44.626560 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd90498-7b9c-4dc1-8237-5d4063a0bcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:44.644280 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-efd90498-7b9c-4dc1-8237-5d4063a0bcb9 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:44.645517 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-efd90498-7b9c-4dc1-8237-5d4063a0bcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:44.654063 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1435/2879] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 12 18:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:42:44.677401 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e5fea-b846-48b2-95e1-c1013149bcdd service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:44.688508 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e5fea-b846-48b2-95e1-c1013149bcdd service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:44.694035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38568107-3418-485a-91ef-8d914c66e3e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:44.694662 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38568107-3418-485a-91ef-8d914c66e3e5 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:44.694947 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38568107-3418-485a-91ef-8d914c66e3e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:44.695227 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38568107-3418-485a-91ef-8d914c66e3e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:44.703615 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38568107-3418-485a-91ef-8d914c66e3e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:44.705194 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38568107-3418-485a-91ef-8d914c66e3e5 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:44.715204 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1445/2880] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:42:47.757392 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f70c33-b777-4309-973c-47a6dd8c590d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:47.757882 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f70c33-b777-4309-973c-47a6dd8c590d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:47.757987 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f70c33-b777-4309-973c-47a6dd8c590d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:47.776003 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-60f70c33-b777-4309-973c-47a6dd8c590d None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:47.777194 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-60f70c33-b777-4309-973c-47a6dd8c590d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:47.784990 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1436/2881] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 12 18:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:42:47.820190 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38568107-3418-485a-91ef-8d914c66e3e5 service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:47.833148 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38568107-3418-485a-91ef-8d914c66e3e5 service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:47.839456 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b5ed2-1076-4bb4-97c6-b37ff3bce601 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:47.840110 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b5ed2-1076-4bb4-97c6-b37ff3bce601 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:47.840395 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b5ed2-1076-4bb4-97c6-b37ff3bce601 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:47.840674 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b5ed2-1076-4bb4-97c6-b37ff3bce601 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:47.850027 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b5ed2-1076-4bb4-97c6-b37ff3bce601 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:47.851488 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b5ed2-1076-4bb4-97c6-b37ff3bce601 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:47.863106 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1446/2882] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:42:50.908422 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895fb1-40d0-43b0-a92a-e094dcedcb45 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:50.908921 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895fb1-40d0-43b0-a92a-e094dcedcb45 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:50.909046 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895fb1-40d0-43b0-a92a-e094dcedcb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:50.926350 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b2895fb1-40d0-43b0-a92a-e094dcedcb45 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:50.927528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b2895fb1-40d0-43b0-a92a-e094dcedcb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:50.935637 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1437/2883] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 12 18:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:42:50.961641 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b5ed2-1076-4bb4-97c6-b37ff3bce601 service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:50.973465 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b5ed2-1076-4bb4-97c6-b37ff3bce601 service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:50.978928 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7778c-324d-4a28-9d3e-8f4b4fcddf32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:50.979559 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7778c-324d-4a28-9d3e-8f4b4fcddf32 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:50.979848 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7778c-324d-4a28-9d3e-8f4b4fcddf32 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:50.980125 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7778c-324d-4a28-9d3e-8f4b4fcddf32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:50.988229 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7778c-324d-4a28-9d3e-8f4b4fcddf32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:50.989895 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7778c-324d-4a28-9d3e-8f4b4fcddf32 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:50.999334 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1447/2884] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:43:00.921436 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=18 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:00.995183 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=64 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:06.098397 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4f3ae-5d61-4e07-8f99-681df4770a76 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:06.098902 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4f3ae-5d61-4e07-8f99-681df4770a76 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:06.099012 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4f3ae-5d61-4e07-8f99-681df4770a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:06.116335 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8ce4f3ae-5d61-4e07-8f99-681df4770a76 None None] MFA Rules not processed for user `6688943a42cd4d7697836461e34fb240`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:06.117541 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8ce4f3ae-5d61-4e07-8f99-681df4770a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:06.124949 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1438/2885] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:43:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:43:06.351624 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7778c-324d-4a28-9d3e-8f4b4fcddf32 service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:06.361664 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7778c-324d-4a28-9d3e-8f4b4fcddf32 service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:06.365204 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310d9c6-4c9d-4603-9e48-4466b8c3d526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:06.365865 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310d9c6-4c9d-4603-9e48-4466b8c3d526 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:06.366144 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310d9c6-4c9d-4603-9e48-4466b8c3d526 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:06.366418 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310d9c6-4c9d-4603-9e48-4466b8c3d526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:06.368163 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a310d9c6-4c9d-4603-9e48-4466b8c3d526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:06.377592 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310d9c6-4c9d-4603-9e48-4466b8c3d526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:06.379055 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310d9c6-4c9d-4603-9e48-4466b8c3d526 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:06.387001 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1448/2886] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:43:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:43:12.404371 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4f3ae-5d61-4e07-8f99-681df4770a76 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:12.405804 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8ce4f3ae-5d61-4e07-8f99-681df4770a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:12.418506 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4f3ae-5d61-4e07-8f99-681df4770a76 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:12.422085 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99398e94-9450-4d17-b096-7193f06c2036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:12.422719 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398e94-9450-4d17-b096-7193f06c2036 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:12.423004 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398e94-9450-4d17-b096-7193f06c2036 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:12.423286 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398e94-9450-4d17-b096-7193f06c2036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:12.425001 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-99398e94-9450-4d17-b096-7193f06c2036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:12.438110 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99398e94-9450-4d17-b096-7193f06c2036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:12.439528 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99398e94-9450-4d17-b096-7193f06c2036 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:12.452064 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1439/2887] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:43:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:43:14.781904 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310d9c6-4c9d-4603-9e48-4466b8c3d526 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:14.790900 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310d9c6-4c9d-4603-9e48-4466b8c3d526 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:14.795417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2224c-57a1-4d71-afe9-401dcb865a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:14.796060 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2224c-57a1-4d71-afe9-401dcb865a9c service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:14.796340 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2224c-57a1-4d71-afe9-401dcb865a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:14.797282 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2224c-57a1-4d71-afe9-401dcb865a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:14.799082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-21b2224c-57a1-4d71-afe9-401dcb865a9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:14.813069 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2224c-57a1-4d71-afe9-401dcb865a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:14.814517 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2224c-57a1-4d71-afe9-401dcb865a9c service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:14.825538 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1449/2888] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:43:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:43:18.797879 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9fb50-bb03-42a7-ab11-505d9db10255 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:18.798391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9fb50-bb03-42a7-ab11-505d9db10255 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:18.798391 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9fb50-bb03-42a7-ab11-505d9db10255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:18.815835 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c8a9fb50-bb03-42a7-ab11-505d9db10255 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:18.817021 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c8a9fb50-bb03-42a7-ab11-505d9db10255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:18.825321 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1440/2889] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 12 18:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:43:18.868965 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2224c-57a1-4d71-afe9-401dcb865a9c service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:18.880335 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2224c-57a1-4d71-afe9-401dcb865a9c service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:18.886684 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8b105-1987-48ee-9e14-98cc62a4f7bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:18.887317 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8b105-1987-48ee-9e14-98cc62a4f7bb service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:18.887603 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8b105-1987-48ee-9e14-98cc62a4f7bb service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:18.887881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8b105-1987-48ee-9e14-98cc62a4f7bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:18.896739 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8b105-1987-48ee-9e14-98cc62a4f7bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:18.898360 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8b105-1987-48ee-9e14-98cc62a4f7bb service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:18.908369 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1450/2890] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:43:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:43:22.054130 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37f63a-f7eb-4070-9463-4d2944067bca None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:22.054687 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37f63a-f7eb-4070-9463-4d2944067bca None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:22.054687 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37f63a-f7eb-4070-9463-4d2944067bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:22.073787 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-cb37f63a-f7eb-4070-9463-4d2944067bca None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:22.074986 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-cb37f63a-f7eb-4070-9463-4d2944067bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:22.083117 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1441/2891] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 12 18:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:43:22.122417 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8b105-1987-48ee-9e14-98cc62a4f7bb service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:22.133553 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8b105-1987-48ee-9e14-98cc62a4f7bb service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:22.139745 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3ff4f-e8c6-4e74-84b0-79d4534a9b16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:22.140367 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3ff4f-e8c6-4e74-84b0-79d4534a9b16 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:22.140648 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3ff4f-e8c6-4e74-84b0-79d4534a9b16 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:22.140926 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3ff4f-e8c6-4e74-84b0-79d4534a9b16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:22.149082 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3ff4f-e8c6-4e74-84b0-79d4534a9b16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:22.150683 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3ff4f-e8c6-4e74-84b0-79d4534a9b16 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:22.159885 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1451/2892] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:43:25.117551 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66587a3b-139d-444e-8506-e6eeebb2e584 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:25.118066 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66587a3b-139d-444e-8506-e6eeebb2e584 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:25.118188 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66587a3b-139d-444e-8506-e6eeebb2e584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:25.136673 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-66587a3b-139d-444e-8506-e6eeebb2e584 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:25.137896 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-66587a3b-139d-444e-8506-e6eeebb2e584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:25.145771 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1442/2893] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 12 18:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:43:25.166392 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3ff4f-e8c6-4e74-84b0-79d4534a9b16 service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:25.177585 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3ff4f-e8c6-4e74-84b0-79d4534a9b16 service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:25.184120 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf77c5-2dd2-405c-b4e4-efb657aae445 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:25.184748 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf77c5-2dd2-405c-b4e4-efb657aae445 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:25.185035 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf77c5-2dd2-405c-b4e4-efb657aae445 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:25.185353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf77c5-2dd2-405c-b4e4-efb657aae445 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:25.193512 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf77c5-2dd2-405c-b4e4-efb657aae445 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:25.195087 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf77c5-2dd2-405c-b4e4-efb657aae445 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:25.205383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1452/2894] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:43:28.281752 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f0611-78ba-4579-8f4f-ab85f861df06 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:28.282275 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f0611-78ba-4579-8f4f-ab85f861df06 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:28.282384 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f0611-78ba-4579-8f4f-ab85f861df06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:28.299903 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e25f0611-78ba-4579-8f4f-ab85f861df06 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:28.301092 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e25f0611-78ba-4579-8f4f-ab85f861df06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:28.309023 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1443/2895] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 12 18:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:43:28.333382 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf77c5-2dd2-405c-b4e4-efb657aae445 service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:28.345462 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf77c5-2dd2-405c-b4e4-efb657aae445 service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:28.351146 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dd0ad-e19d-4b33-9f24-15a4410f1d57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:28.351814 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dd0ad-e19d-4b33-9f24-15a4410f1d57 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:28.352099 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dd0ad-e19d-4b33-9f24-15a4410f1d57 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:28.352380 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dd0ad-e19d-4b33-9f24-15a4410f1d57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:28.360513 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575dd0ad-e19d-4b33-9f24-15a4410f1d57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:28.362136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575dd0ad-e19d-4b33-9f24-15a4410f1d57 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:28.371310 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1453/2896] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:43:31.483028 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246abf48-546b-4dab-a37a-8a4f03a58821 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:31.483589 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246abf48-546b-4dab-a37a-8a4f03a58821 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:31.483589 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246abf48-546b-4dab-a37a-8a4f03a58821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:31.489968 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=22 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:31.502127 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-246abf48-546b-4dab-a37a-8a4f03a58821 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:31.503351 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-246abf48-546b-4dab-a37a-8a4f03a58821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:31.511650 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1444/2897] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 12 18:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:43:31.538249 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dd0ad-e19d-4b33-9f24-15a4410f1d57 service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:31.543917 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=37 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:31.550042 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dd0ad-e19d-4b33-9f24-15a4410f1d57 service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:31.555668 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0234c-8a10-443b-bbeb-5f5224e4c48a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c1bb51c2b642ffa4708122d826fc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:31.556256 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0234c-8a10-443b-bbeb-5f5224e4c48a service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:31.556544 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0234c-8a10-443b-bbeb-5f5224e4c48a service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:31.556823 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0234c-8a10-443b-bbeb-5f5224e4c48a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:31.565660 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0234c-8a10-443b-bbeb-5f5224e4c48a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:31.566874 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0234c-8a10-443b-bbeb-5f5224e4c48a service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:31.577182 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1454/2898] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:43:41.497199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=2 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:41.572351 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=5 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:00.206164 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246abf48-546b-4dab-a37a-8a4f03a58821 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:00.207543 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-246abf48-546b-4dab-a37a-8a4f03a58821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:44:00.267033 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0234c-8a10-443b-bbeb-5f5224e4c48a service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:00.282611 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0234c-8a10-443b-bbeb-5f5224e4c48a service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:00.285050 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246abf48-546b-4dab-a37a-8a4f03a58821 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:00.287321 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ff8a9-296d-437b-8f8f-c1d8a8285991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:00.288189 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ff8a9-296d-437b-8f8f-c1d8a8285991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:00.288470 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ff8a9-296d-437b-8f8f-c1d8a8285991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:00.288746 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ff8a9-296d-437b-8f8f-c1d8a8285991 admin admin] PATH_INFO: `/v3/users/6688943a42cd4d7697836461e34fb240` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:00.289964 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ff8a9-296d-437b-8f8f-c1d8a8285991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6688943a42cd4d7697836461e34fb240)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:00.290091 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acac083-5eca-43ca-8258-1bb0546d2052 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206242c775be40c7b96af6de635e2065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:00.290637 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acac083-5eca-43ca-8258-1bb0546d2052 service placement] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:00.291393 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acac083-5eca-43ca-8258-1bb0546d2052 service placement] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:00.291675 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acac083-5eca-43ca-8258-1bb0546d2052 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:00.291881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ff8a9-296d-437b-8f8f-c1d8a8285991 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:00.293464 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6acac083-5eca-43ca-8258-1bb0546d2052 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:44:00.305620 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acac083-5eca-43ca-8258-1bb0546d2052 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:00.307199 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acac083-5eca-43ca-8258-1bb0546d2052 service placement] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:00.317348 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1445/2899] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:44:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:44:00.340009 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-198ff8a9-296d-437b-8f8f-c1d8a8285991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6688943a42cd4d7697836461e34fb240'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:00.340679 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-198ff8a9-296d-437b-8f8f-c1d8a8285991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6688943a42cd4d7697836461e34fb240'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:00.354812 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-198ff8a9-296d-437b-8f8f-c1d8a8285991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6688943a42cd4d7697836461e34fb240'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:00.362290 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-198ff8a9-296d-437b-8f8f-c1d8a8285991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6688943a42cd4d7697836461e34fb240'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:00.363017 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-198ff8a9-296d-437b-8f8f-c1d8a8285991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6688943a42cd4d7697836461e34fb240'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:00.375346 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1455/2900] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:44:00 2022] DELETE /identity/v3/users/6688943a42cd4d7697836461e34fb240 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:44:00.547238 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acac083-5eca-43ca-8258-1bb0546d2052 service placement] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:00.557852 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acac083-5eca-43ca-8258-1bb0546d2052 service placement] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:00.617416 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5d02d-102f-48ab-ba16-4c3da610194b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:00.618322 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5d02d-102f-48ab-ba16-4c3da610194b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:00.618633 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5d02d-102f-48ab-ba16-4c3da610194b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:00.618943 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5d02d-102f-48ab-ba16-4c3da610194b admin admin] PATH_INFO: `/v3/projects/4e64d3df24f34044bf7f87345b9c0096` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:00.620136 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5d02d-102f-48ab-ba16-4c3da610194b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e64d3df24f34044bf7f87345b9c0096)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:00.622115 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5d02d-102f-48ab-ba16-4c3da610194b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:00.668637 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8eb5d02d-102f-48ab-ba16-4c3da610194b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e64d3df24f34044bf7f87345b9c0096', 'request_id': 'req-8eb5d02d-102f-48ab-ba16-4c3da610194b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:00.674202 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8eb5d02d-102f-48ab-ba16-4c3da610194b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e64d3df24f34044bf7f87345b9c0096', 'request_id': 'req-8eb5d02d-102f-48ab-ba16-4c3da610194b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:00.680221 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8eb5d02d-102f-48ab-ba16-4c3da610194b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e64d3df24f34044bf7f87345b9c0096', 'request_id': 'req-8eb5d02d-102f-48ab-ba16-4c3da610194b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:00.691901 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8eb5d02d-102f-48ab-ba16-4c3da610194b admin admin] The token cache is being invalidate because project 4e64d3df24f34044bf7f87345b9c0096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:44:00.692184 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8eb5d02d-102f-48ab-ba16-4c3da610194b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:00.692801 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8eb5d02d-102f-48ab-ba16-4c3da610194b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:00.694342 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1446/2901] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:44:00 2022] DELETE /identity/v3/projects/4e64d3df24f34044bf7f87345b9c0096 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:44:00.699309 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38557fb-5968-4129-81d8-ce4a32e76d2f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:00.699607 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38557fb-5968-4129-81d8-ce4a32e76d2f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:00.699887 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38557fb-5968-4129-81d8-ce4a32e76d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:00.719203 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d38557fb-5968-4129-81d8-ce4a32e76d2f None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:44:00.720401 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d38557fb-5968-4129-81d8-ce4a32e76d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:44:00.780136 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1456/2902] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:44:00.787618 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3b7ac-c66b-4c33-94ce-e2246ae95495 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:00.787910 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3b7ac-c66b-4c33-94ce-e2246ae95495 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:00.788189 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3b7ac-c66b-4c33-94ce-e2246ae95495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:00.805975 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-11c3b7ac-c66b-4c33-94ce-e2246ae95495 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:44:00.807166 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-11c3b7ac-c66b-4c33-94ce-e2246ae95495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:44:00.815513 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1447/2903] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:44:00.819461 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38557fb-5968-4129-81d8-ce4a32e76d2f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:00.830040 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38557fb-5968-4129-81d8-ce4a32e76d2f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:00.834622 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a2bcf-a0d7-4fb5-8a15-11b2e2425623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:00.835267 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a2bcf-a0d7-4fb5-8a15-11b2e2425623 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:00.835551 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a2bcf-a0d7-4fb5-8a15-11b2e2425623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:00.835828 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a2bcf-a0d7-4fb5-8a15-11b2e2425623 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:00.836558 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a2bcf-a0d7-4fb5-8a15-11b2e2425623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:00.836864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a2bcf-a0d7-4fb5-8a15-11b2e2425623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:00.838510 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a2bcf-a0d7-4fb5-8a15-11b2e2425623 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:00.849991 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1457/2904] 10.222.0.57 () {58 vars in 1152 bytes} [Tue Jul 12 18:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:00.854271 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3b7ac-c66b-4c33-94ce-e2246ae95495 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:00.863457 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3b7ac-c66b-4c33-94ce-e2246ae95495 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:00.868122 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ba429-660d-42e1-833e-c6f98ef7db67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:00.868768 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ba429-660d-42e1-833e-c6f98ef7db67 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:00.869053 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ba429-660d-42e1-833e-c6f98ef7db67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:00.869367 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ba429-660d-42e1-833e-c6f98ef7db67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:00.870081 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ba429-660d-42e1-833e-c6f98ef7db67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:00.871973 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ba429-660d-42e1-833e-c6f98ef7db67 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:00.882142 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:00.899926 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1448/2905] 10.222.0.57 () {60 vars in 1152 bytes} [Tue Jul 12 18:44:00 2022] POST /identity/v3/projects => generated 397 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:44:00.905044 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a2bcf-a0d7-4fb5-8a15-11b2e2425623 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:00.914942 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a2bcf-a0d7-4fb5-8a15-11b2e2425623 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:00.970863 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68878934-3d84-423a-96c2-ac01a0b76b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:00.971450 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68878934-3d84-423a-96c2-ac01a0b76b55 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:00.971734 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68878934-3d84-423a-96c2-ac01a0b76b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:00.972012 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68878934-3d84-423a-96c2-ac01a0b76b55 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:00.972699 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68878934-3d84-423a-96c2-ac01a0b76b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:00.974640 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68878934-3d84-423a-96c2-ac01a0b76b55 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:00.981077 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:00.995509 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1458/2906] 10.222.0.57 () {60 vars in 1143 bytes} [Tue Jul 12 18:44:00 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:44:01.000015 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ba429-660d-42e1-833e-c6f98ef7db67 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:01.010157 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ba429-660d-42e1-833e-c6f98ef7db67 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:01.015273 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5ac9c-b9fd-48b9-8a70-f99a4921086d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:01.015924 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5ac9c-b9fd-48b9-8a70-f99a4921086d admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:01.016241 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5ac9c-b9fd-48b9-8a70-f99a4921086d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:01.016522 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5ac9c-b9fd-48b9-8a70-f99a4921086d admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:01.017237 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5ac9c-b9fd-48b9-8a70-f99a4921086d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:01.018865 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5ac9c-b9fd-48b9-8a70-f99a4921086d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:01.029236 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1449/2907] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:44:01.033179 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68878934-3d84-423a-96c2-ac01a0b76b55 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:01.043153 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68878934-3d84-423a-96c2-ac01a0b76b55 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:01.048385 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1433bc7-5a44-4910-af50-fcdf28f0b441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:01.049050 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1433bc7-5a44-4910-af50-fcdf28f0b441 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:01.049350 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1433bc7-5a44-4910-af50-fcdf28f0b441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:01.049629 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1433bc7-5a44-4910-af50-fcdf28f0b441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:01.050342 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1433bc7-5a44-4910-af50-fcdf28f0b441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:01.051935 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1433bc7-5a44-4910-af50-fcdf28f0b441 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:01.061762 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1459/2908] 10.222.0.57 () {58 vars in 1121 bytes} [Tue Jul 12 18:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:44:01.065631 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5ac9c-b9fd-48b9-8a70-f99a4921086d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:01.075354 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5ac9c-b9fd-48b9-8a70-f99a4921086d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:01.080208 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeefd65-65bc-4210-a42a-5b4d518e4a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:01.081070 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeefd65-65bc-4210-a42a-5b4d518e4a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:01.081379 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeefd65-65bc-4210-a42a-5b4d518e4a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:01.081656 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeefd65-65bc-4210-a42a-5b4d518e4a27 admin admin] PATH_INFO: `/v3/projects/cc432784940543d4b257dee81539a93d/users/a758b1b59fea4c8b99fee57391c88935/roles/7ad29af380bd4e608c78235cbf9741b6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:01.096267 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeefd65-65bc-4210-a42a-5b4d518e4a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc432784940543d4b257dee81539a93d, user_id=a758b1b59fea4c8b99fee57391c88935, role_id=7ad29af380bd4e608c78235cbf9741b6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:01.098953 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeefd65-65bc-4210-a42a-5b4d518e4a27 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:01.112037 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1450/2909] 10.222.0.57 () {60 vars in 1482 bytes} [Tue Jul 12 18:44:01 2022] PUT /identity/v3/projects/cc432784940543d4b257dee81539a93d/users/a758b1b59fea4c8b99fee57391c88935/roles/7ad29af380bd4e608c78235cbf9741b6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:44:01.121583 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d9da9-b314-44f2-8dae-0fb4cfc00550 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:01.121881 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d9da9-b314-44f2-8dae-0fb4cfc00550 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:01.122237 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d9da9-b314-44f2-8dae-0fb4cfc00550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:01.147681 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b12d9da9-b314-44f2-8dae-0fb4cfc00550 None None] MFA Rules not processed for user `a758b1b59fea4c8b99fee57391c88935`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:44:01.148875 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b12d9da9-b314-44f2-8dae-0fb4cfc00550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:44:01.214435 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1460/2910] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:44:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:44:01.226257 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeefd65-65bc-4210-a42a-5b4d518e4a27 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:01.227883 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1aeefd65-65bc-4210-a42a-5b4d518e4a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:44:01.284380 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeefd65-65bc-4210-a42a-5b4d518e4a27 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:01.288035 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628537d-21c5-4107-9a45-37da372d28e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf61fd1e2ab426bbbbcc8dc7d552942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:01.288672 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628537d-21c5-4107-9a45-37da372d28e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:01.288955 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628537d-21c5-4107-9a45-37da372d28e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:01.289231 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628537d-21c5-4107-9a45-37da372d28e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:01.297581 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628537d-21c5-4107-9a45-37da372d28e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:01.299006 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628537d-21c5-4107-9a45-37da372d28e5 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:01.307753 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1451/2911] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:44:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:44:06.248338 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d9da9-b314-44f2-8dae-0fb4cfc00550 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:06.308827 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d9da9-b314-44f2-8dae-0fb4cfc00550 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:06.313796 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b516de-d184-427e-a28b-c80580bef6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:06.314659 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b516de-d184-427e-a28b-c80580bef6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:06.314941 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b516de-d184-427e-a28b-c80580bef6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:06.315218 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b516de-d184-427e-a28b-c80580bef6a5 admin admin] PATH_INFO: `/v3/users/a758b1b59fea4c8b99fee57391c88935` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:06.316388 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b516de-d184-427e-a28b-c80580bef6a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a758b1b59fea4c8b99fee57391c88935)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:06.318347 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b516de-d184-427e-a28b-c80580bef6a5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:06.364588 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d9b516de-d184-427e-a28b-c80580bef6a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a758b1b59fea4c8b99fee57391c88935'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:06.365383 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d9b516de-d184-427e-a28b-c80580bef6a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a758b1b59fea4c8b99fee57391c88935'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:06.377883 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d9b516de-d184-427e-a28b-c80580bef6a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a758b1b59fea4c8b99fee57391c88935'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:06.382340 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:06.386043 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d9b516de-d184-427e-a28b-c80580bef6a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a758b1b59fea4c8b99fee57391c88935'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:06.386738 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d9b516de-d184-427e-a28b-c80580bef6a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a758b1b59fea4c8b99fee57391c88935'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:06.400610 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1461/2912] 10.222.0.57 () {58 vars in 1223 bytes} [Tue Jul 12 18:44:06 2022] DELETE /identity/v3/users/a758b1b59fea4c8b99fee57391c88935 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:44:06.405082 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2905e-fc5e-4ada-83e1-02476cbf7322 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:06.405610 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2905e-fc5e-4ada-83e1-02476cbf7322 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:06.405775 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2905e-fc5e-4ada-83e1-02476cbf7322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:06.423212 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-29d2905e-fc5e-4ada-83e1-02476cbf7322 None None] MFA Rules not processed for user `932830b2b4ea40b59369012d162538e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:44:06.424442 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-29d2905e-fc5e-4ada-83e1-02476cbf7322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:44:06.481178 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1452/2913] 10.222.0.57 () {58 vars in 957 bytes} [Tue Jul 12 18:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:44:06.491214 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b516de-d184-427e-a28b-c80580bef6a5 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:06.492609 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d9b516de-d184-427e-a28b-c80580bef6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:44:06.549142 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b516de-d184-427e-a28b-c80580bef6a5 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:06.552856 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2a003-4eea-437d-9b55-c3c7675ec516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6dc63ae259842209831040cbf45d316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:06.553547 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2a003-4eea-437d-9b55-c3c7675ec516 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:06.553828 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2a003-4eea-437d-9b55-c3c7675ec516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:06.554102 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2a003-4eea-437d-9b55-c3c7675ec516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:06.563838 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2a003-4eea-437d-9b55-c3c7675ec516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:06.565222 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2a003-4eea-437d-9b55-c3c7675ec516 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:06.575109 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1462/2914] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:44:06.841127 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2905e-fc5e-4ada-83e1-02476cbf7322 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:06.842664 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-29d2905e-fc5e-4ada-83e1-02476cbf7322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:44:06.855425 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2905e-fc5e-4ada-83e1-02476cbf7322 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:06.860564 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdd703-3f06-4379-b0c3-6b8031e91183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932830b2b4ea40b59369012d162538e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596f7aaab1542a3ad455f9c2becff96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:06.861468 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdd703-3f06-4379-b0c3-6b8031e91183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:06.861750 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdd703-3f06-4379-b0c3-6b8031e91183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:06.862032 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdd703-3f06-4379-b0c3-6b8031e91183 admin admin] PATH_INFO: `/v3/projects/cc432784940543d4b257dee81539a93d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:06.863230 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdd703-3f06-4379-b0c3-6b8031e91183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc432784940543d4b257dee81539a93d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:06.865137 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdd703-3f06-4379-b0c3-6b8031e91183 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:06.913704 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0ccdd703-3f06-4379-b0c3-6b8031e91183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc432784940543d4b257dee81539a93d', 'request_id': 'req-0ccdd703-3f06-4379-b0c3-6b8031e91183'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:06.917431 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:06.919510 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0ccdd703-3f06-4379-b0c3-6b8031e91183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc432784940543d4b257dee81539a93d', 'request_id': 'req-0ccdd703-3f06-4379-b0c3-6b8031e91183'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:06.926969 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0ccdd703-3f06-4379-b0c3-6b8031e91183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc432784940543d4b257dee81539a93d', 'request_id': 'req-0ccdd703-3f06-4379-b0c3-6b8031e91183'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:06.939236 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0ccdd703-3f06-4379-b0c3-6b8031e91183 admin admin] The token cache is being invalidate because project cc432784940543d4b257dee81539a93d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:44:06.939520 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0ccdd703-3f06-4379-b0c3-6b8031e91183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:06.940126 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0ccdd703-3f06-4379-b0c3-6b8031e91183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:44:06.941677 dv-cinder-835384-15-smb devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1453/2915] 10.222.0.57 () {58 vars in 1232 bytes} [Tue Jul 12 18:44:06 2022] DELETE /identity/v3/projects/cc432784940543d4b257dee81539a93d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:44:16.570807 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=30,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:16.936301 dv-cinder-835384-15-smb devstack@keystone.service[80226]: DEBUG dbcounter [-] [80226] Writing DB stats keystone:DELETE=2,keystone:SELECT=5,keystone:INSERT=1 {{(pid=80226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:46:57.931032 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2a003-4eea-437d-9b55-c3c7675ec516 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:46:57.932437 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-eac2a003-4eea-437d-9b55-c3c7675ec516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:58.071060 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2a003-4eea-437d-9b55-c3c7675ec516 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:46:58.129182 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784e70d-d071-4ec9-aa38-b55be472effd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206242c775be40c7b96af6de635e2065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee99b2e9234f88ac79ff70429b6f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:46:58.129864 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784e70d-d071-4ec9-aa38-b55be472effd service placement] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:58.130149 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784e70d-d071-4ec9-aa38-b55be472effd service placement] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:58.130445 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784e70d-d071-4ec9-aa38-b55be472effd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:58.132353 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0784e70d-d071-4ec9-aa38-b55be472effd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:58.143566 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784e70d-d071-4ec9-aa38-b55be472effd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:46:58.145151 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784e70d-d071-4ec9-aa38-b55be472effd service placement] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:46:58.155345 dv-cinder-835384-15-smb devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1463/2916] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Jul 12 18:46:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:08.151193 dv-cinder-835384-15-smb devstack@keystone.service[80227]: DEBUG dbcounter [-] [80227] Writing DB stats keystone:SELECT=89 {{(pid=80227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}